1
|
Cheng S, Laubscher CA, Gregg RD. Automatic Stub Avoidance for a Powered Prosthetic Leg Over Stairs and Obstacles. IEEE Trans Biomed Eng 2024; 71:1499-1510. [PMID: 38060364 PMCID: PMC11035099 DOI: 10.1109/tbme.2023.3340628] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/23/2024]
Abstract
Passive prosthetic legs require undesirable compensations from amputee users to avoid stubbing obstacles and stairsteps. Powered prostheses can reduce those compensations by restoring normative joint biomechanics, but the absence of user proprioception and volitional control combined with the absence of environmental awareness by the prosthesis increases the risk of collisions. This article presents a novel stub avoidance controller that automatically adjusts prosthetic knee/ankle kinematics based on suprasensory measurements of environmental distance from a small, lightweight, low-power, low-cost ultrasonic sensor mounted above the prosthetic ankle. In a case study with two transfemoral amputee participants, this control method reduced the stub rate during stair ascent by 89.95% and demonstrated an 87.50% avoidance rate for crossing different obstacles on level ground. No thigh kinematic compensation was required to achieve these results. These findings demonstrate a practical perception solution for powered prostheses to avoid collisions with stairs and obstacles while restoring normative biomechanics during daily activities.
Collapse
|
2
|
Haque MR, Islam MR, Sazonov E, Shen X. Swing-phase detection of locomotive mode transitions for smooth multi-functional robotic lower-limb prosthesis control. Front Robot AI 2024; 11:1267072. [PMID: 38680622 PMCID: PMC11045955 DOI: 10.3389/frobt.2024.1267072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 03/20/2024] [Indexed: 05/01/2024] Open
Abstract
Robotic lower-limb prostheses, with their actively powered joints, may significantly improve amputee users' mobility and enable them to obtain healthy-like gait in various modes of locomotion in daily life. However, timely recognition of the amputee users' locomotive mode and mode transition still remains a major challenge in robotic lower-limb prosthesis control. In the paper, the authors present a new multi-dimensional dynamic time warping (mDTW)-based intent recognizer to provide high-accuracy recognition of the locomotion mode/mode transition sufficiently early in the swing phase, such that the prosthesis' joint-level motion controller can operate in the correct locomotive mode and assist the user to complete the desired (and often power-demanding) motion in the stance phase. To support the intent recognizer development, the authors conducted a multi-modal gait data collection study to obtain the related sensor signal data in various modes of locomotion. The collected data were then segmented into individual cycles, generating the templates used in the mDTW classifier. Considering the large number of sensor signals available, we conducted feature selection to identify the most useful sensor signals as the input to the mDTW classifier. We also augmented the standard mDTW algorithm with a voting mechanism to make full use of the data generated from the multiple subjects. To validate the proposed intent recognizer, we characterized its performance using the data cumulated at different percentages of progression into the gait cycle (starting from the beginning of the swing phase). It was shown that the mDTW classifier was able to recognize three locomotive mode/mode transitions (walking, walking to stair climbing, and walking to stair descending) with 99.08% accuracy at 30% progression into the gait cycle, well before the stance phase starts. With its high performance, low computational load, and easy personalization (through individual template generation), the proposed mDTW intent recognizer may become a highly useful building block of a prosthesis control system to facilitate the robotic prostheses' real-world use among lower-limb amputees.
Collapse
Affiliation(s)
- Md Rejwanul Haque
- Human-Centered Bio-Robotics Lab, Department of Mechanical Engineering, The University of Alabama, Tuscaloosa, AL, United States
| | - Md Rafi Islam
- Computer Laboratory of Ambient and Wearable Systems, Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL, United States
| | - Edward Sazonov
- Computer Laboratory of Ambient and Wearable Systems, Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL, United States
| | - Xiangrong Shen
- Human-Centered Bio-Robotics Lab, Department of Mechanical Engineering, The University of Alabama, Tuscaloosa, AL, United States
| |
Collapse
|
3
|
Cortino RJ, Best TK, Gregg RD. Data-Driven Phase-Based Control of a Powered Knee-Ankle Prosthesis for Variable-Incline Stair Ascent and Descent. IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS 2024; 6:175-188. [PMID: 38304755 PMCID: PMC10829527 DOI: 10.1109/tmrb.2023.3328656] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/03/2024]
Abstract
Powered knee-ankle prostheses can offer benefits over conventional passive devices during stair locomotion by providing biomimetic net-positive work and active control of joint angles. However, many modern control approaches for stair ascent and descent are often limited by time-consuming hand-tuning of user/task-specific parameters, predefined trajectories that remove user volition, or heuristic approaches that cannot be applied to both stair ascent and descent. This work presents a phase-based hybrid kinematic and impedance controller (HKIC) that allows for semi-volitional, biomimetic stair ascent and descent at a variety of step heights. We define a unified phase variable for both stair ascent and descent that utilizes lower-limb geometry to adjust to different users and step heights. We extend our prior data-driven impedance model for variable-incline walking, modifying the cost function and constraints to create a continuously-varying impedance parameter model for stair ascent and descent over a continuum of step heights. Experiments with above-knee amputee participants (N=2) validate that our HKIC controller produces biomimetic ascent and descent joint kinematics, kinetics, and work across four step height configurations. We also show improved kinematic performance with our HKIC controller in comparison to a passive microprocessor-controlled device during stair locomotion.
Collapse
Affiliation(s)
- Ross J Cortino
- Department of Robotics, University of Michigan, Ann Arbor, MI 48109
| | - T Kevin Best
- Department of Robotics, University of Michigan, Ann Arbor, MI 48109
| | - Robert D Gregg
- Department of Robotics, University of Michigan, Ann Arbor, MI 48109
| |
Collapse
|
4
|
Barberi F, Anselmino E, Mazzoni A, Goldfarb M, Micera S. Toward the Development of User-Centered Neurointegrated Lower Limb Prostheses. IEEE Rev Biomed Eng 2024; 17:212-228. [PMID: 37639425 DOI: 10.1109/rbme.2023.3309328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
The last few years witnessed radical improvements in lower-limb prostheses. Researchers have presented innovative solutions to overcome the limits of the first generation of prostheses, refining specific aspects which could be implemented in future prostheses designs. Each aspect of lower-limb prostheses has been upgraded, but despite these advances, a number of deficiencies remain and the most capable limb prostheses fall far short of the capabilities of the healthy limb. This article describes the current state of prosthesis technology; identifies a number of deficiencies across the spectrum of lower limb prosthetic components with respect to users' needs; and discusses research opportunities in design and control that would substantially improve functionality concerning each deficiency. In doing so, the authors present a roadmap of patients related issues that should be addressed in order to fulfill the vision of a next-generation, neurally-integrated, highly-functional lower limb prosthesis.
Collapse
|
5
|
Creveling S, Cowan M, Sullivan LM, Gabert L, Lenzi T. Volitional EMG Control Enables Stair Climbing with a Robotic Powered Knee Prosthesis. PROCEEDINGS OF THE ... IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS. IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS 2023; 2023:2152-2157. [PMID: 38566973 PMCID: PMC10985630 DOI: 10.1109/iros55552.2023.10341615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Existing controllers for robotic powered prostheses regulate the prosthesis speed, timing, and energy generation using predefined position or torque trajectories. This approach enables climbing stairs step-over-step. However, it does not provide amputees with direct volitional control of the robotic prosthesis, a functionality necessary to restore full mobility to the user. Here we show that proportional electromyographic (EMG) control of the prosthesis knee torque enables volitional control of a powered knee prosthesis during stair climbing. The proposed EMG controller continuously regulates knee torque based on activation of the residual hamstrings, measured using a single EMG electrode located within the socket. The EMG signal is mapped to a desired knee flexion/extension torque based on the prosthesis knee position, the residual limb position, and the interaction with the ground. As a result, the proposed EMG controller enabled an above-knee amputee to climb stairs at different speeds, while carrying additional loads, and even backwards. By enabling direct, volitional control of powered robotic knee prostheses, the proposed EMG controller has the potential to improve amputee mobility in the real world.
Collapse
Affiliation(s)
- Suzi Creveling
- Department of Mechanical Engineering and the Robotics Center at the University of Utah
| | - Marissa Cowan
- Department of Mechanical Engineering and the Robotics Center at the University of Utah
| | - Liam M Sullivan
- Department of Mechanical Engineering and the Robotics Center at the University of Utah
| | - Lukas Gabert
- Department of Mechanical Engineering and the Robotics Center at the University of Utah
- Rocky Mountain Center for Occupational and Environmental Health
| | - Tommaso Lenzi
- Department of Mechanical Engineering and the Robotics Center at the University of Utah
- Rocky Mountain Center for Occupational and Environmental Health
- Department of Biomedical Engineering at the University of Utah
| |
Collapse
|
6
|
Hong W, Huang HH. Towards Personalized Control for Powered Knee Prostheses: Continuous Impedance Functions and PCA-Based Tuning Method. IEEE Int Conf Rehabil Robot 2023; 2023:1-6. [PMID: 37941276 DOI: 10.1109/icorr58425.2023.10304689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
Optimizing control parameters is crucial for personalizing prosthetic devices. The current method of finite state machine impedance control (FSM-IC) allows interaction with the user but requires time-consuming manual tuning. To improve efficiency, we propose a novel approach for tuning knee prostheses using continuous impedance functions (CIFs) and Principal Component Analysis (PCA). The CIFs, which represent stiffness, damping, and equilibrium angle, are modeled as fourth-order polynomials and optimized through convex optimization. By applying PCA to the CIFs, we extract principal components (PCs) that capture common features. The weights of these PCs serve as tuning parameters, allowing us to reconstruct various impedance functions. We validated this approach using data from 10 able-bodied individuals walking. The contributions of this study include: i) generating CIFs via convex optimization; ii) introducing a new tuning space based on the obtained CIFs; and iii) evaluating the feasibility of this tuning space.
Collapse
|
7
|
Culver SC, Vailati LG, Morgenroth DC, Goldfarb M. A new approach to a powered knee prosthesis: Layering powered assistance onto strictly passive prosthesis behavior. WEARABLE TECHNOLOGIES 2023; 4:e21. [PMID: 38487769 PMCID: PMC10936382 DOI: 10.1017/wtc.2023.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Revised: 04/21/2023] [Accepted: 04/27/2023] [Indexed: 03/17/2024]
Abstract
This article describes a novel approach to the control of a powered knee prosthesis where the control system provides passive behavior for most activities and then provides powered assistance only for those activities that require them. The control approach presented here is based on the categorization of knee joint function during activities into four behaviors: resistive stance behavior, active stance behavior, ballistic swing, and non-ballistic swing. The approach is further premised on the assumption that healthy non-perturbed swing-phase is characterized by a ballistic swing motion, and therefore, a replacement of that function should be similarly ballistic. The control system utilizes a six-state finite-state machine, where each state provides different constitutive behaviors (concomitant with the four aforementioned knee behaviors) which are appropriate for a range of activities. Transitions between states and torque control within states is controlled by user motion, such that the control system provides, to the extent possible, knee torque behavior as a reaction to user motion, including for powered behaviors. The control system is demonstrated on a novel device that provides a sufficiently low impedance to enable a strictly passive ballistic swing-phase, while also providing sufficiently high torque to offer powered stance-phase knee-extension during activities such as step-over stair ascent. Experiments employing the knee and control system on an individual with transfemoral amputation are presented that compare the functionality of the power-supplemented nominally passive system with that of a conventional passive microprocessor-controlled knee prosthesis.
Collapse
Affiliation(s)
- Steve C. Culver
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Léo G. Vailati
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
| | - David C. Morgenroth
- VA RR&D Center for Limb Loss and Mobility (CLiMB), Seattle, WA, USA
- Department of Rehabilitation Medicine, University of Washington, Seattle, WA, USA
| | - Michael Goldfarb
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
8
|
Simon AM, Finucane SB, Ikeda AJ, Cotton RJ, Hargrove LJ. Powered knee and ankle prosthesis use with a K2 level ambulator: a case report. FRONTIERS IN REHABILITATION SCIENCES 2023; 4:1203545. [PMID: 37387731 PMCID: PMC10300561 DOI: 10.3389/fresc.2023.1203545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Accepted: 05/25/2023] [Indexed: 07/01/2023]
Abstract
Powered prosthetic knees and ankles have the capability of restoring power to the missing joints and potential to provide increased functional mobility to users. Nearly all development with these advanced prostheses is with individuals who are high functioning community level ambulators even though limited community ambulators may also receive great benefit from these devices. We trained a 70 year old male participant with a unilateral transfemoral amputation to use a powered knee and powered ankle prosthesis. He participated in eight hours of therapist led in-lab training (two hours per week for four weeks). Sessions included static and dynamic balance activities for improved stability and comfort with the powered prosthesis and ambulation training on level ground, inclines, and stairs. Assessments were taken with both the powered prosthesis and his prescribed, passive prosthesis post-training. Outcome measures showed similarities in velocity between devices for level-ground walking and ascending a ramp. During ramp descent, the participant had a slightly faster velocity and more symmetrical stance and step times with the powered prosthesis compared to his prescribed prosthesis. For stairs, he was able to climb with reciprocal stepping for both ascent and descent, a stepping strategy he is unable to do with his prescribed prosthesis. More research with limited community ambulators is necessary to understand if further functional improvements are possible with either additional training, longer accommodation periods, and/or changes in powered prosthesis control strategies.
Collapse
Affiliation(s)
- Ann M. Simon
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
| | - Suzanne B. Finucane
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, United States
| | - Andrea J. Ikeda
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, United States
| | - R. James Cotton
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
| | - Levi J. Hargrove
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, United States
| |
Collapse
|
9
|
Hunt GR, Hood S, Gabert L, Lenzi T. Can a powered knee-ankle prosthesis improve weight-bearing symmetry during stand-to-sit transitions in individuals with above-knee amputations? J Neuroeng Rehabil 2023; 20:58. [PMID: 37131231 PMCID: PMC10155411 DOI: 10.1186/s12984-023-01177-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 04/19/2023] [Indexed: 05/04/2023] Open
Abstract
BACKGROUND After above-knee amputation, the missing biological knee and ankle are replaced with passive prosthetic devices. Passive prostheses are able to dissipate limited amounts of energy using resistive damper systems during "negative energy" tasks like sit-down. However, passive prosthetic knees are not able to provide high levels of resistance at the end of the sit-down movement when the knee is flexed, and users need the most support. Consequently, users are forced to over-compensate with their upper body, residual hip, and intact leg, and/or sit down with a ballistic and uncontrolled movement. Powered prostheses have the potential to solve this problem. Powered prosthetic joints are controlled by motors, which can produce higher levels of resistance at a larger range of joint positions than passive damper systems. Therefore, powered prostheses have the potential to make sitting down more controlled and less difficult for above-knee amputees, improving their functional mobility. METHODS Ten individuals with above-knee amputations sat down using their prescribed passive prosthesis and a research powered knee-ankle prosthesis. Subjects performed three sit-downs with each prosthesis while we recorded joint angles, forces, and muscle activity from the intact quadricep muscle. Our main outcome measures were weight-bearing symmetry and muscle effort of the intact quadricep muscle. We performed paired t-tests on these outcome measures to test for significant differences between passive and powered prostheses. RESULTS We found that the average weight-bearing symmetry improved by 42.1% when subjects sat down with the powered prosthesis compared to their passive prostheses. This difference was significant (p = 0.0012), and every subject's weight-bearing symmetry improved when using the powered prosthesis. Although the intact quadricep muscle contraction differed in shape, neither the integral nor the peak of the signal was significantly different between conditions (integral p > 0.01, peak p > 0.01). CONCLUSIONS In this study, we found that a powered knee-ankle prosthesis significantly improved weight-bearing symmetry during sit-down compared to passive prostheses. However, we did not observe a corresponding decrease in intact-limb muscle effort. These results indicate that powered prosthetic devices have the potential to improve balance during sit-down for individuals with above-knee amputation and provide insight for future development of powered prosthetics.
Collapse
Affiliation(s)
- Grace R Hunt
- Department of Mechanical Engineering, University of Utah, Salt Lake City, UT, 84112, USA.
| | - Sarah Hood
- Department of Mechanical Engineering, University of Utah, Salt Lake City, UT, 84112, USA
| | - Lukas Gabert
- Department of Mechanical Engineering, University of Utah, Salt Lake City, UT, 84112, USA
- Rocky Mountain Center for Occupational and Environmental Health, Salt Lake City, UT, USA
| | - Tommaso Lenzi
- Department of Mechanical Engineering, University of Utah, Salt Lake City, UT, 84112, USA
- Rocky Mountain Center for Occupational and Environmental Health, Salt Lake City, UT, USA
| |
Collapse
|
10
|
Gehlhar R, Tucker M, Young AJ, Ames AD. A Review of Current State-of-the-Art Control Methods for Lower-Limb Powered Prostheses. ANNUAL REVIEWS IN CONTROL 2023; 55:142-164. [PMID: 37635763 PMCID: PMC10449377 DOI: 10.1016/j.arcontrol.2023.03.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/29/2023]
Abstract
Lower-limb prostheses aim to restore ambulatory function for individuals with lower-limb amputations. While the design of lower-limb prostheses is important, this paper focuses on the complementary challenge - the control of lower-limb prostheses. Specifically, we focus on powered prostheses, a subset of lower-limb prostheses, which utilize actuators to inject mechanical power into the walking gait of a human user. In this paper, we present a review of existing control strategies for lower-limb powered prostheses, including the control objectives, sensing capabilities, and control methodologies. We separate the various control methods into three main tiers of prosthesis control: high-level control for task and gait phase estimation, mid-level control for desired torque computation (both with and without the use of reference trajectories), and low-level control for enforcing the computed torque commands on the prosthesis. In particular, we focus on the high- and mid-level control approaches in this review. Additionally, we outline existing methods for customizing the prosthetic behavior for individual human users. Finally, we conclude with a discussion on future research directions for powered lower-limb prostheses based on the potential of current control methods and open problems in the field.
Collapse
Affiliation(s)
- Rachel Gehlhar
- Department of Mechanical and Civil Engineering, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
| | - Maegan Tucker
- Department of Mechanical and Civil Engineering, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
| | - Aaron J Young
- Woodruff School of Mechanical Engineering, Georgia Institute of Technology, North Avenue, Atlanta, 30332, GA, USA
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, North Avenue, Atlanta, 30332, GA, USA
| | - Aaron D Ames
- Department of Mechanical and Civil Engineering, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
- Department of Computing and Mathematical Sciences, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
| |
Collapse
|
11
|
Farina D, Vujaklija I, Brånemark R, Bull AMJ, Dietl H, Graimann B, Hargrove LJ, Hoffmann KP, Huang HH, Ingvarsson T, Janusson HB, Kristjánsson K, Kuiken T, Micera S, Stieglitz T, Sturma A, Tyler D, Weir RFF, Aszmann OC. Toward higher-performance bionic limbs for wider clinical use. Nat Biomed Eng 2023; 7:473-485. [PMID: 34059810 DOI: 10.1038/s41551-021-00732-x] [Citation(s) in RCA: 87] [Impact Index Per Article: 87.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2019] [Accepted: 04/01/2021] [Indexed: 12/19/2022]
Abstract
Most prosthetic limbs can autonomously move with dexterity, yet they are not perceived by the user as belonging to their own body. Robotic limbs can convey information about the environment with higher precision than biological limbs, but their actual performance is substantially limited by current technologies for the interfacing of the robotic devices with the body and for transferring motor and sensory information bidirectionally between the prosthesis and the user. In this Perspective, we argue that direct skeletal attachment of bionic devices via osseointegration, the amplification of neural signals by targeted muscle innervation, improved prosthesis control via implanted muscle sensors and advanced algorithms, and the provision of sensory feedback by means of electrodes implanted in peripheral nerves, should all be leveraged towards the creation of a new generation of high-performance bionic limbs. These technologies have been clinically tested in humans, and alongside mechanical redesigns and adequate rehabilitation training should facilitate the wider clinical use of bionic limbs.
Collapse
Affiliation(s)
- Dario Farina
- Department of Bioengineering, Imperial College London, London, UK.
| | - Ivan Vujaklija
- Department of Electrical Engineering and Automation, Aalto University, Espoo, Finland
| | - Rickard Brånemark
- Center for Extreme Bionics, Biomechatronics Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Anthony M J Bull
- Department of Bioengineering, Imperial College London, London, UK
| | - Hans Dietl
- Ottobock Products SE & Co. KGaA, Vienna, Austria
| | | | - Levi J Hargrove
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, USA
- Department of Physical Medicine & Rehabilitation, Northwestern University, Chicago, IL, USA
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, USA
| | - Klaus-Peter Hoffmann
- Department of Medical Engineering & Neuroprosthetics, Fraunhofer-Institut für Biomedizinische Technik, Sulzbach, Germany
| | - He Helen Huang
- NCSU/UNC Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC, USA
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Thorvaldur Ingvarsson
- Department of Research and Development, Össur Iceland, Reykjavík, Iceland
- Faculty of Medicine, University of Iceland, Reykjavík, Iceland
| | - Hilmar Bragi Janusson
- School of Engineering and Natural Sciences, University of Iceland, Reykjavík, Iceland
| | | | - Todd Kuiken
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, USA
- Department of Physical Medicine & Rehabilitation, Northwestern University, Chicago, IL, USA
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, USA
| | - Silvestro Micera
- The Biorobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pontedera, Italy
- Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pontedera, Italy
- Bertarelli Foundation Chair in Translational NeuroEngineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Thomas Stieglitz
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering-IMTEK, BrainLinks-BrainTools Center and Bernstein Center Freiburg, University of Freiburg, Freiburg, Germany
| | - Agnes Sturma
- Department of Bioengineering, Imperial College London, London, UK
- Clinical Laboratory for Bionic Extremity Reconstruction, Department of Plastic and Reconstructive Surgery, Medical University of Vienna, Vienna, Austria
| | - Dustin Tyler
- Case School of Engineering, Case Western Reserve University, Cleveland, OH, USA
- Louis Stokes Veterans Affairs Medical Centre, Cleveland, OH, USA
| | - Richard F Ff Weir
- Biomechatronics Development Laboratory, Bioengineering Department, University of Colorado Denver and VA Eastern Colorado Healthcare System, Aurora, CO, USA
| | - Oskar C Aszmann
- Clinical Laboratory for Bionic Extremity Reconstruction, Department of Plastic and Reconstructive Surgery, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
12
|
Chen X, Chen C, Wang Y, Yang B, Ma T, Leng Y, Fu C. A Piecewise Monotonic Gait Phase Estimation Model for Controlling a Powered Transfemoral Prosthesis in Various Locomotion Modes. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3191945] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Affiliation(s)
- Xinxing Chen
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Chuheng Chen
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Yuxuan Wang
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Bowen Yang
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Teng Ma
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Yuquan Leng
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Chenglong Fu
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| |
Collapse
|
13
|
Cheng S, Bolívar-Nieto E, Welker CG, Gregg RD. Modeling the Transitional Kinematics Between Variable-Incline Walking and Stair Climbing. IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS 2022; 4:840-851. [PMID: 35991942 PMCID: PMC9386740 DOI: 10.1109/tmrb.2022.3185405] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
Although emerging powered prostheses can enable people with lower-limb amputation to walk and climb stairs over different task conditions (e.g., speeds and inclines), the control architecture typically uses a finite-state machine to switch between activity-specific controllers. Because these controllers focus on steady-state locomotion, powered prostheses abruptly switch between controllers during gait transitions rather than continuously adjusting leg biomechanics in synchrony with the users. This paper introduces a new framework for powered prosthesis control by modeling the lower-limb joint kinematics over a continuum of variable-incline walking and stair climbing, including steady-state and transitional gaits. Steady-state models for walking and stair climbing represent joint kinematics as continuous functions of gait phase, forward speed, and incline. Transition models interpolate kinematics as convex combinations of the two steady-state models, with an additional term to account for kinematics that fall outside their convex hull. The coefficients of this convex combination denote the similarity of the transitional kinematics to each steady-state mode, providing insight into how able-bodied individuals continuously transition between ambulation modes. Cross-validation demonstrates that the model predictions of untrained kinematics have errors within the range of physiological variability for all joints. Simulation results demonstrate the model's robustness to incline estimation and mode classification errors.
Collapse
Affiliation(s)
- Shihao Cheng
- Department of Mechanical Engineering and the Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| | - Edgar Bolívar-Nieto
- Department of Electrical and Computer Engineering and the Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| | - Cara Gonzalez Welker
- Department of Electrical and Computer Engineering and the Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| | - Robert D Gregg
- Department of Electrical and Computer Engineering and the Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| |
Collapse
|
14
|
Simon AM, Ursetta F, Shah K, Stephens M, Ikeda AJ, Finucane SB, McClerklin E, Lipsey J, Hargrove LJ. Ambulation Control System Design for a Hybrid Knee Prosthesis. IEEE Int Conf Rehabil Robot 2022; 2022:1-6. [PMID: 36173764 DOI: 10.1109/icorr55369.2022.9896607] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Prosthetic knees available to individuals with transfemoral amputation seek to restore functional ability to the user. Passive prosthetic knees are lightweight but can restore only limited, dissipative ambulation activities whereas active knees can provide energy to restore additional ambulation activities such as stair climbing and standing up from a chair. Semi-active prosthetic devices aim to only power a subset of activities and use passive components and control when that power is not necessary. Here, we outline an ambulation control system for a lightweight Hybrid Knee prosthesis that is powered for climbing stairs and passive for other ambulation activities (level-ground walking, walking on an incline, and stair descent). We include preliminary offline and online intent recognition system results for one able-bodied user and one individual with a transfemoral amputation demonstrating low error rates in predicting between active and passive control.
Collapse
|
15
|
Hood S, Gabert L, Lenzi T. Powered Knee and Ankle Prosthesis with Adaptive Control Enables Climbing Stairs with Different Stair Heights, Cadences, and Gait Patterns. IEEE T ROBOT 2022; 38:1430-1441. [PMID: 35686286 PMCID: PMC9175645 DOI: 10.1109/tro.2022.3152134] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/30/2023]
Abstract
Powered prostheses can enable individuals with above-knee amputations to ascend stairs step-over-step. To accomplish this task, available stair ascent controllers impose a pre-defined joint impedance behavior or follow a pre-programmed position trajectory. These control approaches have proved successful in the laboratory. However, they are not robust to changes in stair height or cadence, which is essential for real-world ambulation. Here we present an adaptive stair ascent controller that enables individuals with above-knee amputations to climb stairs of varying stair heights at their preferred cadence and with their preferred gait pattern. We found that modulating the prosthesis knee and ankle position as a function of the user's thigh in swing provides toe clearance for varying stair heights. In stance, modulating the torque-angle relationship as a function of the prosthesis knee position at foot contact provides sufficient torque assistance for climbing stairs of different heights. Furthermore, the proposed controller enables individuals to climb stairs at their preferred cadence and gait pattern, such as step-by-step, step-over-step, and two-steps. The proposed adaptive stair controller may improve the robustness of powered prostheses to environmental and human variance, enabling powered prostheses to more easily move from the lab to the real-world.
Collapse
Affiliation(s)
- Sarah Hood
- Department of Mechanical Engineering and the Robotics Center at the University of Utah, Salt Lake City, UT 84112 USA
| | - Lukas Gabert
- Department of Mechanical Engineering and the Robotics Center at the University of Utah, Salt Lake City, UT 84112 USA
| | - Tommaso Lenzi
- Department of Mechanical Engineering and the Robotics Center at the University of Utah, Salt Lake City, UT 84112 USA
| |
Collapse
|
16
|
Cortino RJ, Bolívar-Nieto E, Best TK, Gregg RD. Stair Ascent Phase-Variable Control of a Powered Knee-Ankle Prosthesis. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION : ICRA : [PROCEEDINGS]. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION 2022; 2022:5673-5678. [PMID: 36061070 PMCID: PMC9432737 DOI: 10.1109/icra46639.2022.9811578] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Passive prostheses cannot provide the net positive work required at the knee and ankle for step-over stair ascent. Powered prostheses can provide this net positive work, but user synchronization of joint motion and power input are critical to enabling natural stair ascent gaits. In this work, we build on previous phase variable-based control methods for walking and propose a stair ascent controller driven by the motion of the user's residual thigh. We use reference kinematics from an able-bodied dataset to produce knee and ankle joint trajectories parameterized by gait phase. We redefine the gait cycle to begin at the point of maximum hip flexion instead of heel strike to improve the phase estimate. Able-bodied bypass adapter experiments demonstrate that the phase variable controller replicates normative able-bodied kinematic trajectories with a root mean squared error of 12.66° and 2.64° for the knee and ankle, respectively. The knee and ankle joints provided on average 0.39 J/kg and 0.21 J/kg per stride, compared to the normative averages of 0.34 J/kg and 0.21 J/kg, respectively. Thus, this controller allows powered knee-ankle prostheses to perform net positive mechanical work to assist stair ascent.
Collapse
Affiliation(s)
- Ross J Cortino
- Department of Electrical Engineering and Computer Science and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109
| | - Edgar Bolívar-Nieto
- Department of Electrical Engineering and Computer Science and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109
| | - T Kevin Best
- Department of Electrical Engineering and Computer Science and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109
| | - Robert D Gregg
- Department of Electrical Engineering and Computer Science and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109
| |
Collapse
|
17
|
Finucane SB, Hargrove LJ, Simon AM. Functional Mobility Training With a Powered Knee and Ankle Prosthesis. FRONTIERS IN REHABILITATION SCIENCES 2022; 3. [PMID: 36003138 PMCID: PMC9396752 DOI: 10.3389/fresc.2022.790538] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Limb loss at the transfemoral or knee disarticulation level results in a significant decrease in mobility. Powered lower limb prostheses have the potential to provide increased functional mobility and return individuals to activities of daily living that are limited due to their amputation. Providing power at the knee and/or ankle, new and innovative training is required for the amputee and the clinician to understand the capabilities of these advanced devices. This protocol for functional mobility training with a powered knee and ankle prosthesis was developed while training 30 participants with a unilateral transfemoral or knee disarticulation amputation at a nationally ranked physical medicine and rehabilitation research hospital. Participants received instruction for level-ground walking, stair climbing, incline walking, and sit-to-stand transitions. A therapist provided specific training for each mode including verbal, visual, and tactile cueing along with patient education on the functionality of the device. The primary outcome measure was the ability of each participant to demonstrate independence with walking and sit-to-stand transitions along with modified independence for stair climbing and incline walking due to the use of a handrail. Every individual was successful in comfortable ambulation of level-ground walking and 27 out of 30 were successful in all other functional modes after participating in 1–3 sessions of 1–2 h in length (3 terminated their participation before attempting all activities). As these prosthetic devices continue to advance, therapy techniques must advance as well, and this paper serves as education on new training techniques that can provide amputees with the best possible tools to take advantage of these powered devices to achieve their desired clinical outcomes.
Collapse
Affiliation(s)
- Suzanne B. Finucane
- Center for Bionic Medicine, Shirley Ryan Abilitylab, Chicago, IL, United States
- *Correspondence: Suzanne B. Finucane
| | - Levi J. Hargrove
- Center for Bionic Medicine, Shirley Ryan Abilitylab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, United States
| | - Ann M. Simon
- Center for Bionic Medicine, Shirley Ryan Abilitylab, Chicago, IL, United States
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, United States
| |
Collapse
|
18
|
Rabe KG, Fey NP. Evaluating Electromyography and Sonomyography Sensor Fusion to Estimate Lower-Limb Kinematics Using Gaussian Process Regression. Front Robot AI 2022; 9:716545. [PMID: 35386586 PMCID: PMC8977408 DOI: 10.3389/frobt.2022.716545] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Accepted: 02/17/2022] [Indexed: 01/23/2023] Open
Abstract
Research on robotic lower-limb assistive devices over the past decade has generated autonomous, multiple degree-of-freedom devices to augment human performance during a variety of scenarios. However, the increase in capabilities of these devices is met with an increase in the complexity of the overall control problem and requirement for an accurate and robust sensing modality for intent recognition. Due to its ability to precede changes in motion, surface electromyography (EMG) is widely studied as a peripheral sensing modality for capturing features of muscle activity as an input for control of powered assistive devices. In order to capture features that contribute to muscle contraction and joint motion beyond muscle activity of superficial muscles, researchers have introduced sonomyography, or real-time dynamic ultrasound imaging of skeletal muscle. However, the ability of these sonomyography features to continuously predict multiple lower-limb joint kinematics during widely varying ambulation tasks, and their potential as an input for powered multiple degree-of-freedom lower-limb assistive devices is unknown. The objective of this research is to evaluate surface EMG and sonomyography, as well as the fusion of features from both sensing modalities, as inputs to Gaussian process regression models for the continuous estimation of hip, knee and ankle angle and velocity during level walking, stair ascent/descent and ramp ascent/descent ambulation. Gaussian process regression is a Bayesian nonlinear regression model that has been introduced as an alternative to musculoskeletal model-based techniques. In this study, time-intensity features of sonomyography on both the anterior and posterior thigh along with time-domain features of surface EMG from eight muscles on the lower-limb were used to train and test subject-dependent and task-invariant Gaussian process regression models for the continuous estimation of hip, knee and ankle motion. Overall, anterior sonomyography sensor fusion with surface EMG significantly improved estimation of hip, knee and ankle motion for all ambulation tasks (level ground, stair and ramp ambulation) in comparison to surface EMG alone. Additionally, anterior sonomyography alone significantly improved errors at the hip and knee for most tasks compared to surface EMG. These findings help inform the implementation and integration of volitional control strategies for robotic assistive technologies.
Collapse
Affiliation(s)
- Kaitlin G. Rabe
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, United States
- Texas Robotics Center of Excellence, The University of Texas at Austin, Austin, TX, United States
- *Correspondence: Kaitlin G. Rabe,
| | - Nicholas P. Fey
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, United States
- Texas Robotics Center of Excellence, The University of Texas at Austin, Austin, TX, United States
- Walker Department of Mechanical Engineering, The University of Texas at Austin, Austin, TX, United States
| |
Collapse
|
19
|
Woodward R, Simon A, Seyforth E, Hargrove L. Real-Time Adaptation of an Artificial Neural Network for Transfemoral Amputees Using a Powered Prosthesis. IEEE Trans Biomed Eng 2022; 69:1202-1211. [PMID: 34652995 PMCID: PMC8988236 DOI: 10.1109/tbme.2021.3120616] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE We evaluated a two-step method to improve control accuracy for a powered prosthetic leg using machine learning and adaptation, while reducing subject training time. METHODS First, information from three transfemoral amputees was grouped together, to create a baseline control system that was subsequently tested using data from a fourth subject (user-independent classification). Second, online adaptation was investigated, whereby the fourth subject's data were used to improve the baseline control system in real-time. Results were compared for user-independent classification and for user-dependent classification (data collected from and tested in the same subject), with and without adaptation. RESULTS The combination of a user-independent classifier with real-time adaptation based on a unique individual's data produced a classification error rate as low as 1.61% [0.15 standard error of the mean (SEM)] without requiring collection of initial training data from that individual. Training/testing using a subject's own data (user-dependent classification), combined with adaptation, resulted in a classification error rate of 0.9% [0.12 SEM], which was not significantly different (P 0.05) but required, on average, an additional 7.52 hours [0.92 SEM] of training sessions. CONCLUSION AND SIGNIFICANCE We found that the combination of a user-independent dataset with adaptation resulted in error rates that were not significantly different from using a user-dependent dataset. Furthermore, this method eliminated the need for individual training sessions, saving many hours of data collection time.
Collapse
|
20
|
Warner H, Khalaf P, Richter H, Simon D, Hardin E, van den Bogert AJ. Early evaluation of a powered transfemoral prosthesis with force-modulated impedance control and energy regeneration. Med Eng Phys 2022; 100:103744. [DOI: 10.1016/j.medengphy.2021.103744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 12/19/2021] [Accepted: 12/21/2021] [Indexed: 10/19/2022]
|
21
|
Best TK, Embry KR, Rouse EJ, Gregg RD. Phase-Variable Control of a Powered Knee-Ankle Prosthesis over Continuously Varying Speeds and Inclines. PROCEEDINGS OF THE ... IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS. IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS 2021; 2021:6182-6189. [PMID: 35251752 DOI: 10.1109/iros51168.2021.9636180] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Most controllers for lower-limb robotic prostheses require individually tuned parameter sets for every combination of speed and incline that the device is designed for. Because ambulation occurs over a continuum of speeds and inclines, this design paradigm requires tuning of a potentially prohibitively large number of parameters. This limitation motivates an alternative control framework that enables walking over a range of speeds and inclines while requiring only a limited number of tunable parameters. In this work, we present the implementation of a continuously varying kinematic controller on a custom powered knee-ankle prosthesis. The controller uses a phase variable derived from the residual thigh angle, along with real-time estimates of ground inclination and walking speed, to compute the appropriate knee and ankle joint angles from a continuous model of able-bodied kinematic data. We modify an existing phase variable architecture to allow for changes in speeds and inclines, quantify the closed-loop accuracy of the speed and incline estimation algorithms for various references, and experimentally validate the controller by observing that it replicates kinematic trends seen in able-bodied gait as speed and incline vary.
Collapse
Affiliation(s)
- T Kevin Best
- Department of Electrical Engineering and Computer Science and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109
| | - Kyle R Embry
- Max Nader Lab for Rehabilitation Technologies and Outcomes Research, Shirley Ryan AbilityLab, and the Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL 60611
| | - Elliott J Rouse
- Department of Mechanical Engineering and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109
| | - Robert D Gregg
- Department of Electrical Engineering and Computer Science and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109
| |
Collapse
|
22
|
Fleming A, Stafford N, Huang S, Hu X, Ferris DP, Huang H(H. Myoelectric control of robotic lower limb prostheses: a review of electromyography interfaces, control paradigms, challenges and future directions. J Neural Eng 2021; 18:10.1088/1741-2552/ac1176. [PMID: 34229307 PMCID: PMC8694273 DOI: 10.1088/1741-2552/ac1176] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Accepted: 07/06/2021] [Indexed: 11/16/2022]
Abstract
Objective.Advanced robotic lower limb prostheses are mainly controlled autonomously. Although the existing control can assist cyclic movements during locomotion of amputee users, the function of these modern devices is still limited due to the lack of neuromuscular control (i.e. control based on human efferent neural signals from the central nervous system to peripheral muscles for movement production). Neuromuscular control signals can be recorded from muscles, called electromyographic (EMG) or myoelectric signals. In fact, using EMG signals for robotic lower limb prostheses control has been an emerging research topic in the field for the past decade to address novel prosthesis functionality and adaptability to different environments and task contexts. The objective of this paper is to review robotic lower limb Prosthesis control via EMG signals recorded from residual muscles in individuals with lower limb amputations.Approach.We performed a literature review on surgical techniques for enhanced EMG interfaces, EMG sensors, decoding algorithms, and control paradigms for robotic lower limb prostheses.Main results.This review highlights the promise of EMG control for enabling new functionalities in robotic lower limb prostheses, as well as the existing challenges, knowledge gaps, and opportunities on this research topic from human motor control and clinical practice perspectives.Significance.This review may guide the future collaborations among researchers in neuromechanics, neural engineering, assistive technologies, and amputee clinics in order to build and translate true bionic lower limbs to individuals with lower limb amputations for improved motor function.
Collapse
Affiliation(s)
- Aaron Fleming
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC 27695, United States of America
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
- Equal contribution as the first author
| | - Nicole Stafford
- Department of Mechanical and Aerospace Engineering, University of Florida, Gainesville, FL 32611, United States of America
- Equal contribution as the first author
| | - Stephanie Huang
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC 27695, United States of America
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
| | - Xiaogang Hu
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC 27695, United States of America
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
| | - Daniel P Ferris
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, United States of America
| | - He (Helen) Huang
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC 27695, United States of America
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
| |
Collapse
|
23
|
Classification of Walking Environments Using Deep Learning Approach Based on Surface EMG Sensors Only. SENSORS 2021; 21:s21124204. [PMID: 34207448 PMCID: PMC8233830 DOI: 10.3390/s21124204] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Revised: 06/14/2021] [Accepted: 06/17/2021] [Indexed: 11/24/2022]
Abstract
Classification of terrain is a vital component in giving suitable control to a walking assistive device for the various walking conditions. Although surface electromyography (sEMG) signals have been combined with inputs from other sensors to detect walking intention, no study has yet classified walking environments using sEMG only. Therefore, the purpose of this study is to classify the current walking environment based on the entire sEMG profile gathered from selected muscles in the lower extremities. The muscle activations of selected muscles in the lower extremities were measured in 27 participants while they walked over flat-ground, upstairs, downstairs, uphill, and downhill. An artificial neural network (ANN) was employed to classify these walking environments using the entire sEMG profile recorded for all muscles during the stance phase. The result shows that the ANN was able to classify the current walking environment with high accuracy of 96.3% when using activation from all muscles. When muscle activation from flexor/extensor groups in the knee, ankle, and metatarsophalangeal joints were used individually to classify the environment, the triceps surae muscle activation showed the highest classification accuracy of 88.9%. In conclusion, a current walking environment was classified with high accuracy using an ANN based on only sEMG signals.
Collapse
|
24
|
Xu D, Wang Q. Noninvasive Human-Prosthesis Interfaces for Locomotion Intent Recognition: A Review. CYBORG AND BIONIC SYSTEMS 2021; 2021:9863761. [PMID: 36285130 PMCID: PMC9494705 DOI: 10.34133/2021/9863761] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2020] [Accepted: 03/22/2021] [Indexed: 12/02/2022] Open
Abstract
The lower-limb robotic prostheses can provide assistance for amputees' daily activities by restoring the biomechanical functions of missing limb(s). To set proper control strategies and develop the corresponding controller for robotic prosthesis, a prosthesis user's intent must be acquired in time, which is still a major challenge and has attracted intensive attentions. This work focuses on the robotic prosthesis user's locomotion intent recognition based on the noninvasive sensing methods from the recognition task perspective (locomotion mode recognition, gait event detection, and continuous gait phase estimation) and reviews the state-of-the-art intent recognition techniques in a lower-limb prosthesis scope. The current research status, including recognition approach, progress, challenges, and future prospects in the human's intent recognition, has been reviewed. In particular for the recognition approach, the paper analyzes the recent studies and discusses the role of each element in locomotion intent recognition. This work summarizes the existing research results and problems and contributes a general framework for the intent recognition based on lower-limb prosthesis.
Collapse
Affiliation(s)
- Dongfang Xu
- Robotics Research Group, College of Engineering, Peking University, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, China
| | - Qining Wang
- Robotics Research Group, College of Engineering, Peking University, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, China
- The Beijing Innovation Center for Engineering Science and Advanced Technology (BIC-ESAT), Peking University, China
| |
Collapse
|
25
|
Zhang K, Luo J, Xiao W, Zhang W, Liu H, Zhu J, Lu Z, Rong Y, de Silva CW, Fu C. A Subvision System for Enhancing the Environmental Adaptability of the Powered Transfemoral Prosthesis. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:3285-3297. [PMID: 32203049 DOI: 10.1109/tcyb.2020.2978216] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Visual information is indispensable to human locomotion in complex environments. Although amputees can perceive the environmental information by eyes, they cannot transmit the neural signals to prostheses directly. To augment human-prosthesis interaction, this article introduces a subvision system that can perceive environments actively, assist to control the powered prosthesis predictively, and accordingly reconstruct a complete vision-locomotion loop for transfemoral amputees. By using deep learning, the subvision system can classify common static terrains (e.g., level ground, stairs, and ramps) and estimate corresponding motion intents of amputees with high accuracy (98%). After applying the subvision system to the locomotion control system, the powered prosthesis can help amputees to achieve nonrhythmic locomotion naturally, including switching between different locomotion modes and crossing the obstacle. The subvision system can also recognize dynamic objects, such as an unexpected obstacle approaching the amputee, and assist in generating an agile obstacle-avoidance reflex movement. The experimental results demonstrate that the subvision system can cooperate with the powered prosthesis to reconstruct a complete vision-locomotion loop, which enhances the environmental adaptability of the amputees.
Collapse
|
26
|
Coker J, Chen H, Schall MC, Gallagher S, Zabala M. EMG and Joint Angle-Based Machine Learning to Predict Future Joint Angles at the Knee. SENSORS (BASEL, SWITZERLAND) 2021; 21:3622. [PMID: 34067477 PMCID: PMC8197024 DOI: 10.3390/s21113622] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Revised: 05/18/2021] [Accepted: 05/20/2021] [Indexed: 12/12/2022]
Abstract
Electromyography (EMG) is commonly used to measure electrical activity of the skeletal muscles. As exoskeleton technology advances, these signals may be used to predict human intent for control purposes. This study used an artificial neural network trained and tested with knee flexion angles and knee muscle EMG signals to predict knee flexion angles during gait at 50, 100, 150, and 200 ms into the future. The hypothesis of this study was that the algorithm's prediction accuracy would only be affected by time into the future, not subject, gender or side, and that as time into the future increased, the prediction accuracy would decrease. A secondary hypothesis was that as the number of algorithm training trials increased, the prediction accuracy of the artificial neural network (ANN) would increase. The results of this study indicate that only time into the future affected the accuracy of knee flexion angle prediction (p < 0.001), whereby greater time resulted in reduced accuracy (0.68 to 4.62 degrees root mean square error (RMSE) from 50 to 200 ms). Additionally, increased number of training trials resulted in increased angle prediction accuracy.
Collapse
Affiliation(s)
- Jordan Coker
- Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA; (J.C.); (H.C.)
| | - Howard Chen
- Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA; (J.C.); (H.C.)
| | - Mark C. Schall
- Department of Industrial Engineering, Auburn University, Auburn, AL 36849, USA; (M.C.S.J.); (S.G.)
| | - Sean Gallagher
- Department of Industrial Engineering, Auburn University, Auburn, AL 36849, USA; (M.C.S.J.); (S.G.)
| | - Michael Zabala
- Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA; (J.C.); (H.C.)
| |
Collapse
|
27
|
Donahue SR, Jin L, Hahn ME. User Independent Estimations of Gait Events With Minimal Sensor Data. IEEE J Biomed Health Inform 2021; 25:1583-1590. [PMID: 33017300 DOI: 10.1109/jbhi.2020.3028827] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
GOAL The purpose of this study was to provide an initial examination of the utility of the Beta Process - Auto Regressive - Hidden Markov Model (BP-AR-HMM) for the prior identification of gait events. A secondary objective was to determine whether the output of the model could be used for classification and prediction of locomotion states. METHODS In this study we utilized the output of the BP-AR-HMM to develop user-independent identification of gait events and gait classification from an idealized three-dimensional acceleration signal. The input acceleration data were collected from two walking (1.4 and 1.6 ms-1) and two running (2.6 and 3.0 ms-1) steady state speeds, and during two dynamic walk to run and run to walk transitions (1.8-2.4 and 2.4-1.8 ms-1) on an instrumented force treadmill. RESULTS The BP-AR-HMM identified 9 unique states. Of these, two states, 4 and 1, were utilized to estimate initial contact and toe off, respectively. The lead time from the first instance of state 4 to initial contact was 0.13 ± 0.02 s. Similarly, the first instance of state 1 occurred 0.14 ± 0.03 s before toe off. Two other states (3 and 7) were examined for possible utilization in a probabilistic model for the prediction of pending locomotion state transitions. CONCLUSION The identification of gait events prior to their occurrence by the BP-AR-HMM appears to be an approach that can minimize the quantity of sensor data in an offline approach. Furthermore, there is evidence it could also be used as a basis to build a probabilistic model to estimate locomotion transitions.
Collapse
|
28
|
Bartlett HL, King ST, Goldfarb M, Lawson BE. A Semi-Powered Ankle Prosthesis and Unified Controller for Level and Sloped Walking. IEEE Trans Neural Syst Rehabil Eng 2021; 29:320-329. [PMID: 33400653 DOI: 10.1109/tnsre.2021.3049194] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This paper describes a semi-powered ankle prosthesis and corresponding unified controller that provides biomimetic behavior for level and sloped walking without requiring identification of ground slope or modulation of control parameters. The controller is based on the observation that healthy individuals maintain an invariant external quasi-stiffness (spring like behavior between the shank and ground) when walking on level and sloped terrain. Emulating an invariant external quasi-stiffness requires an ankle that can vary the set-point (i.e., equilibrium angle) of the ankle stiffness. A semi-powered ankle prosthesis that incorporates a novel constant-volume power-asymmetric actuator was developed to provide this behavior, and the unified controller was implemented on it. The device and unified controller were assessed on three subjects with transtibial amputations while walking on inclines, level ground, and declines. Experimental results suggest that the prosthesis and accompanying controller can provide a consistent external quasi-stiffness similar to healthy subjects across all tested ground slopes.
Collapse
|
29
|
Embry KR, Gregg RD. Analysis of Continuously Varying Kinematics for Prosthetic Leg Control Applications. IEEE Trans Neural Syst Rehabil Eng 2020; 29:262-272. [PMID: 33320814 DOI: 10.1109/tnsre.2020.3045003] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Powered prosthetic legs can improve the quality of life for people with transfemoral amputations by providing net positive work at the knee and ankle, reducing the effort required from the wearer, and making more tasks possible. However, the controllers for these devices use finite state machines that limit their use to a small set of pre-defined tasks that require many hours of tuning for each user. In previous work, we demonstrated that a continuous parameterization of joint kinematics over walking speeds and inclines provides more accurate predictions of reference kinematics for control than a finite state machine. However, our previous work did not account for measurement errors in gait phase, walking speed, and ground incline, nor subject-specific differences in reference kinematics, which occur in practice. In this work, we conduct a pilot experiment to characterize the accuracy of speed and incline measurements using sensors onboard our prototype prosthetic leg and simulate phase measurements on ten able-bodied subjects using archived motion capture data. Our analysis shows that given demonstrated accuracy for speed, incline, and phase estimation, a continuous parameterization provides statistically significantly better predictions of knee and ankle kinematics than a comparable finite state machine, but both methods' primary source of predictive error is subject deviation from average kinematics.
Collapse
|
30
|
Elery T, Rezazadeh S, Nesler C, Gregg RD. Design and Validation of a Powered Knee-Ankle Prosthesis with High-Torque, Low-Impedance Actuators. IEEE T ROBOT 2020; 36:1649-1668. [PMID: 33299386 PMCID: PMC7720653 DOI: 10.1109/tro.2020.3005533] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
We present the design of a powered knee-ankle prosthetic leg, which implements high-torque actuators with low-reduction transmissions. The transmission coupled with a high-torque and low-speed motor creates an actuator with low mechanical impedance and high backdrivability. This style of actuation presents several possible benefits over modern actuation styles in emerging robotic prosthetic legs, which include free-swinging knee motion, compliance with the ground, negligible unmodeled actuator dynamics, less acoustic noise, and power regeneration. Benchtop tests establish that both joints can be backdriven by small torques (~1-3 Nm) and confirm the small reflected inertia. Impedance control tests prove that the intrinsic impedance and unmodeled dynamics of the actuator are sufficiently small to control joint impedance without torque feedback or lengthy tuning trials. Walking experiments validate performance under the designed loading conditions with minimal tuning. Lastly, the regenerative abilities, low friction, and small reflected inertia of the presented actuators reduced power consumption and acoustic noise compared to state-of-art powered legs.
Collapse
Affiliation(s)
- Toby Elery
- T. Elery is with the Departments of Bioengineering and Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080 USA. S. Rezazadeh is with the Department of Mechanical Engineering, University of Denver, Denver, CO, 80208 USA. C. Nesler and R. D. Gregg are with the Department of Electrical Engineering and Computer Science; Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| | - Siavash Rezazadeh
- T. Elery is with the Departments of Bioengineering and Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080 USA. S. Rezazadeh is with the Department of Mechanical Engineering, University of Denver, Denver, CO, 80208 USA. C. Nesler and R. D. Gregg are with the Department of Electrical Engineering and Computer Science; Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| | - Christopher Nesler
- T. Elery is with the Departments of Bioengineering and Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080 USA. S. Rezazadeh is with the Department of Mechanical Engineering, University of Denver, Denver, CO, 80208 USA. C. Nesler and R. D. Gregg are with the Department of Electrical Engineering and Computer Science; Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| | - Robert D Gregg
- T. Elery is with the Departments of Bioengineering and Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080 USA. S. Rezazadeh is with the Department of Mechanical Engineering, University of Denver, Denver, CO, 80208 USA. C. Nesler and R. D. Gregg are with the Department of Electrical Engineering and Computer Science; Robotics Institute, University of Michigan, Ann Arbor, MI, 48109 USA
| |
Collapse
|
31
|
Kumar S, Mohammadi A, Quintero D, Rezazadeh S, Gans N, Gregg RD. Extremum Seeking Control for Model-Free Auto-Tuning of Powered Prosthetic Legs. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY : A PUBLICATION OF THE IEEE CONTROL SYSTEMS SOCIETY 2020; 28:2120-2135. [PMID: 33041615 PMCID: PMC7546444 DOI: 10.1109/tcst.2019.2928514] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This paper proposes an extremum seeking controller (ESC) for simultaneously tuning the feedback control gains of a knee-ankle powered prosthetic leg using continuous-phase controllers. Previously, the proportional gains of the continuous-phase controller for each joint were tuned manually by trial-and-error, which required several iterations to achieve a balance between the prosthetic leg tracking error performance and the user's comfort. In this paper, a convex objective function is developed, which incorporates these two goals. We present a theoretical analysis demonstrating that the quasi-steady-state value of the objective function is independent of the controller damping gains. Furthermore, we prove the stability of error dynamics of continuous-phase controlled powered prosthetic leg along with ESC dynamics using averaging and singular perturbation tools. The developed cost function is then minimized by ESC in real-time to simultaneously tune the proportional gains of the knee and ankle joints. The optimum of the objective function shifts at different walking speeds, and our algorithm is suitably fast to track these changes, providing real-time adaptation for different walking conditions. Benchtop and walking experiments verify the effectiveness of the proposed ESC across various walking speeds.
Collapse
Affiliation(s)
- Saurav Kumar
- Department of Electrical Engineering and the Department of Bioengineering, University of Texas at Dallas, Richardson, TX 75080 USA
| | - Alireza Mohammadi
- Department of Electrical and Computer Engineering, University of Michigan-Dearborn, Dearborn, MI 48128 USA
| | - David Quintero
- Department of Mechanical Engineering, San Francisco State University, San Francisco, CA 94132 USA
| | - Siavash Rezazadeh
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX 75080 USA
| | - Nicholas Gans
- University of Texas at Arlington Research Institute, University of Texas at Arlington, Fort Worth, TX 76118 USA
| | - Robert D Gregg
- Department of Electrical Engineering and Computer Science and the Robotics Institute, University of Michigan, Ann Arbor, MI 48109 USA
| |
Collapse
|
32
|
Park K, Ahn HJ, Lee KH, Lee CH. Development and Performance Verification of a Motorized Prosthetic Leg for Stair Walking. Appl Bionics Biomech 2020; 2020:8872362. [PMID: 33178333 PMCID: PMC7609156 DOI: 10.1155/2020/8872362] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2020] [Revised: 08/03/2020] [Accepted: 09/25/2020] [Indexed: 11/28/2022] Open
Abstract
The present study emphasized on the optimal design of a motorized prosthetic leg and evaluation of its performance for stair walking. Developed prosthetic leg includes two degrees of freedom on the knee and ankle joint designed using a virtual product development process for better stair walking. The DC motor system was introduced to imitate gait motion in the knee joint, and a spring system was applied at the ankle joint to create torque and flexion angle. To design better motorized prosthetic leg, unnecessary mass was eliminated via a topology optimization process under a complex walking condition in a boundary considered condition and aluminum alloy for lower limb and plastic nylon through 3D printing foot which were used. The structural safety of a developed prosthetic leg was validated via finite element analysis under a variety of walking conditions. In conclusion, the motorized prosthetic leg was optimally designed while maintaining structural safety under boundary conditions based on the human walking data, and its knee motions were synchronized with normal human gait via a PD controller. The results from this study about powered transfemoral prosthesis might help amputees in their rehabilitation process. Furthermore, this research can be applied to the area of biped robots that try to mimic human motion.
Collapse
Affiliation(s)
- Kiwon Park
- Department of Mechatronics Engineering, Incheon National University, Incheon 22012, Republic of Korea
| | - Hyoung-Jong Ahn
- Department of Mechanical Engineering, Inha University, Incheon 22212, Republic of Korea
| | - Kwang-Hee Lee
- Department of Mechanical Engineering, Inha University, Incheon 22212, Republic of Korea
| | - Chul-Hee Lee
- Department of Mechanical Engineering, Inha University, Incheon 22212, Republic of Korea
| |
Collapse
|
33
|
Grimmer M, Zeiss J, Weigand F, Zhao G, Lamm S, Steil M, Heller A. Lower limb joint biomechanics-based identification of gait transitions in between level walking and stair ambulation. PLoS One 2020; 15:e0239148. [PMID: 32936793 PMCID: PMC7494088 DOI: 10.1371/journal.pone.0239148] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Accepted: 08/31/2020] [Indexed: 11/19/2022] Open
Abstract
Lower limb exoskeletons and lower limb prostheses have the potential to reduce gait limitations during stair ambulation. To develop robotic assistance devices, the biomechanics of stair ambulation and the required transitions to level walking have to be understood. This study aimed to identify the timing of these transitions, to determine if transition phases exist and how long they last, and to investigate if there exists a joint-related order and timing for the start and end of the transitions. Therefore, this study analyzed the kinematics and kinetics of both transitions between level walking and stair ascent, and between level walking and stair descent (12 subjects, 25.4 yrs, 74.6 kg). We found that transitions primarily start within the stance phase and end within the swing phase. Transition phases exist for each limb, all joints (hip, knee, ankle), and types of transitions. They have a mean duration of half of one stride and they do not last longer than one stride. The duration of the transition phase for all joints of a single limb in aggregate is less than 35% of one stride in all but one case. The distal joints initialize stair ascent, while the proximal joints primarily initialize the stair descent transitions. In general, the distal joints complete the transitions first. We believe that energy- and balance-related processes are responsible for the joint-specific transition timing. Regarding the existence of a transition phase for all joints and transitions, we believe that lower limb exoskeleton or prosthetic control concepts should account for these transitions in order to improve the smoothness of the transition and to thus increase the user comfort, safety, and user experience. Our gait data and the identified transition timings can provide a reference for the design and the performance of stair ambulation- related control concepts.
Collapse
Affiliation(s)
- Martin Grimmer
- Institute for Sports Science, Technical University of Darmstadt, Darmstadt, Hesse, Germany
| | - Julian Zeiss
- Institute of Automatic Control and Mechatronics, Technical University of Darmstadt, Darmstadt, Hesse, Germany
| | - Florian Weigand
- Institute of Automatic Control and Mechatronics, Technical University of Darmstadt, Darmstadt, Hesse, Germany
| | - Guoping Zhao
- Institute for Sports Science, Technical University of Darmstadt, Darmstadt, Hesse, Germany
| | - Sascha Lamm
- Technical University of Darmstadt, Darmstadt, Hesse, Germany
| | - Martin Steil
- Technical University of Darmstadt, Darmstadt, Hesse, Germany
| | - Adrian Heller
- Technical University of Darmstadt, Darmstadt, Hesse, Germany
| |
Collapse
|
34
|
Khademi G, Simon D. Toward Minimal-Sensing Locomotion Mode Recognition for a Powered Knee-Ankle Prosthesis. IEEE Trans Biomed Eng 2020; 68:967-979. [PMID: 32784127 DOI: 10.1109/tbme.2020.3016129] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Locomotion mode recognition (LMR) enables seamless and natural transitions between low-level control systems in a powered prosthesis. We present a new optimization framework for LMR that eliminates irrelevant or redundant features and measurement signals while still maintaining performance. METHODS We use multi-objective biogeography-based optimization to find a compromise solution between performance and the minimization of feature set size. Experimental data are collected from four transfemoral users walking with a powered knee-ankle prosthesis. We compare the performance of LMR systems trained with the optimal feature subsets and with the full feature set using a deep neural network classifier across six locomotion modes: standing, flat-ground walking, stair up/down, and ramp up/down. RESULTS Statistical tests indicate that classifier performance using the optimal feature subsets is statistically equal to that using the full feature set. The LMR trained with an optimal subset results in the 1.98% steady-state and 4.09% transitional error rates, while only using approximately 41% and 53% of the available features and sensors, respectively. CONCLUSION Results thus indicate the capability of the proposed framework to achieve simultaneously accurate and low-complex LMR systems for transfemoral individuals with powered prostheses. SIGNIFICANCE This framework would potentially lead to less frequent clinical visits needed for sensor replacement and calibrations, which may save health care costs and the prosthesis user's time and energy.
Collapse
|
35
|
Mendez J, Hood S, Gunnel A, Lenzi T. Powered knee and ankle prosthesis with indirect volitional swing control enables level-ground walking and crossing over obstacles. Sci Robot 2020; 5:5/44/eaba6635. [PMID: 33022611 DOI: 10.1126/scirobotics.aba6635] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2019] [Accepted: 06/25/2020] [Indexed: 11/02/2022]
Abstract
Powered prostheses aim to mimic the missing biological limb with controllers that are finely tuned to replicate the nominal gait pattern of non-amputee individuals. Unfortunately, this control approach poses a problem with real-world ambulation, which includes tasks such as crossing over obstacles, where the prosthesis trajectory must be modified to provide adequate foot clearance and ensure timely foot placement. Here, we show an indirect volitional control approach that enables prosthesis users to walk at different speeds while smoothly and continuously crossing over obstacles of different sizes without explicit classification of the environment. At the high level, the proposed controller relies on a heuristic algorithm to continuously change the maximum knee flexion angle and the swing duration in harmony with the user's residual limb. At the low level, minimum-jerk planning is used to continuously adapt the swing trajectory while maximizing smoothness. Experiments with three individuals with above-knee amputation show that the proposed control approach allows for volitional control of foot clearance, which is necessary to negotiate environmental barriers. Our study suggests that a powered prosthesis controller with intrinsic, volitional adaptability may provide prosthesis users with functionality that is not currently available, facilitating real-world ambulation.
Collapse
Affiliation(s)
- Joel Mendez
- Department of Mechanical Engineering and Utah Robotics Center, University of Utah, Salt Lake City, UT, USA
| | - Sarah Hood
- Department of Mechanical Engineering and Utah Robotics Center, University of Utah, Salt Lake City, UT, USA
| | - Andy Gunnel
- Department of Mechanical Engineering and Utah Robotics Center, University of Utah, Salt Lake City, UT, USA
| | - Tommaso Lenzi
- Department of Mechanical Engineering and Utah Robotics Center, University of Utah, Salt Lake City, UT, USA.
| |
Collapse
|
36
|
Wen Y, Si J, Brandt A, Gao X, Huang HH. Online Reinforcement Learning Control for the Personalization of a Robotic Knee Prosthesis. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:2346-2356. [PMID: 30668514 DOI: 10.1109/tcyb.2019.2890974] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Robotic prostheses deliver greater function than passive prostheses, but we face the challenge of tuning a large number of control parameters in order to personalize the device for individual amputee users. This problem is not easily solved by traditional control designs or the latest robotic technology. Reinforcement learning (RL) is naturally appealing. The recent, unprecedented success of AlphaZero demonstrated RL as a feasible, large-scale problem solver. However, the prosthesis-tuning problem is associated with several unaddressed issues such as that it does not have a known and stable model, the continuous states and controls of the problem may result in a curse of dimensionality, and the human-prosthesis system is constantly subject to measurement noise, environmental change and human-body-caused variations. In this paper, we demonstrated the feasibility of direct heuristic dynamic programming, an approximate dynamic programming (ADP) approach, to automatically tune the 12 robotic knee prosthesis parameters to meet individual human users' needs. We tested the ADP-tuner on two subjects (one able-bodied subject and one amputee subject) walking at a fixed speed on a treadmill. The ADP-tuner learned to reach target gait kinematics in an average of 300 gait cycles or 10 min of walking. We observed improved ADP tuning performance when we transferred a previously learned ADP controller to a new learning session with the same subject. To the best of our knowledge, our approach to personalize robotic prostheses is the first implementation of online ADP learning control to a clinical problem involving human subjects.
Collapse
|
37
|
Stolyarov R, Carney M, Herr H. Accurate Heuristic Terrain Prediction in Powered Lower-Limb Prostheses Using Onboard Sensors. IEEE Trans Biomed Eng 2020; 68:384-392. [PMID: 32406822 DOI: 10.1109/tbme.2020.2994152] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE This study describes the development and offline validation of a heuristic algorithm for accurate prediction of ground terrain in a lower limb prosthesis. This method is based on inference of the ground terrain geometry using estimation of prosthetic limb kinematics during gait with a single integrated inertial measurement unit. METHODS We asked five subjects with below-knee amputations to traverse level ground, stairs, and ramps using a high-range-of-motion powered prosthesis while internal sensor data were remotely logged. We used these data to develop three terrain prediction algorithms. The first two employed state-of-the-art machine learning approaches, while the third was a directly tuned heuristic using thresholds on estimated prosthetic ankle joint translations and ground slope. We compared the performance of these algorithms using resubstitution error for the machine learning algorithms and overall error for the heuristic algorithm. RESULTS Our optimal machine learning algorithm attained a resubstitution error of 3.4% using 45 features, while our heuristic method attained an overall prediction error of 2.8% using only 5 features derived from estimation of ground slope and horizontal and vertical ankle joint displacement. Compared with pattern recognition, the heuristic performed better on each individual subject, and across both level and non-level strides. CONCLUSION AND SIGNIFICANCE These results demonstrate a method for heuristic prediction of ground terrain in a powered prosthesis. The method is more accurate, more interpretable, and less computationally expensive than machine learning methods considered state-of-the-art for intent recognition, and relies only on integrated prosthesis sensors. Finally, the method provides intuitively tunable thresholds to improve performance for specific walking conditions.
Collapse
|
38
|
Wen Y, Li M, Si J, Huang H. Wearer-Prosthesis Interaction for Symmetrical Gait: A Study Enabled by Reinforcement Learning Prosthesis Control. IEEE Trans Neural Syst Rehabil Eng 2020; 28:904-913. [PMID: 32149646 PMCID: PMC7250159 DOI: 10.1109/tnsre.2020.2979033] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
With advances in robotic prostheses, rese-archers attempt to improve amputee's gait performance (e.g., gait symmetry) beyond restoring normative knee kinematics/kinetics. Yet, little is known about how the prosthesis mechanics/control influence wearer-prosthesis' gait performance, such as gait symmetry, stability, etc. This study aimed to investigate the influence of robotic transfemoral prosthesis mechanics on human wearers' gait symmetry. The investigation was enabled by our previously designed reinforcement learning (RL) supplementary control, which simultaneously tuned 12 control parameters that determined the prosthesis mechanics throughout a gait cycle. The RL control design facilitated safe explorations of prosthesis mechanics with the human in the loop. Subjects were recruited and walked with a robotic transfemoral prosthesis on a treadmill while the RL controller tuned the control parameters. Stance time symmetry, step length symmetry, and bilateral anteroposterior (AP) impulses were measured. The data analysis showed that changes in robotic knee mechanics led to movement variations in both lower limbs and therefore gait temporal-spatial symmetry measures. Consistent across all the subjects, inter-limb AP impulse measurements explained gait symmetry: the stance time symmetry was significantly correlated with the net inter-limb AP impulse, and the step length symmetry was significantly correlated with braking and propulsive impulse symmetry. The results suggest that it is possible to personalize transfemoral prosthesis control for improved temporal-spatial gait symmetry. However, adjusting prosthesis mechanics alone was insufficient to maximize the gait symmetry. Rather, achieving gait symmetry may require coordination between the wearer's motor control of the intact limb and adaptive control of the prosthetic joints. The results also indicated that the RL-based prosthesis tuning system was a potential tool for studying wearer-prosthesis interactions.
Collapse
|
39
|
Lee JT, Bartlett HL, Goldfarb M. Design of a Semi-Powered Stance-Control Swing-Assist Transfemoral Prosthesis. IEEE/ASME TRANSACTIONS ON MECHATRONICS : A JOINT PUBLICATION OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY AND THE ASME DYNAMIC SYSTEMS AND CONTROL DIVISION 2020; 25:175-184. [PMID: 33746502 PMCID: PMC7977329 DOI: 10.1109/tmech.2019.2952084] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
This paper describes the design of a new type of knee prosthesis called a stance-control, swing-assist (SCSA) knee prosthesis. The device is motivated by the recognition that energetically-passive stance-controlled microprocessor-controlled knees (SCMPKs) offer many desirable characteristics, such as quiet operation, low weight, high-impedance stance support, and an inertially-driven swing-phase motion. Due to the latter, however, SCMPKs are also highly susceptible to swing-phase perturbations, which can increase the likelihood of falling. The SCSA prosthesis supplements the behavior of an SCMPK with a small motor that maintains the low output impedance of the SCMPK swing state, while adding a supplemental closed-loop controller around it. This paper elaborates upon the motivation for the SCSA prosthesis, describes the design of a prosthesis prototype, and provides human-subject testing data that demonstrates potential device benefits relative to an SCMPK during both non-perturbed and perturbed walking.
Collapse
Affiliation(s)
- J T Lee
- Department of Mechanical Engineering Vanderbilt University, Nashville, TN, USA
| | - H L Bartlett
- Department of Mechanical Engineering Vanderbilt University, Nashville, TN, USA
| | - M Goldfarb
- Department of Mechanical Engineering Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
40
|
Gregory U, Ren L. Intent Prediction of Multi-axial Ankle Motion Using Limited EMG Signals. Front Bioeng Biotechnol 2019; 7:335. [PMID: 31803731 PMCID: PMC6877553 DOI: 10.3389/fbioe.2019.00335] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Accepted: 10/30/2019] [Indexed: 11/25/2022] Open
Abstract
Background: In this study, different intent prediction strategies were explored with the objective of determining the best approach to predicting continuous multi-axial user motion based solely on surface EMG (electromyography) data. These strategies were explored as the first step to better facilitating control of a multi-axis transtibial powered prosthesis. Methods: Based on data acquired from gait experiments, different data sets, prediction approaches and classification algorithms were explored. The effect of varying EMG electrode positioning was also tested. EMG data measured from three lower leg muscles was the sole data type used for making intent predictions. The motions to be predicted were along both the sagittal plane (foot dorsiflexion and plantarflexion) and the frontal plane (foot eversion and inversion). Results: The deviation of EMG data from its optimal pattern led to a decrease in prediction accuracy of up to 23%. However, using features that were calculated based on a participant's specific walking pattern limited this loss of prediction accuracy as a result of EMG electrode placement. A decoupled data set, one wherein the terrain type was accounted for beforehand, yielded the highest intent prediction accuracy of 77.2%. Conclusions: The results of this study highlighted the challenges faced when using very limited EMG data to predict multi-axial ankle motion. They also indicated that approaches that are more user-centric by design could led to more accurate motion predictions, possibly enabling more intuitive control.
Collapse
Affiliation(s)
| | - Lei Ren
- School of Mechanical, Aerospace and Civil Engineering, University of Manchester, Manchester, United Kingdom
| |
Collapse
|
41
|
Spanias JA, Simon AM, Finucane SB, Perreault EJ, Hargrove LJ. Online adaptive neural control of a robotic lower limb prosthesis. J Neural Eng 2019; 15:016015. [PMID: 29019467 DOI: 10.1088/1741-2552/aa92a8] [Citation(s) in RCA: 51] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE The purpose of this study was to develop and evaluate an adaptive intent recognition algorithm that continuously learns to incorporate a lower limb amputee's neural information (acquired via electromyography (EMG)) as they ambulate with a robotic leg prosthesis. APPROACH We present a powered lower limb prosthesis that was configured to acquire the user's neural information and kinetic/kinematic information from embedded mechanical sensors, and identify and respond to the user's intent. We conducted an experiment with eight transfemoral amputees over multiple days. EMG and mechanical sensor data were collected while subjects using a powered knee/ankle prosthesis completed various ambulation activities such as walking on level ground, stairs, and ramps. Our adaptive intent recognition algorithm automatically transitioned the prosthesis into the different locomotion modes and continuously updated the user's model of neural data during ambulation. MAIN RESULTS Our proposed algorithm accurately and consistently identified the user's intent over multiple days, despite changing neural signals. The algorithm incorporated 96.31% [0.91%] (mean, [standard error]) of neural information across multiple experimental sessions, and outperformed non-adaptive versions of our algorithm-with a 6.66% [3.16%] relative decrease in error rate. SIGNIFICANCE This study demonstrates that our adaptive intent recognition algorithm enables incorporation of neural information over long periods of use, allowing assistive robotic devices to accurately respond to the user's intent with low error rates.
Collapse
Affiliation(s)
- J A Spanias
- Center for Bionic Medicine, Shirley Ryan AbilityLab, 355 East Erie Street, Chicago, IL, United States of America. Department of Biomedical Engineering, Northwestern University, Evanston, IL, United States of America
| | | | | | | | | |
Collapse
|
42
|
Zhang K, Zhang W, Xiao W, Liu H, De Silva CW, Fu C. Sequential Decision Fusion for Environmental Classification in Assistive Walking. IEEE Trans Neural Syst Rehabil Eng 2019; 27:1780-1790. [PMID: 31425118 DOI: 10.1109/tnsre.2019.2935765] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Powered prostheses are effective for helping amputees walk in a single environment, but these devices are inconvenient to use in complex environments. In order to help amputees walk in complex environments, prostheses need to understand the motion intent of amputees. Recently, researchers have found that vision sensors can be utilized to classify environments and predict the motion intent of amputees. Although previous studies have been able to classify environments accurately in offline analysis, the corresponding time delay has not been considered. To increase the accuracy and decrease the time delay of environmental classification, the present paper proposes a new decision fusion method. In this method, the sequential decisions of environmental classification are fused by constructing a hidden Markov model and designing a transition probability matrix. The developed method is evaluated by inviting five able-bodied subjects and three amputees to perform indoor and outdoor walking experiments. The results indicate that the proposed method can classify environments with accuracy improvements of 1.01% (indoor) and 2.48% (outdoor) over the previous voting method when a delay of only one frame is incorporated. The present method also achieves higher classification accuracy than with the methods of recurrent neural network (RNN), long-short term memory (LSTM), and gated recurrent unit (GRU). When achieving the same classification accuracy, the method of the present paper can decrease the time delay by 67 ms (indoor) and 733 ms (outdoor) in comparison to the previous voting method. Besides classifying environments, the proposed decision fusion method may be able to optimize the sequential predictions of the human motion intent.
Collapse
|
43
|
Tran M, Gabert L, Cempini M, Lenzi T. A Lightweight, Efficient Fully Powered Knee Prosthesis With Actively Variable Transmission. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2892204] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
44
|
Khademi G, Mohammadi H, Simon D. Gradient-Based Multi-Objective Feature Selection for Gait Mode Recognition of Transfemoral Amputees. SENSORS 2019; 19:s19020253. [PMID: 30634668 PMCID: PMC6359457 DOI: 10.3390/s19020253] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2018] [Revised: 01/03/2019] [Accepted: 01/04/2019] [Indexed: 01/27/2023]
Abstract
One control challenge in prosthetic legs is seamless transition from one gait mode to another. User intent recognition (UIR) is a high-level controller that tells a low-level controller to switch to the identified activity mode, depending on the user's intent and environment. We propose a new framework to design an optimal UIR system with simultaneous maximum performance and minimum complexity for gait mode recognition. We use multi-objective optimization (MOO) to find an optimal feature subset that creates a trade-off between these two conflicting objectives. The main contribution of this paper is two-fold: (1) a new gradient-based multi-objective feature selection (GMOFS) method for optimal UIR design; and (2) the application of advanced evolutionary MOO methods for UIR. GMOFS is an embedded method that simultaneously performs feature selection and classification by incorporating an elastic net in multilayer perceptron neural network training. Experimental data are collected from six subjects, including three able-bodied subjects and three transfemoral amputees. We implement GMOFS and four variants of multi-objective biogeography-based optimization (MOBBO) for optimal feature subset selection, and we compare their performances using normalized hypervolume and relative coverage. GMOFS demonstrates competitive performance compared to the four MOBBO methods. We achieve a mean classification accuracy of 97.14 % ± 1.51 % and 98.45 % ± 1.22 % with the optimal selected subset for able-bodied and amputee subjects, respectively, while using only 23% of the available features. Results thus indicate the potential of advanced optimization methods to simultaneously achieve accurate, reliable, and compact UIR for locomotion mode detection of lower-limb amputees with prostheses.
Collapse
Affiliation(s)
- Gholamreza Khademi
- Department of Electrical Engineering and Computer Science, Cleveland State University, Cleveland, OH 44115, USA.
| | - Hanieh Mohammadi
- Department of Electrical Engineering and Computer Science, Cleveland State University, Cleveland, OH 44115, USA.
| | - Dan Simon
- Department of Electrical Engineering and Computer Science, Cleveland State University, Cleveland, OH 44115, USA.
| |
Collapse
|
45
|
Kumar S, Mohammadi A, Gans N, Gregg RD. Automatic Tuning of Virtual Constraint-Based Control Algorithms for Powered Knee-Ankle Prostheses. FIRST ANNUAL IEEE CONFERENCE ON CONTROL TECHNOLOGY AND APPLICATIONS : CCTA 2017 : KOHALA COAST, HAWAI'I, AUGUST 27-30, 2017. IEEE CONFERENCE ON CONTROL TECHNOLOGY AND APPLICATIONS (1ST : 2017 : WAIMEA, HAWAII ISLAND, HAWAII) 2018; 2017:812-818. [PMID: 30175324 DOI: 10.1109/ccta.2017.8062560] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
State-of-art powered prosthetic legs are often controlled using a collection of joint impedance controllers designed for different phases of a walking cycle. Consequently, finite state machines are used to control transitions between different phases. This approach requires a large number of impedance parameters and switching rules to be tuned. Since one set of control parameters cannot be used across different amputees, clinicians spend enormous time tuning these gains for each patient. This paper proposes a virtual constraint-based control scheme with a smaller set of control parameters, which are automatically tuned in real-time using an extremum seeking controller (ESC). ESC, being a model-free control method, assumes no prior knowledge of either the prosthesis or human. Using a singular perturbation analysis, we prove that the virtual constraint tracking errors are small and the PD gains remain bounded. Simulations demonstrate that our ESC-based method is capable of adapting the virtual-constraint based control parameters for amputees with different masses.
Collapse
Affiliation(s)
- Saurav Kumar
- Department of Electrical Engineering, University of Texas at Dallas, Richardson, TX 75080, USA.,Department of Bioengineering, University of Texas at Dallas, Richardson, TX 75080, USA
| | - Alireza Mohammadi
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX 75080, USA.,Department of Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080, USA
| | - Nicholas Gans
- Department of Electrical Engineering, University of Texas at Dallas, Richardson, TX 75080, USA
| | - Robert D Gregg
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX 75080, USA.,Department of Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080, USA
| |
Collapse
|
46
|
Braun JM, Wörgötter F, Manoonpong P. Modular Neural Mechanisms for Gait Phase Tracking, Prediction, and Selection in Personalizable Knee-Ankle-Foot-Orthoses. Front Neurorobot 2018; 12:37. [PMID: 30090061 PMCID: PMC6068343 DOI: 10.3389/fnbot.2018.00037] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2016] [Accepted: 06/14/2018] [Indexed: 11/13/2022] Open
Abstract
Orthoses for the lower limbs support patients to perform movements that they could not perform on their own. In traditional devices, generic gait models for a limited set of supported movements restrict the patients mobility and device acceptance. To overcome such limitations, we propose a modular neural control approach with user feedback for personalizable Knee-Ankle-Foot-Orthoses (KAFO). The modular controller consists of two main neural components: neural orthosis control for gait phase tracking and neural internal models for gait prediction and selection. A user interface providing online feedback allows the user to shape the control output that adjusts the knee damping parameter of a KAFO. The accuracy and robustness of the control approach were investigated in different conditions including walking on flat ground and descending stairs as well as stair climbing. We show that the controller accurately tracks and predicts the user's movements and generates corresponding gaits. Furthermore, based on the modular control architecture, the controller can be extended to support various distinguishable gaits depending on differences in sensory feedback.
Collapse
Affiliation(s)
- Jan-Matthias Braun
- Computational Neuroscience Group, 3. Physics Institute, Georg-August-University, Göttingen, Germany
- Bernstein Focus Neurotechnology, Georg-August-University, Göttingen, Germany
| | - Florentin Wörgötter
- Computational Neuroscience Group, 3. Physics Institute, Georg-August-University, Göttingen, Germany
- Bernstein Focus Neurotechnology, Georg-August-University, Göttingen, Germany
| | - Poramate Manoonpong
- Bernstein Focus Neurotechnology, Georg-August-University, Göttingen, Germany
- CBR Embodied AI & Neurorobotics Lab, The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, Odense, Denmark
- Bio-inspired Robotics & Neural Engineering Lab, School of Information Science & Technology, Vidyasirimedhi Institute of Science & Technology, Rayong, Thailand
| |
Collapse
|
47
|
Quintero D, Villarreal DJ, Lambert DJ, Kapp S, Gregg RD. Continuous-Phase Control of a Powered Knee-Ankle Prosthesis: Amputee Experiments Across Speeds and Inclines. IEEE T ROBOT 2018; 34:686-701. [PMID: 30008623 PMCID: PMC6042879 DOI: 10.1109/tro.2018.2794536] [Citation(s) in RCA: 93] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Control systems for powered prosthetic legs typically divide the gait cycle into several periods with distinct controllers, resulting in dozens of control parameters that must be tuned across users and activities. To address this challenge, this paper presents a control approach that unifies the gait cycle of a powered knee-ankle prosthesis using a continuous, user-synchronized sense of phase. Virtual constraints characterize the desired periodic joint trajectories as functions of a phase variable across the entire stride. The phase variable is computed from residual thigh motion, giving the amputee control over the timing of the prosthetic joint patterns. This continuous sense of phase enabled three transfemoral amputee subjects to walk at speeds from 0.67 to 1.21 m/s and slopes from -2.5 to +9.0 deg. Virtual constraints based on task-specific kinematics facilitated normative adjustments in joint work across walking speeds. A fixed set of control gains generalized across these activities and users, which minimized the configuration time of the prosthesis.
Collapse
Affiliation(s)
- David Quintero
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX 75080 USA
- Department of Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080 USA
| | - Dario J Villarreal
- Department of Electrical Engineering, Southern Methodist University, Dallas, TX 75275 USA
| | - Daniel J Lambert
- Department of Electrical and Computer Engineering, University of Texas at Dallas, Richardson, TX 75080 USA
| | - Susan Kapp
- Department of Rehabilitation Medicine, University of Washington, Seattle, WA 98104 USA
| | - Robert D Gregg
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX 75080 USA
- Department of Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080 USA
| |
Collapse
|
48
|
Culver S, Bartlett H, Shultz A, Goldfarb M. A Stair Ascent and Descent Controller for a Powered Ankle Prosthesis. IEEE Trans Neural Syst Rehabil Eng 2018; 26:993-1002. [DOI: 10.1109/tnsre.2018.2819508] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
49
|
Jayaraman C, Hoppe-Ludwig S, Deems-Dluhy S, McGuire M, Mummidisetty C, Siegal R, Naef A, Lawson BE, Goldfarb M, Gordon KE, Jayaraman A. Impact of Powered Knee-Ankle Prosthesis on Low Back Muscle Mechanics in Transfemoral Amputees: A Case Series. Front Neurosci 2018; 12:134. [PMID: 29623025 PMCID: PMC5874899 DOI: 10.3389/fnins.2018.00134] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2017] [Accepted: 02/20/2018] [Indexed: 12/04/2022] Open
Abstract
Regular use of prostheses is critical for individuals with lower limb amputations to achieve everyday mobility, maintain physical and physiological health, and achieve a better quality of life. Use of prostheses is influenced by numerous factors, with prosthetic design playing a critical role in facilitating mobility for an amputee. Thus, prostheses design can either promote biomechanically efficient or inefficient gait behavior. In addition to increased energy expenditure, inefficient gait behavior can expose prosthetic user to an increased risk of secondary musculoskeletal injuries and may eventually lead to rejection of the prosthesis. Consequently, researchers have utilized the technological advancements in various fields to improve prosthetic devices and customize them for user specific needs. One evolving technology is powered prosthetic components. Presently, an active area in lower limb prosthetic research is the design of novel controllers and components in order to enable the users of such powered devices to be able to reproduce gait biomechanics that are similar in behavior to a healthy limb. In this case series, we studied the impact of using a powered knee-ankle prostheses (PKA) on two transfemoral amputees who currently use advanced microprocessor controlled knee prostheses (MPK). We utilized outcomes pertaining to kinematics, kinetics, metabolics, and functional activities of daily living to compare the efficacy between the MPK and PKA devices. Our results suggests that the PKA allows the participants to walk with gait kinematics similar to normal gait patterns observed in a healthy limb. Additionally, it was observed that use of the PKA reduced the level of asymmetry in terms of mechanical loading and muscle activation, specifically in the low back spinae regions and lower extremity muscles. Further, the PKA allowed the participants to achieve a greater range of cadence than their predicate MPK, thus allowing them to safely ambulate in variable environments and dynamically control speed changes. Based on the results of this case series, it appears that there is considerable potential for powered prosthetic components to provide safe and efficient gait for individuals with above the knee amputation.
Collapse
Affiliation(s)
- Chandrasekaran Jayaraman
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States.,Department of Physical Therapy and Human Movement Sciences, Northwestern University, Chicago, IL, United States
| | - Shenan Hoppe-Ludwig
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States
| | - Susan Deems-Dluhy
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States
| | - Matt McGuire
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States
| | - Chaithanya Mummidisetty
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States
| | - Rachel Siegal
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States
| | - Aileen Naef
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States.,School of Life Sciences, Swiss Federal Institute of Technology in Lausanne, Lausanne, Switzerland
| | - Brian E Lawson
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, United States
| | - Michael Goldfarb
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, United States
| | - Keith E Gordon
- Department of Physical Therapy and Human Movement Sciences, Northwestern University, Chicago, IL, United States
| | - Arun Jayaraman
- Max Nader Lab for Rehabilitation Technologies & Outcomes Research, Center for Bionic Medicine, Shirley Ryan Ability Lab, Chicago, IL, United States.,Department of Physical Therapy and Human Movement Sciences, Northwestern University, Chicago, IL, United States
| |
Collapse
|
50
|
Quintero D, Martin AE, Gregg RD. Toward Unified Control of a Powered Prosthetic Leg: A Simulation Study. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY : A PUBLICATION OF THE IEEE CONTROL SYSTEMS SOCIETY 2018; 26:305-312. [PMID: 29403259 PMCID: PMC5796555 DOI: 10.1109/tcst.2016.2643566] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
This brief presents a novel control strategy for a powered knee-ankle prosthesis that unifies the entire gait cycle, eliminating the need to switch between controllers during different periods of gait. A reduced-order Discrete Fourier Transformation (DFT) is used to define virtual constraints that continuously parameterize periodic joint patterns as functions of a mechanical phasing variable. In order to leverage the provable stability properties of Hybrid Zero Dynamics (HZD), hybrid-invariant Bézier polynomials are converted into unified DFT virtual constraints for various walking speeds. Simulations of an amputee biped model show that the unified prosthesis controller approximates the behavior of the original HZD design under ideal scenarios and has advantages over the HZD design when hybrid invariance is violated by mismatches with the human controller. Two implementations of the unified virtual constraints, a feedback linearizing controller and a more practical joint impedance controller, produce similar results in simulation.
Collapse
Affiliation(s)
- David Quintero
- Departments of Bioengineering and Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080. A.E
| | - Anne E Martin
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, State College, PA 16801
| | - Robert D Gregg
- Departments of Bioengineering and Mechanical Engineering, University of Texas at Dallas, Richardson, TX 75080. A.E
| |
Collapse
|