Measuring Gait Variables Using Computer Vision to Assess Mobility and Fall Risk in Older Adults With Dementia

Video-based assessments of activities of daily living: generating real-world evidence in pediatric rare diseases

INTRODUCTION

Preserving function and independence to perform activities of daily living (ADL) is critical for patients and carers to manage the burden of care and improve quality of life. In children living with rare diseases, video recording ADLs offer the opportunity to collect the patients' experience in a real-life setting and accurately reflect treatment effectiveness on outcomes that matter to patients and families.

AREAS COVERED

We reviewed the measurement of ADL in pediatric rare diseases and the use of video to develop at-home electronic clinical outcome assessments (eCOA) by leveraging smartphone apps and artificial intelligence-based analysis. We broadly searched PubMed using Boolean combinations of the following MeSH terms 'Rare Diseases,' 'Quality of Life,' 'Activities of Daily Living,' 'Child,' 'Video Recording,' 'Outcome Assessment, Healthcare,' 'Intellectual disability,' and 'Genetic Diseases, Inborn.' Non-controlled vocabulary was used to include human pose estimation in movement analysis.

EXPERT OPINION

Broad uptake of video eCOA in drug development is linked to the generation of technical and clinical validation evidence to confidently assess a patient's functional abilities. Software platforms handling video data must align with quality regulations to ensure data integrity, security, and privacy. Regulatory flexibility and optimized validation processes should facilitate video eCOA to support benefit/risk drug assessment.

Performance of digital technologies in assessing fall risks among older adults with cognitive impairment: a systematic review

Older adults with cognitive impairment (CI) are twice as likely to fall compared to the general older adult population. Traditional fall risk assessments may not be suitable for older adults with CI due to their reliance on attention and recall. Hence, there is an interest in using objective technology-based fall risk assessment tools to assess falls within this population. This systematic review aims to evaluate the features and performance of technology-based fall risk assessment tools for older adults with CI. A systematic search was conducted across several databases such as PubMed and IEEE Xplore, resulting in the inclusion of 22 studies. Most studies focused on participants with dementia. The technologies included sensors, mobile applications, motion capture, and virtual reality. Fall risk assessments were conducted in the community, laboratory, and institutional settings; with studies incorporating continuous monitoring of older adults in everyday environments. Studies used a combination of technology-based inputs of gait parameters, socio-demographic indicators, and clinical assessments. However, many missed the opportunity to include cognitive performance inputs as predictors to fall risk. The findings of this review support the use of technology-based fall risk assessment tools for older adults with CI. Further advancements incorporating cognitive measures and additional longitudinal studies are needed to improve the effectiveness and clinical applications of these assessment tools. Additional work is also required to compare the performance of existing methods for fall risk assessment, technology-based fall risk assessments, and the combination of these approaches.

Human Pose Estimation for Clinical Analysis of Gait Pathologies

Gait analysis serves as a critical diagnostic tool for identifying neurologic and musculoskeletal damage. Traditional manual analysis of motion data, however, is labor-intensive and heavily reliant on the expertise and judgment of the therapist. This study introduces a binary classification method for the quantitative assessment of gait impairments, specifically focusing on Duchenne muscular dystrophy (DMD), a prevalent and fatal neuromuscular genetic disorder. The research compares spatiotemporal and sagittal kinematic gait features derived from 2D and 3D human pose estimation trajectories against concurrently recorded 3D motion capture (MoCap) data from healthy children. The proposed model leverages a novel benchmark dataset, collected from YouTube and publicly available datasets of their typically developed peers, to extract time-distance variables (e.g. speed, step length, stride time, and cadence) and sagittal joint angles of the lower extremity (e.g. hip, knee, and knee flexion angles). Machine learning and deep learning techniques are employed to discern patterns that can identify children exhibiting DMD gait disturbances. While the current model is capable of distinguishing between healthy subjects and those with DMD, it does not specifically differentiate between DMD patients and patients with other gait impairments. Experimental results validate the efficacy of our cost-effective method, which relies on recorded RGB video, in detecting gait abnormalities, achieving a prediction accuracy of 96.2% for Support Vector Machine (SVM) and 97% for the deep network.

Automation of Functional Mobility Assessments at Home Using a Multimodal Sensor System Integrating Inertial Measurement Units and Computer Vision (IMU-Vision)

OBJECTIVE

Functional movement assessments are routinely used to evaluate and track changes in mobility. The objective of this study was to evaluate a multimodal movement monitoring system developed for autonomous, home-based, functional movement assessment.

METHODS

Fifty frail and prefrail adults were recruited from the Brigham and Women's Hospital at Home program to evaluate the feasibility and accuracy of applying the multimodal movement monitoring system to autonomously recognize and score functional activities collected in the home. Study subjects completed sit-to-stand, standing balance (Romberg, semitandem, and tandem), and walking test activities in likeness to the Short Physical Performance Battery. Test activities were identified and scored manually and by the multimodal movement monitoring system's activity recognition and scoring algorithms, which were previously trained on lab-based biomechanical data to integrate wearable inertial measurement unit (IMU) and external red-blue-green-depth vision data. Feasibility was quantified as the proportion of completed tests that were analyzable. Accuracy was quantified as the degree of agreement between the actual and system-identified activities. In an exploratory analysis of a subset of functional activity data, the accuracy of a preliminary activity-scoring algorithm was also evaluated.

RESULTS

Activity recognition by the IMU-vision system had good feasibility and high accuracy. Of 271 test activities collected in the home, 217 (80%) were analyzable by the activity-recognition algorithm, which overall correctly identified 206 (95%) of the analyzable activities: 100% of walking, 97% of balance, and 82% of sit-to-stand activities (χ2(2) = 19.9). In the subset of 152 tests suitable for activity scoring, automatic and manual scores showed substantial agreement (Kw = 0.76 [0.69, 0.83]).

CONCLUSIONS

Autonomous recognition and scoring of home-based functional activities is enabled by a multimodal movement monitoring system that integrates inertial measurement unit and vision data. Further algorithm training with ecologically valid data and a kitted system that is independently usable by patients are needed before fully autonomous, functional movement assessment is realizable.

IMPACT

Functional movement assessments that can be administered in the home without a clinician present have the potential to democratize these evaluations and improve care access.

Clinical reliability and validity of a video-based markerless gait evaluation method

Objective

To explore the reliability and validity of gait parameters obtained from gait assessment system software employing a human posture estimation algorithm based on markerless videos of children walking in clinical practice.

Methods

Eighteen typical developmental (TD) children and ten children with developmental dysplasia of the hip (DDH) were recruited to walk along a designated sidewalk at a comfortable walking speed. A 3-dimensional gait analysis (3D GA) and a 2-dimensional markerless (2D ML) gait evaluation system were used to extract the gait kinematics parameters twice at an interval of 2 h.

Results

The two measurements of the children's kinematic gait parameters revealed no significant differences (P > 0.05). Intra-class correlation coefficients (ICC) were generally high (ICC >0.7), showing moderate to good relative reliability. The standard error of measurement (SEM) values of all gait parameters measured by the two walks were 1.26°-2.91°. The system software had good to excellent validity compared to the 3D GA, with ICC values between 0.835 and 0.957 and SEM values of 0.87°-1.71° for the gait parameters measured by both methods. The Bland-Altman plot analysis indicated no significant systematic errors.

Conclusions

The feasibility of the markerless gait assessment method using the human posture estimation-based algorithm may provide reliable and valid gait analysis results for practical clinical applications.

A pilot observational study of gait changes over time before and after an unplanned hospital visit in long-term care residents with dementia

BACKGROUND

Older adults with dementia living in long-term care (LTC) have high rates of hospitalization. Two common causes of unplanned hospital visits for LTC residents are deterioration in health status and falls. Early detection of health deterioration or increasing falls risk may present an opportunity to intervene and prevent hospitalization. There is some evidence that impairments in older adults' gait, such as reduced gait speed, increased variability, and poor balance may be associated with hospitalization. However, it is not clear whether changes in gait are observable and measurable before an unplanned hospital visit and whether these changes persist after the acute medical issue has been resolved. The objective of this study was to examine gait changes before and after an unplanned acute care hospital visit in people with dementia.

METHODS

We performed a secondary analysis of quantitative gait measures extracted from videos of natural gait captured over time on a dementia care unit and collected information about unplanned hospitalization from health records.

RESULTS

Gait changes in study participants before hospital visits were characterized by decreasing stability and step length, and increasing step variability, although these changes were also observed in participants without hospital visits. In an age and sex-adjusted mixed effects model, gait speed and step length declined more quickly in those with a hospital visit compared to those without.

CONCLUSIONS

These results provide preliminary evidence that clinically meaningful longitudinal gait changes may be captured by repeated non-invasive gait monitoring, although a larger study is needed to identify changes specific to future medical events.

Wearable multisource quantitative gait analysis of Parkinson's diseases

As the motor symptoms of Parkinson's disease (PD) are complex and influenced by many factors, it is challenging to quantify gait abnormalities adequately using a single type of signal. Therefore, a wearable multisource gait monitoring system is developed to perform a quantitative analysis of gait abnormalities for improving the effectiveness of the clinical diagnosis. To detect multisource gait data for an accurate evaluation of gait abnormalities, force sensitive sensors, piezoelectric sensors, and inertial measurement units are integrated into the devised device. The modulation circuits and wireless framework are designed to simultaneously collect plantar pressure, dynamic deformation, and postural angle of the foot and then wirelessly transmit these collected data. With the designed system, multisource gait data from PD patients and healthy controls are collected. Multisource features for quantifying gait abnormalities are extracted and evaluated by a significance test of difference and correlation analysis. The results show that the features extracted from every single type of data are able to quantify the health status of the subjects (p < 0.001, ρ > 0.50). More importantly, the validity of multisource gait data is verified. The results demonstrate that the gait feature fusing multisource data achieves a maximum correlation coefficient of 0.831, a maximum Area Under Curve of 0.9206, and a maximum feature-based classification accuracy of 88.3%. The system proposed in this study can be applied to the gait analysis and objective evaluation of PD.

Depth-Imaging for Gait Analysis on a Treadmill in Older Adults at Risk of Falling

BACKGROUND

Accidental falls are a major health issue in older people. One significant and potentially modifiable risk factor is reduced gait stability. Clinicians do not have sophisticated kinematic options to measure this risk factor with simple and affordable systems. Depth-imaging with AI-pose estimation can be used for gait analysis in young healthy adults. However, is it applicable for measuring gait in older adults at a risk of falling?

METHODS

In this methodological comparison 59 older adults with and without a history of falls walked on a treadmill while their gait pattern was recorded with multiple inertial measurement units and with an Azure Kinect depth-camera. Spatiotemporal gait parameters of both systems were compared for convergent validity and with a Bland-Altman plot.

RESULTS

Correlation between systems for stride length (r=.992, [Formula: see text]) and stride time (r=0.914, [Formula: see text]) was high. Bland-Altman plots revealed a moderate agreement in stride length (-0.74 ± 3.68 cm; [-7.96 cm to 6.47 cm]) and stride time (-3.7±54 ms; [-109 ms to 102 ms]).

CONCLUSION

Gait parameters in older adults with and without a history of falls can be measured with inertial measurement units and Azure Kinect cameras. Affordable and small depth-cameras agree with IMUs for gait analysis in older adults with and without an increased risk of falling. However, tolerable accuracy is limited to the average over multiple steps of spatiotemporal parameters derived from the initial foot contact. Clinical Translation Statement- Gait parameters in older adults with and without a history of falls can be measured with inertial measurement units and Azure Kinect. Affordable and small depth-cameras, developed for various purposes in research and industry, agree with IMUs in clinical gait analysis in older adults with and without an increased risk of falling. However, tolerable accuracy to assess function or monitor changes in gait is limited to the average over multiple steps of spatiotemporal parameters derived from the initial foot contact.

Computer Vision and Machine Learning-Based Gait Pattern Recognition for Flat Fall Prediction

BACKGROUND

Gait recognition has been applied in the prediction of the probability of elderly flat ground fall, functional evaluation during rehabilitation, and the training of patients with lower extremity motor dysfunction. Gait distinguishing between seemingly similar kinematic patterns associated with different pathological entities is a challenge for the clinician. How to realize automatic identification and judgment of abnormal gait is a significant challenge in clinical practice. The long-term goal of our study is to develop a gait recognition computer vision system using artificial intelligence (AI) and machine learning (ML) computing. This study aims to find an optimal ML algorithm using computer vision techniques and measure variables from lower limbs to classify gait patterns in healthy people. The purpose of this study is to determine the feasibility of computer vision and machine learning (ML) computing in discriminating different gait patterns associated with flat-ground falls.

METHODS

We used the Kinect^® Motion system to capture the spatiotemporal gait data from seven healthy subjects in three walking trials, including normal gait, pelvic-obliquity-gait, and knee-hyperextension-gait walking. Four different classification methods including convolutional neural network (CNN), support vector machine (SVM), K-nearest neighbors (KNN), and long short-term memory (LSTM) neural networks were used to automatically classify three gait patterns. Overall, 750 sets of data were collected, and the dataset was divided into 80% for algorithm training and 20% for evaluation.

RESULTS

The SVM and KNN had a higher accuracy than CNN and LSTM. The SVM (94.9 ± 3.36%) had the highest accuracy in the classification of gait patterns, followed by KNN (94.0 ± 4.22%). The accuracy of CNN was 87.6 ± 7.50% and that of LSTM 83.6 ± 5.35%.

CONCLUSIONS

This study revealed that the proposed AI machine learning (ML) techniques can be used to design gait biometric systems and machine vision for gait pattern recognition. Potentially, this method can be used to remotely evaluate elderly patients and help clinicians make decisions regarding disposition, follow-up, and treatment.

Enabling Gait Analysis in the Telemedicine Practice through Portable and Accurate 3D Human Pose Estimation

Human pose estimation (HPE) through deep learning-based software applications is a trend topic for markerless motion analysis. Thanks to the accuracy of the state-of-the-art technology, HPE could enable gait analysis in the telemedicine practice. On the other hand, delivering such a service at a distance requires the system to satisfy multiple and different constraints like accuracy, portability, real-time, and privacy compliance at the same time. Existing solutions either guarantee accuracy and real-time (e.g., the widespread OpenPose software on well-equipped computing platforms) or portability and data privacy (e.g., light convolutional neural networks on mobile phones). We propose a portable and low-cost platform that implements real-time and accurate 3D HPE through an embedded software on a low-power off-the-shelf computing device that guarantees privacy by default and by design. We present an extended evaluation of both accuracy and performance of the proposed solution conducted with a marker-based motion capture system (i.e., Vicon) as ground truth. The results show that the platform achieves real-time performance and high-accuracy with a deviation below the error tolerance when compared to the marker-based motion capture system (e.g., less than an error of 5^∘ on the estimated knee flexion difference on the entire gait cycle and correlation 0.91<ρ<0.99). We provide a proof-of-concept study, showing that such portable technology, considering the limited discrepancies with respect to the marker-based motion capture system and its working tolerance, could be used for gait analysis at a distance without leading to different clinical interpretation.

Patient-led development of digital endpoints and the use of computer vision analysis in assessment of motor function in rare diseases

Digital health technologies are transforming the way health outcomes are captured and measured. Digital biomarkers may provide more objective measurements than traditional approaches as they encompass continuous and longitudinal data collection and use of automated analysis for data interpretation. In addition, the use of digital health technology allows for home-based disease assessments, which in addition to reducing patient burden from on-site hospital visits, provides a more holistic picture of how the patient feels and functions in the real world. Tools that can robustly capture drug efficacy based on disease-specific outcomes that are meaningful to patients, are going to be key to the successful development of new treatments. This is particularly important for people living with rare and chronic complex conditions, where therapeutic options are limited and need to be developed using a patient-focused approach to achieve the biggest impact. Working in partnership with patient Organisation Duchenne UK, we co-developed a video-based approach, delivered through a new mobile health platform (DMD Home), to assess motor function in patients with Duchenne muscular dystrophy (DMD), a genetic, rare, muscular disease characterized by the progressive loss of muscle function and strength. Motor function tasks were selected to reflect the “transfer stage” of the disease, when patients are no longer able to walk independently but can stand and weight-bear to transfer. This stage is important for patients and families as it represents a significant milestone in the progression of DMD but it is not routinely captured and/or scored by standard DMD clinical and physiotherapy assessments. A total of 62 videos were submitted by eight out of eleven participants who onboarded the app and were analysed with pose estimation software (OpenPose) that led to the extraction of objective, quantitative measures, including time, pattern of movement trajectory, and smoothness and symmetry of movement. Computer vision analysis of video tasks to identify voluntary or compensatory movements within the transfer stage merits further investigation. Longitudinal studies to validate DMD home as a new methodology to predict progression to the non-ambulant stage will be pursued.

The Toronto older adults gait archive: video and 3D inertial motion capture data of older adults' walking

We introduce the Toronto Older Adults Gait Archive, a gait dataset of 14 older adults containing 2D video recordings, and 2D (video pose tracking algorithms) and 3D (inertial motion capture) joint locations of the lower body. Participants walked for 60 seconds. We also collected participants’ scores on four clinical assessments of gait and balance, namely the Tinneti performance-oriented mobility assessment (POMA-gait and -balance), the Berg balance scale (BBS), and the timed-up-and-go (TUG). Three human pose tracking models (Alphapose, OpenPose, and Detectron) were used to detect body joint positions in 2D video frames and a number of gait parameters were computed using 2D video-based and 3D motion capture data. To show an example usage of our datasets, we performed a correlation analysis between the gait variables and the clinical scores. Our findings revealed that the temporal but not the spatial or variability gait variables from both systems had high correlations to clinical scores. This dataset can be used to evaluate, or to enhance vision-based pose-tracking models to the specifics of older adults’ walking.

Measurement(s)	Lower Extremity Gait, CTCAE
Technology Type(s)	digital camera • Accelerometer
Sample Characteristic - Organism	Homo
Sample Characteristic - Environment	nursing home
Sample Characteristic - Location	City of Toronto

Preserving Data Privacy and Accuracy of Human Pose Estimation Software Based on CNN s for Remote Gait Analysis

In the last years there have been significant improvements in the accuracy of real-time 3D skeletal data estimation software. These applications based on convolutional neural networks (CNNs) can playa key role in a variety of clinical scenarios, from gait analysis to medical diagnosis. One of the main challenges is to apply such intelligent video analytic at a distance, which requires the system to satisfy, beside accuracy, also data privacy. To satisfy privacy by default and by design, the software has to run on "edge" computing devices, by which the sensitive information (i.e., the video stream) is elaborated close to the camera while only the process results can be stored or sent over the communication network. In this paper we address such a challenge by evaluating the accuracy of the state-of-the-art software for human pose estimation when run "at the edge". We show how the most accurate platforms for pose estimation based on complex and deep neural networks can become inaccurate due to subs amp ling of the input video frames when run on the resource constrained edge devices. In contrast, we show that, starting from less accurate and "lighter" CNNs and enhancing the pose estimation software with filters and interpolation primitives, the platform achieves better real-time performance and higher accuracy with a deviation below the error tolerance of a marker-based motion capture system.

Three-dimensional continuous gait trajectory estimation using single Shank-Worn inertial measurement units and clinical walk test application

State-of-the-art estimation methods using inertial measurement units (IMUs) for global continuous gait path and local stepwise gait trajectory during walking have been developed. However, estimation methods for continuous gait trajectory integrating both these aspects with high accuracy are almost lacking. Thus, continuous gait trajectory estimation using a single shank-worn IMU with high accuracy is proposed in this study. This method calculates three-dimensional local stepwise gait trajectory based on IMU measurement data extracted between adjacent middle points of stance phases during walking. Continuous gait trajectory is estimated by concatenating adjacent local stepwise gait trajectories based on relative angles determined according to stride vectors and shank orientations. Evaluation experiments results obtained using the optical motion capture system with 12 healthy participants demonstrated estimation errors in the stride length (− 0.027 (− 0.054 to − 0.006) m) and turning angle (0.7 (− 0.2–1.7)°), and normalized endpoint position error (0.029 (0.019–0.04) m). Comparing with previous reports, the proposed method integrally achieves a continuous gait trajectory with a low estimation error level in both local and global aspects despite the continuous measurement of multiple gait cycles. The proposed simple and low-cost method can be applied in the medical field and contribute to expansion of the application of precise gait information in daily life.

Video-Based Pose Estimation for Gait Analysis in Stroke Survivors during Clinical Assessments: A Proof-of-Concept Study

Recent advancements in deep learning have produced significant progress in markerless human pose estimation, making it possible to estimate human kinematics from single camera videos without the need for reflective markers and specialized labs equipped with motion capture systems. Such algorithms have the potential to enable the quantification of clinical metrics from videos recorded with a handheld camera. Here we used DeepLabCut, an open-source framework for markerless pose estimation, to fine-tune a deep network to track 5 body keypoints (hip, knee, ankle, heel, and toe) in 82 below-waist videos of 8 patients with stroke performing overground walking during clinical assessments. We trained the pose estimation model by labeling the keypoints in 2 frames per video and then trained a convolutional neural network to estimate 5 clinically relevant gait parameters (cadence, double support time, swing time, stance time, and walking speed) from the trajectory of these keypoints. These results were then compared to those obtained from a clinical system for gait analysis (GAITRite®, CIR Systems). Absolute accuracy (mean error) and precision (standard deviation of error) for swing, stance, and double support time were within 0.04 ± 0.11 s; Pearson's correlation with the reference system was moderate for swing times (r = 0.4-0.66), but stronger for stance and double support time (r = 0.93-0.95). Cadence mean error was -0.25 steps/min ± 3.9 steps/min (r = 0.97), while walking speed mean error was -0.02 ± 0.11 m/s (r = 0.92). These preliminary results suggest that single camera videos and pose estimation models based on deep networks could be used to quantify clinically relevant gait metrics in individuals poststroke, even while using assistive devices in uncontrolled environments. Such development opens the door to applications for gait analysis both inside and outside of clinical settings, without the need of sophisticated equipment.

Single Camera-Based Remote Physical Therapy: Verification on a Large Video Dataset

In recent years, several systems have been developed to capture human motion in real-time using common RGB cameras. This approach has great potential to become widespread among the general public as it allows the remote evaluation of exercise at no additional cost. The concept of using these systems in rehabilitation in the home environment has been discussed, but no work has addressed the practical problem of detecting basic body parts under different sensing conditions on a large scale. In this study, we evaluate the ability of the OpenPose pose estimation algorithm to perform keypoint detection of anatomical landmarks under different conditions. We infer the quality of detection based on the keypoint confidence values reported by the OpenPose. We used more than two thousand unique exercises for the evaluation. We focus on the influence of the camera view and the influence of the position of the trainees, which are essential in terms of the use for home exercise. Our results show that the position of the trainee has the greatest effect, in the following increasing order of suitability across all camera views: lying position, position on the knees, sitting position, and standing position. On the other hand, the effect of the camera view was only marginal, showing that the side view is having slightly worse results. The results might also indicate that the quality of detection of lower body joints is lower across all conditions than the quality of detection of upper body joints. In this practical overview, we present the possibilities and limitations of current camera-based systems in telerehabilitation.

Concurrent Validity of Zeno Instrumented Walkway and Video-Based Gait Features in Adults With Parkinson’s Disease

Background: Parkinson’s disease (PD) presents with motor symptoms such as bradykinesia, rigidity, and tremor that can affect gait. To monitor changes associated with disease progression or medication use, quantitative gait assessment is often performed during clinical visits. Conversely, vision-based solutions have been proposed for monitoring gait quality in non-clinical settings. Methods: We use three 2D human pose-estimation libraries (AlphaPose, Detectron, OpenPose) and one 3D library (ROMP) to calculate gait features from color video, and correlate them with those extracted by a Zeno instrumented walkway in older adults with PD. We calculate video-based gait features using a manual and automated heel-strike detection algorithm, and compare the correlations when the participants walk towards and away from the camera separately. Results: Based on analysis of 67 bidirectional walking bouts from 25 adults with PD, moderate to strong positive correlations were identified between the number of steps, cadence, as well as the mean and coefficient of variation of step width calculated from Zeno and video using 2D pose-estimation libraries. We noted that our automated heel-strike annotation method struggled to identify short steps. Conclusion: Gait features calculated from 2D joint trajectories are more strongly correlated with the Zeno than analogous gait features calculated from ROMP. Based on our analysis, videos processed with 2D pose-estimation libraries can be used for longitudinal gait monitoring in individuals with PD. Future work will seek to improve the prediction of gait features using a comprehensive machine learning model to predict gait features directly from color video without relying on intermediate extraction of joint trajectories.

A Probability Distribution Model-Based Approach for Foot Placement Prediction in the Early Swing Phase With a Wearable IMU Sensor

Predicting the next foot placement of humans during walking can help improve compliant interactions between humans and walking aid robots. Previous studies have focused on foot placement estimation with wearable inertial sensors after heel-strike, but few have predicted foot placements in advance during the early swing phase. In this study, a Bayesian inference-based foot placement prediction approach was proposed. Possible foot placements were modeled as a probability distribution grid map. With selected foot motion feature events detected sequentially in the early swing phase, the foot placement probability map could be updated iteratively using the feature models we built. The weighted center of the probability distribution was regarded as the predicted foot placement. Prediction errors were evaluated with collected walking data sets. When testing with the data from inertial measurement units, the prediction errors were (5.46 cm ± 10.89 cm, -0.83 cm ± 10.56 cm) for cross-velocity walking data and (-4.99 cm ± 12.31 cm, -11.27 cm ± 7.74 cm) for cross-subject-cross-velocity walking data. The results were comparable to previous works yet the prediction could be made earlier. For the subject who walked with more stable gaits, the prediction error can be further decreased. The proposed foot placement prediction approach can be utilized to help walking aid robots adjust their pose before each heel-strike event during walking, which will make human-robot interactions more compliant. This study is also expected to inspire additional probabilistic gait analysis works.

Gait changes over time in hospitalized older adults with advanced dementia: Predictors of mobility change

People with dementia are at risk of mobility decline. In this study, we measured changes in quantitative gait measures over a maximum 10-week period during the course of a psychogeriatric admission in older adults with dementia, with the aims to describe mobility changes over the duration of the admission, and to determine which factors were associated with this change. Fifty-four individuals admitted to a specialized dementia inpatient unit participated in this study. A vision-based markerless motion capture system was used to record participants’ natural gait. Mixed effect models were developed with gait measures as the dependent variables and clinical and demographic variables as predictors. We found that gait stability, step time, and step length decreased, and step time variability and step length variability increased over 10 weeks. Gait stability of men decreased more than that of women, associated with an increased sacrum mediolateral range of motion over time. In addition, the sacrum mediolateral range of motion decreased in those with mild neuropsychiatric symptoms over 10 weeks, but increased in those with more severe neuropsychiatric symptoms. Our study provides evidence of worsening of gait mechanics and control over the course of a hospitalization in older adults with dementia. Quantitative gait monitoring in hospital environments may provide opportunities to intervene to prevent adverse events, decelerate mobility decline, and monitor rehabilitation outcomes.

Applications of Pose Estimation in Human Health and Performance across the Lifespan

The emergence of pose estimation algorithms represents a potential paradigm shift in the study and assessment of human movement. Human pose estimation algorithms leverage advances in computer vision to track human movement automatically from simple videos recorded using common household devices with relatively low-cost cameras (e.g., smartphones, tablets, laptop computers). In our view, these technologies offer clear and exciting potential to make measurement of human movement substantially more accessible; for example, a clinician could perform a quantitative motor assessment directly in a patient's home, a researcher without access to expensive motion capture equipment could analyze movement kinematics using a smartphone video, and a coach could evaluate player performance with video recordings directly from the field. In this review, we combine expertise and perspectives from physical therapy, speech-language pathology, movement science, and engineering to provide insight into applications of pose estimation in human health and performance. We focus specifically on applications in areas of human development, performance optimization, injury prevention, and motor assessment of persons with neurologic damage or disease. We review relevant literature, share interdisciplinary viewpoints on future applications of these technologies to improve human health and performance, and discuss perceived limitations.

Prediction of Parkinsonian Gait in Older Adults with Dementia using Joint Trajectories and Gait Features from 2D Video. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021;2021:5700-5703. [PMID: 34892415 DOI: 10.1109/embc46164.2021.9630563] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

Older adults with dementia have a high risk of developing drug-induced parkinsonism; however, formal clinical gait assessments are too infrequent to capture fluctuations in their gait. Camera-based human pose estimation and tracking provides a means to frequently monitor gait in nonclinical settings. In this study, 2160 walking bouts from 49 participants were recorded using a ceiling-mounted camera. Recorded color videos were processed using AlphaPose to obtain 2D joint trajectories of the participant as they were walking down a hallway of the unit. A subset of 324 walking bouts from 14 participants were annotated with clinical scores of parkinsonism on the Unified Parkinson's Disease Rating Scale (UPDRS)-gait scale. Linear, random forest, and ordinal logistic regression models were evaluated for regression to UPDRS-gait scores using engineered 2D gait features calculated from the AlphaPose joint trajectories. Additionally, spatial temporal graph convolutional networks (ST-GCNs) were trained to predict UPDRS-gait scores from joint trajectories and gait features using a two-stage training scheme (self-supervised pretraining stage on all walks followed by a finetuning stage on labelled walks). All models were trained using leave-one-subject-out cross-validation to simulate testing on previously unseen participants. The macro-averaged F1-score was 0.333 for the best model operating on only gait features and 0.372 for the top ST-GCN model that used both joint trajectories and gait features as input. When accepting predicted scores that were only off by at most 1 point on the UPDRS-gait scale, the accuracy of the model that only used gait features was 82.8%, while the model that also used joint trajectories had an accuracy of 94.2%.Clinical Relevance- The combination of gait features and joint trajectories capture parkinsonian qualities in gait better than either group of data individually.

From Neural Command to Robotic Use: The Role of Symmetry/Asymmetry in Postural and Locomotor Activities

This article deepens a reflection on why and how symmetry/asymmetry affects the motor and postural behavior from the neural source, uterine development, child maturation, and how the notion of symmetry/asymmetry has been applied to walking robot design and control. The concepts of morphology and tensegrity are also presented to illustrate how the biological structures have been used in both sciences and arts. The development of the brain and the neuro-fascia-musculoskeletal system seems to be quite symmetric from the beginning of life through to complete maturity. The neural sources of movements (i.e., central pattern generators) are able to produce both symmetric or asymmetric responses to accommodate to environmental constraints and task requirements. Despite the fact that the human development is mainly symmetric, asymmetries already regulate neurological and physiological development. Laterality and sports training could affect natural musculoskeletal symmetry. The plasticity and flexibility of the nervous system allows the abilities to adapt and compensate for environmental constraints and musculoskeletal asymmetries in order to optimize the postural and movement control. For designing humanoid walking robots, symmetry approaches have been mainly used to reduce the complexity of the online calculation. Applications in neurological retraining and rehabilitation should also be considered.

Concurrent validity of human pose tracking in video for measuring gait parameters in older adults: a preliminary analysis with multiple trackers, viewing angles, and walking directions

Background

Many of the available gait monitoring technologies are expensive, require specialized expertise, are time consuming to use, and are not widely available for clinical use. The advent of video-based pose tracking provides an opportunity for inexpensive automated analysis of human walking in older adults using video cameras. However, there is a need to validate gait parameters calculated by these algorithms against gold standard methods for measuring human gait data in this population.

Methods

We compared quantitative gait variables of 11 older adults (mean age = 85.2) calculated from video recordings using three pose trackers (AlphaPose, OpenPose, Detectron) to those calculated from a 3D motion capture system. We performed comparisons for videos captured by two cameras at two different viewing angles, and viewed from the front or back. We also analyzed the data when including gait variables of individual steps of each participant or each participant’s averaged gait variables.

Results

Our findings revealed that, i) temporal (cadence and step time), but not spatial and variability gait measures (step width, estimated margin of stability, coefficient of variation of step time and width), calculated from the video pose tracking algorithms correlate significantly to that of motion capture system, and ii) there are minimal differences between the two camera heights, and walks viewed from the front or back in terms of correlation of gait variables, and iii) gait variables extracted from AlphaPose and Detectron had the highest agreement while OpenPose had the lowest agreement.

Conclusions

There are important opportunities to evaluate models capable of 3D pose estimation in video data, improve the training of pose-tracking algorithms for older adult and clinical populations, and develop video-based 3D pose trackers specifically optimized for quantitative gait measurement.

Kinect V2-Based Gait Analysis for Children with Cerebral Palsy: Validity and Reliability of Spatial Margin of Stability and Spatiotemporal Variables

Children with cerebral palsy (CP) have high risks of falling. It is necessary to evaluate gait stability for children with CP. In comparison to traditional motion capture techniques, the Kinect has the potential to be utilised as a cost-effective gait stability assessment tool, ensuring frequent and uninterrupted gait monitoring. To evaluate the validity and reliability of this measurement, in this study, ten children with CP performed two testing sessions, of which gait data were recorded by a Kinect V2 sensor and a referential Motion Analysis system. The margin of stability (MOS) and gait spatiotemporal metrics were examined. For the spatiotemporal parameters, intraclass correlation coefficient (ICC_2,k) values were from 0.83 to 0.99 between two devices and from 0.78 to 0.88 between two testing sessions. For the MOS outcomes, ICC_2,k values ranged from 0.42 to 0.99 between two devices and 0.28 to 0.69 between two test sessions. The Kinect V2 was able to provide valid and reliable spatiotemporal gait parameters, and it could also offer accurate outcome measures for the minimum MOS. The reliability of the Kinect V2 when assessing time-specific MOS variables was limited. The Kinect V2 shows the potential to be used as a cost-effective tool for CP gait stability assessment.

Artificial Intelligence: An Interprofessional Perspective on Implications for Geriatric Mental Health Research and Care

Artificial intelligence (AI) in healthcare aims to learn patterns in large multimodal datasets within and across individuals. These patterns may either improve understanding of current clinical status or predict a future outcome. AI holds the potential to revolutionize geriatric mental health care and research by supporting diagnosis, treatment, and clinical decision-making. However, much of this momentum is driven by data and computer scientists and engineers and runs the risk of being disconnected from pragmatic issues in clinical practice. This interprofessional perspective bridges the experiences of clinical scientists and data science. We provide a brief overview of AI with the main focus on possible applications and challenges of using AI-based approaches for research and clinical care in geriatric mental health. We suggest future AI applications in geriatric mental health consider pragmatic considerations of clinical practice, methodological differences between data and clinical science, and address issues of ethics, privacy, and trust.

Assessment of Parkinsonian gait in older adults with dementia via human pose tracking in video data

Background

Parkinsonism is common in people with dementia, and is associated with neurodegenerative and vascular changes in the brain, or with exposure to antipsychotic or other dopamine antagonist medications. The detection of parkinsonian changes to gait may provide an opportunity to intervene and address reversible causes. In this study, we investigate the use of a vision-based system as an unobtrusive means to assess severity of parkinsonism in gait.

Methods

Videos of walking bouts of natural gait were collected in a specialized dementia unit using a Microsoft Kinect sensor and onboard color camera, and were processed to extract sixteen 3D and eight 2D gait features. Univariate regression to gait quality, as rated on the Unified Parkinson’s Disease Rating Scale (UPDRS) and Simpson-Angus Scale (SAS), was used to identify gait features significantly correlated to these clinical scores for inclusion in multivariate models. Multivariate ordinal logistic regression was subsequently performed and the relative contribution of each gait feature for regression to UPDRS-gait and SAS-gait scores was assessed.

Results

Four hundred one walking bouts from 14 older adults with dementia were included in the analysis. Multivariate ordinal logistic regression models incorporating selected 2D or 3D gait features attained similar accuracies: the UPDRS-gait regression models achieved accuracies of 61.4 and 62.1% for 2D and 3D features, respectively. Similarly, the SAS-gait models achieved accuracies of 47.4 and 48.5% with 2D or 3D gait features, respectively.

Conclusions

Gait features extracted from both 2D and 3D videos are correlated to UPDRS-gait and SAS-gait scores of parkinsonism severity in gait. Vision-based systems have the potential to be used as tools for longitudinal monitoring of parkinsonism in residential settings.