Accuracy and Reliability of the Kinect Version 2 for Clinical Measurement of Motor Function

Analysis of Factors Influencing the Precision of Body Tracking Outcomes in Industrial Gesture Control

The body tracking systems on the current market offer a wide range of options for tracking the movements of objects, people, or extremities. The precision of this technology is often limited and determines its field of application. This work aimed to identify relevant technical and environmental factors that influence the performance of body tracking in industrial environments. The influence of light intensity, range of motion, speed of movement and direction of hand movement was analyzed individually and in combination. The hand movement of a test person was recorded with an Azure Kinect at a distance of 1.3 m. The joints in the center of the hand showed the highest accuracy compared to other joints. The best results were achieved at a luminous intensity of 500 lx, and movements in the x-axis direction were more precise than in the other directions. The greatest inaccuracy was found in the z-axis direction. A larger range of motion resulted in higher inaccuracy, with the lowest data scatter at a 100 mm range of motion. No significant difference was found at hand velocity of 370 mm/s, 670 mm/s and 1140 mm/s. This study emphasizes the potential of RGB-D camera technology for gesture control of industrial robots in industrial environments to increase efficiency and ease of use.

Concurrent Validity of Motion Parameters Measured With an RGB-D Camera-Based Markerless 3D Motion Tracking Method in Children and Young Adults

OBJECTIVE

Low-cost, portable RGB-D cameras with integrated motion tracking functionality enable easy-to-use 3D motion analysis without requiring expensive facilities and specialized personnel. However, the accuracy of existing systems is insufficient for most clinical applications, particularly when applied to children. In previous work, we developed an RGB-D camera-based motion tracking method and showed that it accurately captures body joint positions of children and young adults in 3D. In this study, the validity and accuracy of clinically relevant motion parameters that were computed from kinematics of our motion tracking method are evaluated in children and young adults.

METHODS

Twenty-three typically developing children and healthy young adults (5-29 years, 110-189 cm) performed five movement tasks while being recorded simultaneously with a marker-based Vicon system and an Azure Kinect RGB-D camera. Motion parameters were computed from the extracted kinematics of both methods: time series measurements, i.e., measurements over time, peak measurements, i.e., measurements at a single time instant, and movement smoothness. The agreement of these parameter values was evaluated using Pearson's correlation coefficients r for time series data, and mean absolute error (MAE) and Bland-Altman plots with limits of agreement for peak measurements and smoothness.

RESULTS

Time series measurements showed strong to excellent correlations (r-values between 0.8 and 1.0), MAE for angles ranged from 1.5 to 5 degrees and for smoothness parameters (SPARC) from 0.02-0.09, while MAE for distance-related parameters ranged from 9 to 15 mm.

CONCLUSION

Extracted motion parameters are valid and accurate for various movement tasks in children and young adults, demonstrating the suitability of our tracking method for clinical motion analysis.

CLINICAL IMPACT

The low-cost portable hardware in combination with our tracking method enables motion analysis outside of specialized facilities while providing measurements that are close to those of the clinical gold-standard.

Test-Retest Reliability of Movement Displacement during a 20-s Stepping-in-Place Test in Community-Dwelling Older Adults with and without Supportive Care

INTRODUCTION

Our recent reports have shown that movement pattern and displacement assessed with an infrared depth sensor during a 20-s stepping-in-place test (ST) correlates with measures of balance and need for assistance in older individuals. This study investigated ST test-retest reliability in community-dwelling older adults with and without supportive care.

METHODS

Two groups were included: those not participating (HO: n = 25, 74.7 ± 5.2 years) and those participating (DSU: n = 41, 78.8 ± 5.8 years) in regular senior day services (supportive care). HO completed three ST trials, separated by 1 week, while DSU completed two ST trials during the same half-day supportive care visit. Testing was conducted with eyes open. ST measures included head movement path distance (TMD), maximum movement displacement (MMD), knee movement path length (KMD), and stepping rate (STEP). TMD×KMD-1 ratio indicated upper-body sway relative to lower-body. Test-retest reliability (intra-class correlation coefficients, ICCs) and between-trial and between group differences (ANCOVA, adjusting for age) were assessed.

RESULTS

After adjusting for age, TMD, KMD, TMD×KMD-1 were lesser and STEP was greater in HO than DUS. HO ST variables did not differ across testing days. HO ICC (1, 3) for TMD (0.911 [95% confidence interval: 0.827-0.958]), MMD (0.918 [0.814-0.961]), KMD (0.838 [0.685-0.923]), and TMD×KMD-1 (0.940 [0.884-0.872]) showed strong to very strong reliability. Similarly, DSU ST variables did not differ across same day trials and ICC (1, 2) for TMD, KMD, and TMD×KMD-1 displayed very strong reliability.

CONCLUSION

These ST variables exhibited excellent test-retest reliability of discriminating between community-dwelling older adults with and without supportive care.

Kinematic synergies show good consistency when extracted with a low-cost markerless device and a marker-based motion tracking system

Recently, markerless tracking systems, such as RGB-Depth cameras, have spread to overcome some of the limitations of the gold standard marker-based tracking systems. Although these systems are valuable substitutes for human motion analysis, as they guarantee higher flexibility, faster setup time and lower costs, their tracking accuracy is lower with respect to marker-based systems. Many studies quantified the error made by markerless systems in terms of body segment length estimation, articular angles, and biomechanics, concluding that they are appropriate for many clinical applications related to motion analysis. We propose an innovative approach to compare a markerless tracking system (Kinect V2) with a gold standard marker-based system (Vicon), based on motor control assessment. We quantified kinematic synergies from the tracking data of fifteen participants performing multi-directional upper limb movements. Kinematic synergy analysis decomposes the kinematic data into a reduced set of motor primitives that describe how the central nervous system coordinates motion at spatial and temporal level. Synergies were extracted with the recently released mixed-matrix factorization algorithm. Four synergies were extracted from both marker-based and markerless datasets and synergies were grouped in 6 clusters for each dataset. Cosine similarity in each cluster was ⩾0.60 in both systems, showing good consistency of synergies. Good matching was found between synergies extracted from markerless and from marker-based data, with a cosine similarity between matched synergies ⩾0.60 in 5 out 6 synergies. These results showed that the markerless sensor can be feasible for kinematic synergy analysis for gross movements, as it correctly estimates the number of synergies and in most cases also their spatial and temporal organization.

Accuracy, Validity, and Reliability of Markerless Camera-Based 3D Motion Capture Systems versus Marker-Based 3D Motion Capture Systems in Gait Analysis: A Systematic Review and Meta-Analysis

(1) Background: Marker-based 3D motion capture systems (MBS) are considered the gold standard in gait analysis. However, they have limitations for which markerless camera-based 3D motion capture systems (MCBS) could provide a solution. The aim of this systematic review and meta-analysis is to compare the accuracy, validity, and reliability of MCBS and MBS. (2) Methods: A total of 2047 papers were systematically searched according to PRISMA guidelines on 7 February 2024, in two different databases: Pubmed (1339) and WoS (708). The COSMIN-tool and EBRO guidelines were used to assess risk of bias and level of evidence. (3) Results: After full text screening, 22 papers were included. Spatiotemporal parameters showed overall good to excellent accuracy, validity, and reliability. For kinematic variables, hip and knee showed moderate to excellent agreement between the systems, while for the ankle joint, poor concurrent validity and reliability were measured. The accuracy and concurrent validity of walking speed were considered excellent in all cases, with only a small bias. The meta-analysis of the inter-rater reliability and concurrent validity of walking speed, step time, and step length resulted in a good-to-excellent intraclass correlation coefficient (ICC) (0.81; 0.98). (4) Discussion and conclusions: MCBS are comparable in terms of accuracy, concurrent validity, and reliability to MBS in spatiotemporal parameters. Additionally, kinematic parameters for hip and knee in the sagittal plane are considered most valid and reliable but lack valid and accurate measurement outcomes in transverse and frontal planes. Customization and standardization of methodological procedures are necessary for future research to adequately compare protocols in clinical settings, with more attention to patient populations.

Clinical Feasibility of a Markerless Gait Analysis System

Background

The gait analysis method that has been used in clinical practice to date is an optical tracking system (OTS) using a marker, but a markerless gait analysis (MGA) system is being developed because of the expensive cost and complicated examination of the OTS. To apply this MGA clinically, a comparative study of the MGA and OTS methods is necessary. The purpose of this study was to evaluate the compatibility between the OTS and the MGA methods and to evaluate the usefulness of the MGA system in actual clinical settings.

Methods

From March 2021 to August 2021, 14 patients underwent gait analysis using the OTS and MGA system, and the spatiotemporal parameters and kinematic results obtained by the 2 methods were compared. To evaluate the practicality of the MGA system in an actual clinical setting, MGA was performed on 14 symptomatic children with idiopathic toe walking, who had been treated with a corrective cast, and the pre-cast and post-cast results were compared. For the OTS, the Motion Analysis Eagle system was used, and for MGA, DH Walk was used.

Results

The spatiotemporal parameters showed no significant difference between the OTS and MGA system. The joint angle graphs of the kinematics along the sagittal plane showed similar shapes as a whole, with particularly high correlations in the hip and knee (pelvis: 29.4%, hip joint: 96.7%, knee joint: 94.9%, and ankle joint: 68.5%). A quantified comparison using the CORrelation and Analysis (CORA) score also showed high similarity between the 2 methods. The MGA results of pre-cast application and post-cast removal for children with idiopathic toe walking showed a statistically significant improvement in ankle dorsiflexion after treatment (p < 0.001).

Conclusions

MGA showed a good correlation with the conventional OTS in terms of spatiotemporal parameters and kinematics. We demonstrated that ankle sagittal kinematics improved after treatment by corrective cast in children with idiopathic toe walking using the MGA method. Thus, after the improvement of a few limitations, the MGA system may soon be able to be clinically applied.

Digital Motor Biomarkers of Cerebellar Ataxia Using an RGB-Depth Camera-Based Motion Analysis System

This study aimed to identify quantitative biomarkers of motor function for cerebellar ataxia by evaluating gait and postural control using an RGB-depth camera-based motion analysis system. In 28 patients with degenerative cerebellar ataxia and 33 age- and sex-matched healthy controls, motor tasks (short-distance walk, closed feet stance, and stepping in place) were selected from a previously reported protocol, and scanned using Kinect V2 and customized software. The Clinical Assessment Scale for the Assessment and Rating of Ataxia (SARA) was also evaluated. Compared with the normal control group, the cerebellar ataxia group had slower gait speed and shorter step lengths, increased step width, and mediolateral trunk sway in the walk test (all P < 0.001). Lateral sway increased in the stance test in the ataxia group (P < 0.001). When stepping in place, the ataxia group showed higher arrhythmicity of stepping and increased stance time (P < 0.001). In the correlation analyses, the ataxia group showed a positive correlation between the total SARA score and arrhythmicity of stepping in place (r = 0.587, P = 0.001). SARA total score (r = 0.561, P = 0.002) and gait subscore (ρ = 0.556, P = 0.002) correlated with mediolateral truncal sway during walking. These results suggest that the RGB-depth camera-based motion analyses on mediolateral truncal sway during walking and arrhythmicity of stepping in place are useful digital motor biomarkers for the assessment of cerebellar ataxia, and could be utilized in future clinical trials.

Dynamic assessment of spine movement patterns using an RGB-D camera and deep learning

In clinical practice, functional limitations in patients with low back pain are subjectively assessed, potentially leading to misdiagnosis and prolonged pain. This paper proposes an objective deep learning (DL) markerless motion capture system that uses a red-green-blue-depth (RGB-D) camera to measure the kinematics of the spine during flexion-extension (FE) through: 1) the development and validation of a DL semantic segmentation algorithm that segments the back into four anatomical classes and 2) the development and validation of a framework that uses these segmentations to measure spine kinematics during FE. Twenty participants performed ten cycles of FE with drawn-on point markers while being recorded with an RGB-D camera. Five of these participants also performed an additional trial where they were recorded with an optical motion capture (OPT) system. The DL algorithm was trained to segment the back and pelvis into four anatomical classes: upper back, lower back, spine, and pelvis. A kinematic framework was then developed to refine these segmentations into upper spine, lower spine, and pelvis masks, which were used to measure spine kinematics after obtaining 3D global coordinates of the mask corners. The segmentation algorithm achieved high accuracy, and the root mean square error (RMSE) between ground truth and predicted lumbar kinematics was < 4°. When comparing markerless and OPT kinematics, RMSE values were < 6°. This work demonstrates the feasibility of using markerless motion capture to assess FE spine movement in clinical settings. Future work will expand the studied movement directions and test on different demographics.

A multifactorial fall risk assessment system for older people utilizing a low-cost, markerless Microsoft Kinect

Falls among older people are a major health concern. This study aims to develop a multifactorial fall risk assessment system for older people using a low-cost, markerless Microsoft Kinect. A Kinect-based test battery was designed to comprehensively assess major fall risk factors. A follow-up experiment was conducted with 102 older participants to assess their fall risks. Participants were divided into high and low fall risk groups based on their prospective falls over a 6-month period. Results showed that the high fall risk group performed significantly worse on the Kinect-based test battery. The developed random forest classification model achieved an average classification accuracy of 84.7%. In addition, the individual's performance was computed as the percentile value of a normative database to visualise deficiencies and targets for intervention. These findings indicate that the developed system can not only screen out 'at risk' older individuals with good accuracy, but also identify potential fall risk factors for effective fall intervention.Practitioner summary: Falls are the leading cause of injuries in older people. We newly developed a multifactorial fall risk assessment system for older people utilising a low-cost, markerless Kinect. Results showed that the developed system can screen out 'at risk' individuals and identify potential risk factors for effective fall intervention.

Azure Kinect performance evaluation for human motion and upper limb biomechanical analysis

Human motion tracking is a valuable task for many medical applications. Marker-based optoelectronic systems are considered the gold standard in human motion tracking. However, their use is not always feasible in clinics and industrial environments. On the other hand, marker-less sensors became valuable tools, as they are inexpensive, noninvasive and easy to use. However, their accuracy can depend on many factors including sensor positioning, light conditions and body occlusions. In this study, following previous works on the feasibility of marker-less systems for human motion monitoring, we investigate the performance of the Microsoft Azure Kinect sensor in computing kinematic and dynamic measurements of static postures and dynamic movements. According to our knowledge, it is the first time that this sensor is compared with a Vicon marker-based system to assess the best camera positioning while observing the upper body part movements of people performing several tasks. Twenty-five healthy volunteers were monitored to evaluate the effects of the several testing conditions, including the Azure Kinect positions, the light conditions, and lower limbs occlusions, on the tracking accuracy of kinematic, dynamic, and motor control parameters. From the statistical analysis of the performed measurements, the camera in the frontal position was the most reliable, the lighting conditions had almost no effects on the tracking accuracy, while the lower limbs occlusion worsened the accuracy of the upper limbs. The assessment of human static postures and dynamic movements based on experimental data proves the feasibility of applying the Azure Kinect to the biomechanical monitoring of human motion in several fields.

Progression events defined by home-based assessment of motor function in multiple sclerosis: protocol of a prospective study

Background

This study relates to emerging concepts of appropriate trial designs to evaluate effects of intervention on the accumulation of irreversible disability in multiple sclerosis (MS). Major starting points of our study are the known limitations of current definitions of disability progression by rater-based clinical assessment and the high relevance of gait and balance dysfunctions in MS. The study aims to explore a novel definition of disease progression using repeated instrumental assessment of relevant motor functions performed by patients in their home setting.

Methods

The study is a prospective single-center observational cohort study with the primary outcome acquired by participants themselves, a home-based assessment of motor functions based on an RGB-Depth (RGB-D) camera, a camera that provides both depth (D) and color (RGB) data. Participants are instructed to perform and record a set of simple motor tasks twice a day over a one-week period every 6 months. Assessments are complemented by a set of questionnaires. Annual research grade assessments are acquired at dedicated study visits and include clinical ratings as well as structural imaging (MRI and optical coherence tomography). In addition, clinical data from routine visits is provided semiannually by treating neurologists. The observation period is 24 months for the primary endpoint with an additional clinical assessment at 27 month to confirm progression defined by the Expanded Disability Status Scale (EDSS). Secondary analyses aim to explore the time course of changes in motor parameters and performance of the novel definition against different alternative definitions of progression in MS. The study was registered at Deutsches Register für Klinische Studien (DRKS00027042).

Discussion

The study design presented here investigates disease progression defined by marker-less home-based assessment of motor functions against 3-month confirmed disease progression (3 m-CDP) defined by the EDSS. The technical approach was chosen due to previous experience in lab-based settings. The observation time per participant of 24, respectively, 27 months is commonly conceived as the lower limit needed to study disability progression. Defining a valid digital motor outcome for disease progression in MS may help to reduce observation times in clinical trials and add confidence to the detection of progression events in MS.

Measurement Accuracy of the HTC VIVE Tracker 3.0 Compared to Vicon System for Generating Valid Positional Feedback in Virtual Reality

For realistic and reliable full-body visualization in virtual reality, the HTC VIVE Tracker could be an alternative to highly complex and cost- and effort-intensive motion capture systems such as Vicon. Due to its lighter weight and smaller dimensions, the latest generation of trackers is proving to be very promising for capturing human movements. The aim of this study was to investigate the accuracy of the HTC VIVE Tracker 3.0 compared to the gold-standard Vicon for different arrangements of the base stations and various velocities during an athletic movement. Therefore, the position data from three trackers attached to the hip, knee and ankle of one sporty participant were recorded while riding a bicycle ergometer at different pedaling frequencies and different base station arrangements. As parameters for the measurement accuracy, the trajectories of the linear motion of the knee and the circular motion of the ankle were compared between VIVE and Vicon by calculating the spatial distance from the raw data at each point in time. Both the pedaling frequency and the arrangement of the base stations significantly affected the measurement accuracy, with the lowest pedaling frequency of 80 rpm and the rectangular arrangement recommended by the manufacturer showing the smallest spatial differences of 10.4 mm ± 4.5 mm at the knee and 11.3 mm ± 5.1 mm at the ankle. As the pedaling frequency increased gradually (120 rpm and 160 rpm), the measurement accuracy of the trackers per step decreased less at the knee (approximately 5 mm) than at the ankle (approximately 10 mm). In conclusion, the measurement accuracy for various athletic skills was high enough to enable the visualization of body limbs or the entire body using inverse kinematics in VR on the one hand and, on the other hand, to provide initial insights into the quality of certain techniques at lower speeds in sports science research. However, the VIVE trackers are not suitable for exact biomechanical analyses.

Sharing Augmented Reality between a Patient and a Clinician for Assessment and Rehabilitation in Daily Living Activities

In rehabilitation settings that exploit Mixed Reality, a clinician risks losing empathy with the patient by being immersed in different worlds, either real and/or virtual. While the patient perceives the rehabilitation stimuli in a mixed real–virtual world, the physician is only immersed in the real part. While in rehabilitation, this may cause the impossibility for the clinician to intervene, in skill assessment, this may cause difficulty in evaluation. To overcome the above limitation, we propose an innovative Augmented Reality (AR) framework for rehabilitation and skill assessment in clinical settings. Data acquired by a distributed sensor network are used to feed a “shared AR” environment so that both therapists and end-users can effectively operate/perceive it, taking into account the specific interface requirements for each user category: (1) for patients, simplicity, immersiveness, engagement and focus on the task; (2) for clinicians/therapists, contextualization and natural interaction with the whole set of data that is linked with the users’ performances in real-time. This framework has a strong potential in Occupational Therapy (OT) but also in physical, psychological, and neurological rehabilitation. Hybrid real and virtual environments may be quickly developed and personalized to match end users’ abilities and emotional and physiological states and evaluate nearly all relevant performances, thus augmenting the clinical eye of the therapist and the clinician-patient empathy. In this paper, we describe a practical exploitation of the proposed framework in OT: setting-up the table for eating. Both a therapist and a user wear Microsoft HoloLens 2. First, the therapist sets up the table with virtual furniture. Next, the user places the corresponding real objects (also in shape) to match them as closely as possible to the corresponding virtual ones. The therapist’s view is augmented during the test with motion, balance, and physiological estimated cues. Once the training is completed, he automatically perceives deviations in the position and attitude of each object and the elapsed time. We used a camera-based localization algorithm achieving a level of accuracy of 5 mm with a confidence level of 95% for position and 1° for rotation. The framework was designed and tested in collaboration with clinical experts of Villa Rosa rehabilitation hospital in Pergine (Italy), involving both a set of patients and healthy users to demonstrate the effectiveness of the designed architecture and the significance of the analyzed parameters between healthy users and patients.

Evaluating the intra- and inter-day reliability of output measures for the VALD HumanTrak: dynamic movements and range of motion of the shoulder and hip with body armour

The HumanTrak captures human movement through markerless motion tracking and can be a crucial tool in military physical screening. Reliability was examined in eighteen healthy participants who completed shoulder and hip ROM, and dynamic tasks in three body armour conditions. Generally, for all conditions, good to excellent reliability was observed in shoulder abduction and flexion, hip abduction and adduction, and dynamic squats knee and hip flexion (ICC ≥ 0.75 excluding outliers). Shoulder adduction and hip flexion demonstrated moderate to excellent reliability (ICC ≥ 0.50). Shoulder and hip extension and the drop jump were unreliable (ICC: 0.10-0.94, 0.15-0.89, and 0.30-0.82, respectively) due to the large distribution of ICC scores. Tasks with ROM values ≥ 100° involving movement towards or perpendicular to the HumanTrak camera tended to have greater reliability than movements moving away from the camera and out of the perpendicular plane regardless if body armour was worn.Practitioner summary: The HumanTrak analyses ROM in a time-efficient manner in a military setting. This study established that shoulder abduction and adduction (no body armour) and shoulder, hip, and knee flexion were the most reliable measurement for all conditions. Further work is required for movements across different planes.Abbreviations: ROM: range of motion; NBA: no body armour; BA: unloaded body armour; BA9: body armour with 9 kg; RGB: red, green, blue; ICC: intra-class correlation; SEM: standard error of measurement; MDC: minimal detectable change: MSE: mean square error; r: pearson correlations; N: sample size.

Accuracy and repeatability of the Microsoft Azure Kinect for clinical measurement of motor function

Quantitative assessment of motor function is increasingly applied in fall risk stratification, diagnosis, and disease monitoring of neuro-geriatric disorders of balance and gait. Its broad application, however, demands for low-cost and easy to use solutions that facilitate high-quality assessment outside laboratory settings. In this study, we validated in 30 healthy adults (12 female, age: 32.5 [22 - 62] years) the performance and accuracy of the latest generation of the Microsoft RGB-D camera, i.e., Azure Kinect (AK), in tracking body motion and providing estimates of clinical measures that characterise static posture, postural transitions, and locomotor function. The accuracy and repeatability of AK recordings was validated with a clinical reference standard multi-camera motion capture system (Qualisys) and compared to its predecessor Kinect version 2 (K2). Motion signal quality was evaluated by Pearson's correlation and signal-to-noise ratios while the accuracy of estimated clinical parameters was described by absolute and relative agreement based on intraclass correlation coefficients. The accuracy of AK-based body motion signals was moderate to excellent (RMSE 89 to 20 mm) and depended on the dimension of motion (highest for anterior-posterior dimension), the body region (highest for wrists and elbows, lowest for ankles and feet), and the specific motor task (highest for stand up and sit down, lowest for quiet standing). Most derived clinical parameters showed good to excellent accuracy (r .84 to .99) and repeatability (ICC(1,1) .55 to .94). The overall performance and limitations of body tracking by AK were comparable to its predecessor K2 in a cohort of young healthy adults. The observed accuracy and repeatability of AK-based evaluation of motor function indicate the potential for a broad application of high-quality and long-term monitoring of balance and gait in different non-specialised environments such as medical practices, nursing homes or community centres.

Methods for Spatiotemporal Analysis of Human Gait Based on Data from Depth Sensors

Gait analysis may serve various purposes related to health care, such as the estimation of elderly people's risk of falling. This paper is devoted to gait analysis based on data from depth sensors which are suitable for use both at healthcare facilities and in monitoring systems dedicated to household environments. This paper is focused on the comparison of three methods for spatiotemporal gait analysis based on data from depth sensors, involving the analysis of the movement trajectories of the knees, feet, and centre of mass. The accuracy of the results obtained using those methods was assessed for different depth sensors' viewing angles and different types of subject clothing. Data were collected using a Kinect v2 device. Five people took part in the experiments. Data from a Zebris FDM platform were used as a reference. The obtained results indicate that the viewing angle and the subject's clothing affect the uncertainty of the estimates of spatiotemporal gait parameters, and that the method based on the trajectories of the feet yields the most information, while the method based on the trajectory of the centre of mass is the most robust.

Scoring People With Spinal Muscular Atrophy on the Motor Function Measure Using the Microsoft Kinect

PURPOSE

Assess the ability of the Kinect to capture movement and posture of people with spinal muscular atrophy (SMA) during completion of 14 items of the Motor Function Measure, a validated functional rating scale for people with neuromuscular diseases.

METHODS

Multicenter feasibility study in which Motor Function Measure items were scored as usual by the participant's therapist during the completion (Score-T) while another therapist scored items based only on the visualization of digital data collected using the Kinect (Score-D). Agreement and disagreement were investigated.

RESULTS

Twenty people with SMA type 2 or 3 were participants; 142 items were recorded and analyzed. There was 31.7% agreement between Score-T and Score-D for participants with SMA type 2, and 76.2% for those with SMA type 3.

CONCLUSIONS

The results prevent us from considering the use of Kinect capture to deduce an automated scoring, but this device may be of interest to highlight potential compensations.

RGB-Depth Camera-Based Assessment of Motor Capacity: Normative Data for Six Standardized Motor Tasks

BACKGROUND

Instrumental motion analysis constitutes a promising development in the assessment of motor function in clinical populations affected by movement disorders. To foster implementation and facilitate interpretation of respective outcomes, we aimed to establish normative data of healthy subjects for a markerless RGB-Depth camera-based motion analysis system and to illustrate their use.

METHODS

We recorded 133 healthy adults (56% female) aged 20 to 60 years with an RGB-Depth camera-based motion analysis system. Forty-three spatiotemporal parameters were extracted from six short, standardized motor tasks-including three gait tasks, stepping in place, standing-up and sitting down, and a postural control task. Associations with confounding factors, height, weight, age, and sex were modelled using a predictive linear regression approach. A z-score normalization approach was provided to improve usability of the data.

RESULTS

We reported descriptive statistics for each spatiotemporal parameter (mean, standard deviation, coefficient of variation, quartiles). Robust confounding associations emerged for step length and step width in comfortable speed gait only. Accessible normative data usage was lastly exemplified with recordings from one randomly selected individual with multiple sclerosis.

CONCLUSION

We provided normative data for an RGB depth camera-based motion analysis system covering broad aspects of motor capacity.

Berlin Registry of Neuroimmunological entities (BERLimmun): protocol of a prospective observational study

BACKGROUND

Large-scale disease overarching longitudinal data are rare in the field of neuroimmunology. However, such data could aid early disease stratification, understanding disease etiology and ultimately improve treatment decisions. The Berlin Registry of Neuroimmunological Entities (BERLimmun) is a longitudinal prospective observational study, which aims to identify diagnostic, disease activity and prognostic markers and to elucidate the underlying pathobiology of neuroimmunological diseases.

METHODS

BERLimmun is a single-center prospective observational study of planned 650 patients with neuroimmunological disease entity (e.g. but not confined to: multiple sclerosis, isolated syndromes, neuromyelitis optica spectrum disorders) and 85 healthy participants with 15 years of follow-up. The protocol comprises annual in-person visits with multimodal standardized assessments of medical history, rater-based disability staging, patient-report of lifestyle, diet, general health and disease specific symptoms, tests of motor, cognitive and visual functions, structural imaging of the neuroaxis and retina and extensive sampling of biological specimen.

DISCUSSION

The BERLimmun database allows to investigate multiple key aspects of neuroimmunological diseases, such as immunological differences between diagnoses or compared to healthy participants, interrelations between findings of functional impairment and structural change, trajectories of change for different biomarkers over time and, importantly, to study determinants of the long-term disease course. BERLimmun opens an opportunity to a better understanding and distinction of neuroimmunological diseases.

Evaluation of a Low-Cost Virtual Reality Surround-Screen Projection System

Two of the most popular mediums for virtual reality are head-mounted displays and surround-screen projection systems, such as CAVE Automatic Virtual Environments. In recent years, HMDs suffered a significant reduction in cost and have become widespread consumer products. In contrast, CAVEs are still expensive and remain accessible to a limited number of researchers. This study aims to evaluate both objective and subjective characteristics of a CAVE-like monoscopic low-cost virtual reality surround-screen projection system compared to advanced setups and HMDs. For objective results, we measured the head position estimation accuracy and precision of a low-cost active infrared (IR) based tracking system, used in the proposed low-cost CAVE, relatively to an infrared marker-based tracking system, used in a laboratory-grade CAVE system. For subjective characteristics, we investigated the sense of presence and cybersickness elicited in users during a visual search task outside personal space, beyond arms reach, where the importance of stereo vision is diminished. Thirty participants rated their sense of presence and cybersickness after performing the VR search task with our CAVE-like system and a modern HMD. The tracking showed an accuracy error of 1.66 cm and .4 mm of precision jitter. The system was reported to elicit presence but at a lower level than the HMD, while causing significant lower cybersickness. Our results were compared to a previous study performed with a laboratory-grade CAVE and support that a VR system implemented with low-cost devices could be a viable alternative to laboratory-grade CAVEs for visual search tasks outside the user's personal space.

Digital Devices for Assessing Motor Functions in Mobility-Impaired and Healthy Populations: Systematic Literature Review

Background

With the advent of smart sensing technology, mobile and wearable devices can provide continuous and objective monitoring and assessment of motor function outcomes.

Objective

We aimed to describe the existing scientific literature on wearable and mobile technologies that are being used or tested for assessing motor functions in mobility-impaired and healthy adults and to evaluate the degree to which these devices provide clinically valid measures of motor function in these populations.

Methods

A systematic literature review was conducted by searching Embase, MEDLINE, CENTRAL (January 1, 2015, to June 24, 2020), the United States and European Union clinical trial registries, and the United States Food and Drug Administration website using predefined study selection criteria. Study selection, data extraction, and quality assessment were performed by 2 independent reviewers.

Results

A total of 91 publications representing 87 unique studies were included. The most represented clinical conditions were Parkinson disease (n=51 studies), followed by stroke (n=5), Huntington disease (n=5), and multiple sclerosis (n=2). A total of 42 motion-detecting devices were identified, and the majority (n=27, 64%) were created for the purpose of health care–related data collection, although approximately 25% were personal electronic devices (eg, smartphones and watches) and 11% were entertainment consoles (eg, Microsoft Kinect or Xbox and Nintendo Wii). The primary motion outcomes were related to gait (n=30), gross motor movements (n=25), and fine motor movements (n=23). As a group, sensor-derived motion data showed a mean sensitivity of 0.83 (SD 7.27), a mean specificity of 0.84 (SD 15.40), a mean accuracy of 0.90 (SD 5.87) in discriminating between diseased individuals and healthy controls, and a mean Pearson r validity coefficient of 0.52 (SD 0.22) relative to clinical measures. We did not find significant differences in the degree of validity between in-laboratory and at-home sensor-based assessments nor between device class (ie, health care–related device, personal electronic devices, and entertainment consoles).

Conclusions

Sensor-derived motion data can be leveraged to classify and quantify disease status for a variety of neurological conditions. However, most of the recent research on digital clinical measures is derived from proof-of-concept studies with considerable variation in methodological approaches, and much of the reviewed literature has focused on clinical validation, with less than one-quarter of the studies performing analytical validation. Overall, future research is crucially needed to further consolidate that sensor-derived motion data may lead to the development of robust and transformative digital measurements intended to predict, diagnose, and quantify neurological disease state and its longitudinal change.

Biomechanics beyond the lab: Remote technology for osteoarthritis patient data-A scoping review

The objective of this project is to produce a review of available and validated technologies suitable for gathering biomechanical and functional research data in patients with osteoarthritis (OA), outside of a traditionally fixed laboratory setting. A scoping review was conducted using defined search terms across three databases (Scopus, Ovid MEDLINE, and PEDro), and additional sources of information from grey literature were added. One author carried out an initial title and abstract review, and two authors independently completed full-text screenings. Out of the total 5,164 articles screened, 75 were included based on inclusion criteria covering a range of technologies in articles published from 2015. These were subsequently categorised by technology type, parameters measured, level of remoteness, and a separate table of commercially available systems. The results concluded that from the growing number of available and emerging technologies, there is a well-established range in use and further in development. Of particular note are the wide-ranging available inertial measurement unit systems and the breadth of technology available to record basic gait spatiotemporal measures with highly beneficial and informative functional outputs. With the majority of technologies categorised as suitable for part-remote use, the number of technologies that are usable and fully remote is rare and they usually employ smartphone software to enable this. With many systems being developed for camera-based technology, such technology is likely to increase in usability and availability as computational models are being developed with increased sensitivities to recognise patterns of movement, enabling data collection in the wider environment and reducing costs and creating a better understanding of OA patient biomechanical and functional movement data.

Enhanced assessment of human dynamic stability by eliminating the effect of body height: modeling and experiment study

Margin of stability (MOS) is one of the essential indices for evaluating dynamic stability. However, there are indications that MOS was affected by body height and its application in identifying factors on dynamic stability other than body height is restricted. An inverted pendulum model was used to simulate human walking and investigate the relevance between MOS and body height. Eventually, a height-independent index in dynamic stability assessment (named as Angled Margin of Stability, AMOS) was proposed. For testing, fifteen healthy young volunteers performed walking trials with normal arm swing, holding arms, and anti-normal arm swing. Kinematic parameters were recorded using a gait analysis system with a Microsoft Kinect V2.0 and instrumented walkway. Both simulation and test results show that MOS had a significant correlation with height during walking with normal arm swing, while AMOS had no such significant correlation. Walking with normal arm swing produced significantly larger AMOS than holding arms and anti-normal arm swing. However, no significant difference showed up in MOS between normal arm swing and holding arms. The results suggest that AMOS is not affected by body height and has the potential to identify the variations in dynamic stability caused by physiological factors other than body height.

Motor signature of autism spectrum disorder in adults without intellectual impairment

Motor signs such as dyspraxia and abnormal gait are characteristic features of autism spectrum disorder (ASD). However, motor behavior in adults with ASD has scarcely been quantitatively characterized. In this pilot study, we aim to quantitatively examine motor signature of adults with ASD without intellectual impairment using marker-less visual-perceptive motion capture. 82 individuals (37 ASD and 45 healthy controls, HC) with an IQ > 85 and aged 18 to 65 years performed nine movement tasks and were filmed by a 3D-infrared camera. Anatomical models were quantified via custom-made software and resulting kinematic parameters were compared between individuals with ASD and HCs. Furthermore, the association between specific motor behaviour and severity of autistic symptoms (Autism Diagnostic Observation Schedule 2, Autism Spectrum Quotient) was explored. Adults with ASD showed a greater mediolateral deviation while walking, greater sway during normal, tandem and single leg stance, a reduced walking speed and cadence, a greater arrhythmicity during jumping jack tasks and an impaired manual dexterity during finger tapping tasks (p < 0.05 and |D|> 0.48) compared to HC. Furthermore, in the ASD group, some of these parameters correlated moderately to severity of ASD symptoms. Adults with ASD seem to display a specific motor signature in this disorder affecting movement timing and aspects of balance. The data appear to reinforce knowledge about motor signs reported in children and adolescents with ASD. Also, quantitative motor assessment via visual-perceptive computing may be a feasible instrument to detect subtle motor signs in ASD and perhaps suitable in the diagnosis of ASD in the future.

Reliability and Validity of the Kinect-Based Mixed Reality Device: Pilot Study

OBJECTIVES Firefighter (FF) is an occupation which needs high fitness abilities. However, most of Korean FFs in the capital city have relatively low fitness levels and they have difficulty participating in exercises owing to their emergency environments. Kinect-based mixed reality device (KMR) is a device that can deliver exercises with live visual feedbacks by detecting motions at any time while needing few human resources. Therefore, KMR could be an adequate tool for FFs to provide exercise. However, there are no studies that identified the reliability and validity. So, the purpose of this study is to evaluate the reliability and validity of KMR and the intensity of the fitness program for relatively low-fit FFs.METHODS Using a test-retest design, five male participants underwent three trials with 1wk washouts. The participants underwent 1 screening and 2 workout sessions. The fitness program using KMR last approximately 25 min. Intensity was measured using the heart rate (HR), rated perceived exertion (RPE), and finger-tip lactate. HR and RPE were measured before, during, and after the exercise using the Polar watch and Borg scale. Finger-tip lactate were measured before and after the exercise using Lactate Pro2. Cronbach alpha and Pearson correlation were determined for reliability and validity based on the HR and RPE.RESULTS Excellent reliability (Cronbach alpha: 0.967, 0.969) and strong correlation (r = .525 – .814, .718 – .958; very large) were observed with regard to the HR and RPE. Additionally, HR, RPE, and post-workout lactate showed a moderate-to-high intensity response in exercise program. Conclusions: The results suggest that KMR is a reliable and validate device to provide fitness programs and the fitness program designed for relatively low-fit FFs showed a “moderate-to-high” intensity response, which is an adequate physiological response for relatively low-fit Korean FFs.

Proposal for Post Hoc Quality Control in Instrumented Motion Analysis Using Markerless Motion Capture: Development and Usability Study

Background

Instrumented assessment of motor symptoms has emerged as a promising extension to the clinical assessment of several movement disorders. The use of mobile and inexpensive technologies such as some markerless motion capture technologies is especially promising for large-scale application but has not transitioned into clinical routine to date. A crucial step on this path is to implement standardized, clinically applicable tools that identify and control for quality concerns.

Objective

The main goal of this study comprises the development of a systematic quality control (QC) procedure for data collected with markerless motion capture technology and its experimental implementation to identify specific quality concerns and thereby rate the usability of recordings.

Methods

We developed a post hoc QC pipeline that was evaluated using a large set of short motor task recordings of healthy controls (2010 recordings from 162 subjects) and people with multiple sclerosis (2682 recordings from 187 subjects). For each of these recordings, 2 raters independently applied the pipeline. They provided overall usability decisions and identified technical and performance-related quality concerns, which yielded respective proportions of their occurrence as a main result.

Results

The approach developed here has proven user-friendly and applicable on a large scale. Raters’ decisions on recording usability were concordant in 71.5%-92.3% of cases, depending on the motor task. Furthermore, 39.6%-85.1% of recordings were concordantly rated as being of satisfactory quality whereas in 5.0%-26.3%, both raters agreed to discard the recording.

Conclusions

We present a QC pipeline that seems feasible and useful for instant quality screening in the clinical setting. Results confirm the need of QC despite using standard test setups, testing protocols, and operator training for the employed system and by extension, for other task-based motor assessment technologies. Results of the QC process can be used to clean existing data sets, optimize quality assurance measures, as well as foster the development of automated QC approaches and therefore improve the overall reliability of kinematic data sets.

Machine Learning-Based Analysis of Digital Movement Assessment and ExerGame Scores for Parkinson's Disease Severity Estimation

Neurodegenerative Parkinson's Disease (PD) is one of the common incurable diseases among the elderly. Clinical assessments are characterized as standardized means for PD diagnosis. However, relying on medical evaluation of a patient's status can be subjective to physicians' experience, making the assessment process susceptible to human errors. The use of ICT-based tools for capturing the status of patients with PD can provide more objective and quantitative metrics. In this vein, the Personalized Serious Game Suite (PGS) and intelligent Motor Assessment Tests (iMAT), produced within the i-PROGNOSIS European project (www.i-prognosis.eu), are explored in the current study. More specifically, data from 27 patients with PD at Stage 1 (9) and Stage 3 (18) produced from their interaction with PGS/iMAT are analyzed. Five feature vector (FV) scenarios are set, including features from PGS or iMAT scores or their combination, after also taking into consideration the age of patients with PD. These FVs are fed into three machine learning classifiers, i.e., K-Nearest Neighbor (KNN), Support Vector Machines (SVM), and Random Forest (RF), to infer the stage of each patient with PD. A Leave-One-Out Cross-Validation (LOOCV) method is adopted for testing the classification performance. The experimental results show that a high (>90%) classification accuracy is achieved from both data sources (PGS/iMAT), justifying the effectiveness of PGS/iMAT to efficiently reflect the motor skill status of patients with PD and further potentiating PGS/iMAT enhancement with a machine learning a part to infer for the stage of patients with PD. Clearly, this integrated approach provides new opportunities for remote monitoring of the stage of patients with PD, contributing to a more efficient organization and set up of personalized interventions.

Applications and limitations of current markerless motion capture methods for clinical gait biomechanics

BACKGROUND

Markerless motion capture has the potential to perform movement analysis with reduced data collection and processing time compared to marker-based methods. This technology is now starting to be applied for clinical and rehabilitation applications and therefore it is crucial that users of these systems understand both their potential and limitations. This literature review aims to provide a comprehensive overview of the current state of markerless motion capture for both single camera and multi-camera systems. Additionally, this review explores how practical applications of markerless technology are being used in clinical and rehabilitation settings, and examines the future challenges and directions markerless research must explore to facilitate full integration of this technology within clinical biomechanics.

METHODOLOGY

A scoping review is needed to examine this emerging broad body of literature and determine where gaps in knowledge exist, this is key to developing motion capture methods that are cost effective and practically relevant to clinicians, coaches and researchers around the world. Literature searches were performed to examine studies that report accuracy of markerless motion capture methods, explore current practical applications of markerless motion capture methods in clinical biomechanics and identify gaps in our knowledge that are relevant to future developments in this area.

RESULTS

Markerless methods increase motion capture data versatility, enabling datasets to be re-analyzed using updated pose estimation algorithms and may even provide clinicians with the capability to collect data while patients are wearing normal clothing. While markerless temporospatial measures generally appear to be equivalent to marker-based motion capture, joint center locations and joint angles are not yet sufficiently accurate for clinical applications. Pose estimation algorithms are approaching similar error rates of marker-based motion capture, however, without comparison to a gold standard, such as bi-planar videoradiography, the true accuracy of markerless systems remains unknown.

CONCLUSIONS

Current open-source pose estimation algorithms were never designed for biomechanical applications, therefore, datasets on which they have been trained are inconsistently and inaccurately labelled. Improvements to labelling of open-source training data, as well as assessment of markerless accuracy against gold standard methods will be vital next steps in the development of this technology.

Review-Emerging Portable Technologies for Gait Analysis in Neurological Disorders

The understanding of locomotion in neurological disorders requires technologies for quantitative gait analysis. Numerous modalities are available today to objectively capture spatiotemporal gait and postural control features. Nevertheless, many obstacles prevent the application of these technologies to their full potential in neurological research and especially clinical practice. These include the required expert knowledge, time for data collection, and missing standards for data analysis and reporting. Here, we provide a technological review of wearable and vision-based portable motion analysis tools that emerged in the last decade with recent applications in neurological disorders such as Parkinson's disease and Multiple Sclerosis. The goal is to enable the reader to understand the available technologies with their individual strengths and limitations in order to make an informed decision for own investigations and clinical applications. We foresee that ongoing developments toward user-friendly automated devices will allow for closed-loop applications, long-term monitoring, and telemedical consulting in real-life environments.

A SWOT Analysis of Portable and Low-Cost Markerless Motion Capture Systems to Assess Lower-Limb Musculoskeletal Kinematics in Sport

Markerless motion capture systems are promising for the assessment of movement in more real world research and clinical settings. While the technology has come a long way in the last 20 years, it is important for researchers and clinicians to understand the capacities and considerations for implementing these types of systems. The current review provides a SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis related to the successful adoption of markerless motion capture technology for the assessment of lower-limb musculoskeletal kinematics in sport medicine and performance settings. 31 articles met the a priori inclusion criteria of this analysis. Findings from the analysis indicate that the improving accuracy of these systems via the refinement of machine learning algorithms, combined with their cost efficacy and the enhanced ecological validity outweighs the current weaknesses and threats. Further, the analysis makes clear that there is a need for multidisciplinary collaboration between sport scientists and computer vision scientists to develop accurate clinical and research applications that are specific to sport. While work remains to be done for broad application, markerless motion capture technology is currently on a positive trajectory and the data from this analysis provide an efficient roadmap toward widespread adoption.

A real-time algorithm for the detection of compensatory movements during reaching

Introduction: Interactive game systems can motivate stroke survivors to engage with their rehabilitation exercises. However, it is crucial that systems are in place to detect if exercises are performed correctly as stroke survivors often perform compensatory movements which can be detrimental to recovery. Very few game systems integrate motion tracking algorithms to monitor performance and detect such movements. This paper describes the development of algorithms which monitor for compensatory movements during upper limb reaching movements in real-time and provides quantitative metrics for health professionals to monitor performance and progress over time.

Methods: A real-time algorithm was developed to analyse reaching motions in real-time through a low-cost depth camera. The algorithm segments cyclical reaching motions into component parts, including compensatory movement, and provides a graphical representation of task performance. Healthy participants (n = 10) performed reaching motions facing the camera. The real-time accuracy of the algorithm was assessed by comparing offline analysis to real-time collection of data.

Results: The algorithm’s ability to segment cyclical reaching motions and detect the component parts in real-time was assessed. Results show that movement types can be detected in real time with accuracy, showing a maximum error of 1.71%.

Conclusions: Using the methods outlined, the real-time detection and quantification of compensatory movements is feasible for integration within home-based, repetitive task practice game systems for people with stroke.

A Study Protocol for Occupational Rehabilitation in Multiple Sclerosis

Digital medical solutions can be very helpful in restorative neurology, as they allow the patients to practice their rehabilitation activities remotely. This work discloses ReMoVES, an IoMT system providing telemedicine services, in the context of Multiple Sclerosis rehabilitation, within the frame of the project STORMS. A rehabilitative protocol of exercises can be provided as ReMoVES services and integrated into the Individual Rehabilitation Project as designed by a remote multidimensional medical team. In the present manuscript, the first phase of the study is described, including the definition of the needs to be addressed, the employed technology, the design and the development of the exergames, and the possible practical/professional and academic consequences. The STORMS project has been implemented with the aim to act as a starting point for the development of digital telerehabilitation solutions that support Multiple Sclerosis patients, improving their living conditions. This paper introduces a study protocol and it addresses pre-clinical research needs, where system issues can be studied and better understood how they might be addressed. It also includes tools to favor remote patient monitoring and to support the clinical staff.

The ergonomic impact of patient body mass index on surgeon posture during simulated laparoscopy

Laparoscopy is a cornerstone of modern surgical care, with clear advantages for the patients. However, it has also been associated with inducing upper body musculoskeletal disorders amongst surgeons due to their propensity to assume non-neutral postures. Further, there is a perception that patients with high body mass indexes (BMI) exacerbate these factors. Therefore, surgeon upper body postures were objectively quantified using inertial measurement units and the LUBA ergonomic framework was used to assess posture during laparoscopic training on patient models that simulated BMIs of 20, 30, 40 and 50 kg/m². In all surgeons the posture of the upper body significantly worsened during simulated laparoscopic surgery on the BMI 50 kg/m² model as compared to the baseline BMI model of 20 kg/m². These findings suggest that performing laparoscopic surgery on patients with high BMIs increases the prevalence of non-neutral posture and may further increase the risk of musculoskeletal disorders in surgeons.

Improving Accuracy and Runtime of Skeletal Tracking of Lower Limbs for Athletic Jump Mechanics Assessment

Previous studies have shown that athletic jump mechanics assessments are valuable tools for identifying indicators of an individual's anterior cruciate ligament injury risk. These assessments, such as the drop jump test, often relied on camera systems or sensors that are not always accessible nor practical for screening individuals in a sports setting. As human pose estimation deep learning models improve, we envision transitioning biometrical assessments to mobile devices. As such, here we have addressed two of the most preclusive hindrances of the current state-of-the-art models: accuracy of the lower limb joint prediction and the slow run-time of in-the-wild inference. We tackle the issue of accuracy by adding a post-processing step that is compatible with all inference methods that outputs 3D key points. Additionally, to overcome the lengthy inference rate, we propose a depth estimation method that runs in real-time and can function with any 2D human pose estimation model that outputs COCO key points. Our solution, paired with a state-of-the-art model for 3D human pose estimation, significantly increased lower-limb positional accuracy. Furthermore, when paired with our real-time joint depth estimation algorithm, it is a plausible solution for developing the first mobile device prototype for athlete jump mechanics assessments.

Kinect-based rapid movement training to improve balance recovery for stroke fall prevention: a randomized controlled trial

Background

Falls are more prevalent in stroke survivors than age-matched healthy older adults because of their functional impairment. Rapid balance recovery reaction with adequate range-of-motion and fast response and movement time are crucial to minimize fall risk and prevent serious injurious falls when postural disturbances occur. A Kinect-based Rapid Movement Training (RMT) program was developed to provide real-time feedback to promote faster and larger arm reaching and leg stepping distances toward targets in 22 different directions.

Objective

To evaluate the effectiveness of the interactive RMT and Conventional Balance Training (CBT) on chronic stroke survivors’ overall balance and balance recovery reaction.

Methods

In this assessor-blinded randomized controlled trial, chronic stroke survivors were randomized to receive twenty training sessions (60-min each) of either RMT or CBT. Pre- and post-training assessments included clinical tests, as well as kinematic measurements and electromyography during simulated forward fall through a “lean-and-release” perturbation system.

Results

Thirty participants were recruited (RMT = 16, CBT = 14). RMT led to significant improvement in balance control (Berg Balance Scale: pre = 49.13, post = 52.75; P = .001), gait control (Timed-Up-and-Go Test: pre = 14.66 s, post = 12.62 s; P = .011), and motor functions (Fugl-Meyer Assessment of Motor Recovery: pre = 60.63, post = 65.19; P = .015), which matched the effectiveness of CBT. Both groups preferred to use their non-paretic leg to take the initial step to restore stability, and their stepping leg’s rectus femoris reacted significantly faster post-training (P = .036).

Conclusion

The RMT was as effective as conventional balance training to provide beneficial effects on chronic stroke survivors’ overall balance, motor function and improving balance recovery with faster muscle response.

Trial registration: The study was registered at Clinicaltrials.gov (https://clinicaltrials.gov/ct2/show/NCT03183635, NCT03183635) on 12 June 2017.

Concurrent validity of a custom computer vision algorithm for measuring lumbar spine motion from RGB-D camera depth data

Using RGB-D cameras as an alternative motion capture device can be advantageous for biomechanical spine motion assessments of movement quality and dysfunction due to their lower cost and complexity. In this study, we evaluated RGB-D camera performance relative to gold-standard optoelectronic motion capture equipment. Twelve healthy young adults (6M, 6F) were recruited to perform repetitive spine flexion-extension, while wearing infrared reflective marker clusters placed over their T₁₀-T₁₂ spinous processes and sacrum, and motion capture data were recorded simultaneously by both systems. Custom computer vision algorithms were developed to extract spine angles from depth data. Root mean square error (RMSE) was calculated for continuous Euler angles, and intraclass correlation coefficients (ICC_2,1) were calculated between minimum and maximum angles and range of motion in all movement planes. RMSE was low (RMSE ≤ 2.05°) and reliability was good to excellent (0.849 ≤ ICC_2,1 ≤ 0.979) across all movement planes. In conclusion, the proposed algorithm for tracking 3D lumbar spine motion during a sagittal movement task from one RGB-D camera is reliable in comparison to gold-standard motion tracking equipment. Future research will investigate accuracy and validity in a wider variety of movements, and will also investigate the development of novel methods to measure spine motion without using infrared reflective markers.

Influence of motor instruction words on body movements in step-over motions

[Purpose] To quantitatively analyze the characteristics of movements evoked by certain motor instruction words on the basis of measurements of ankle elevation and related body movements in step-over motion tasks. [Participants and Methods] Sixty-one healthy adult participants were presented with motor instructions and asked to step over an obstacle in accordance with the instructions. The motor instructions were as follows: “Raise your XX (body part) up YY (expression)” in four combinations using “thigh” and “knee” for body part and “high” and “firmly” for expression. Using Kinect to analyze movements, ankle elevation, trunk-anteversion angle, hip-flexion angle, and knee-flexion angle were measured and statistically processed. [Results] With respect to body part, there was no significant difference in the mean and standard deviation (individual variation) values for ankle elevation. With respect to expression, hip joint and knee joint were bent significantly more for “high” than for “firmly”, and although the mean value for ankle elevation was high, ankle elevation standard deviation (individual variation) values were significantly lower for “firmly” than for “high”. [Conclusion] Explicit motor instruction words such as “high” may be effective in improving performance, while ambiguous motor instruction words like “firmly” may be effective in stabilizing movements.

Proof-of-Concept of a Sensor-Based Evaluation Method for Better Sensitivity of Upper-Extremity Motor Function Assessment

In rehabilitation, the Fugl-Meyer assessment (FMA) is a typical clinical instrument to assess upper-extremity motor function of stroke patients, but it cannot measure fine changes of motor function (both in recovery and deterioration) due to its limited sensitivity. This paper introduces a sensor-based automated FMA system that addresses this limitation with a continuous rating algorithm. The system consists of a depth sensor (Kinect V2) and an algorithm to rate the continuous FM scale based on fuzzy inference. Using a binary logic based classification method developed from a linguistic scoring guideline of FMA, we designed fuzzy input/output variables, fuzzy rules, membership functions, and a defuzzification method for several representative FMA tests. A pilot trial with nine stroke patients was performed to test the feasibility of the proposed approach. The continuous FM scale from the proposed algorithm exhibited a high correlation with the clinician rated scores and the results showed the possibility of more sensitive upper-extremity motor function assessment.

Camera-based objective measures of Parkinson's disease gait features

OBJECTIVE

Parkinson's disease is a common, age-related, neurodegenerative disease, affecting gait and other motor functions. Technological developments in consumer imaging are starting to provide high-quality, affordable tools for home-based diagnosis and monitoring. This pilot study aims to investigate whether a consumer depth camera can capture changes in gait features of Parkinson's patients. The dataset consisted of 19 patients (tested in both a practically defined OFF phase and ON phase) and 8 controls, who performed the "Timed-Up-and-Go" test multiple times while being recorded with the Microsoft Kinect V2 sensor. Camera-derived features were step length, average walking speed and mediolateral sway. Motor signs were assessed clinically using the Movement Disorder Society Unified Parkinson's Disease Rating Scale.

RESULTS

We found significant group differences between patients and controls for step length and average walking speed, showing the ability to detect Parkinson's features. However, there were no differences between the ON and OFF medication state, so further developments are needed to allow for detection of small intra-individual changes in symptom severity.

Simple benchmarking method for determining the accuracy of depth cameras in body landmark location estimation: Static upright posture as a measurement example

To evaluate the postures in ergonomics applications, studies have proposed the use of low-cost, marker-less, and portable depth camera-based motion tracking systems (DCMTSs) as a potential alternative to conventional marker-based motion tracking systems (MMTSs). However, a simple but systematic method for examining the estimation errors of various DCMTSs is lacking. This paper proposes a benchmarking method for assessing the estimation accuracy of depth cameras for full-body landmark location estimation. A novel alignment board was fabricated to align the coordinate systems of the DCMTSs and MMTSs. The data from an MMTS were used as a reference to quantify the error of using a DCMTS to identify target locations in a 3-D space. To demonstrate the proposed method, the full-body landmark location tracking errors were evaluated for a static upright posture using two different DCMTSs. For each landmark, we compared each DCMTS (Kinect system and RealSense system) with an MMTS by calculating the Euclidean distances between symmetrical landmarks. The evaluation trials were performed twice. The agreement between the tracking errors of the two evaluation trials was assessed using intraclass correlation coefficient (ICC). The results indicate that the proposed method can effectively assess the tracking performance of DCMTSs. The average errors (standard deviation) for the Kinect system and RealSense system were 2.80 (1.03) cm and 5.14 (1.49) cm, respectively. The highest average error values were observed in the depth orientation for both DCMTSs. The proposed method achieved high reliability with ICCs of 0.97 and 0.92 for the Kinect system and RealSense system, respectively.

Detection of Postural Control in Young and Elderly Adults Using Deep and Machine Learning Methods with Joint-Node Plots

Postural control decreases with aging. Thus, an efficient and accurate method of detecting postural control is needed. We enrolled 35 elderly adults (aged 82.06 ± 8.74 years) and 20 healthy young adults (aged 21.60 ± 0.60 years) who performed standing tasks for 40 s, performed six times. The coordinates of 15 joint nodes were captured using a Kinect device (30 Hz). We plotted joint positions into a single 2D figure (named a joint–node plot, JNP) once per second for up to 40 s. A total of 15 methods combining deep and machine learning for postural control classification were investigated. The accuracy, sensitivity, specificity, positive predicted value (PPV), negative predicted value (NPV), and kappa values of the selected methods were assessed. The highest PPV, NPV, accuracy, sensitivity, specificity, and kappa values were higher than 0.9 in validation testing. The presented method using JNPs demonstrated strong performance in detecting the postural control ability of young and elderly adults.

Multi-segment phase coupling to oscillatory visual drive

BACKGROUND

It has been shown that humans adapt their postural sway to oscillatory, visually simulated self-motion. However, little is still known about the way individual body segments contribute to this adjustment of body sway and how this contribution varies with different environmental conditions.

RESEARCH QUESTION

How do the centre of pressure (COP) and individual body segments phase-lock to a sinusoidal visual drive depending on the frequency of stimulation?

METHODS

In this study, we introduce phase coupling as a method for assessing full body motion in response to visual stimuli presented in virtual reality (VR). 12 participants (mean age: 31 ± 9 years) stood inside a virtual tunnel which oscillated sinusoidally in the anterior-posterior direction at a frequency of 0.2 Hz, 0.8 Hz or 1.2 Hz. Primary outcome measures were the trajectories of their COP as well as of 25 body segments obtained by a motion tracking system.

RESULTS

Subjects significantly coupled the phase of their COP and body segments to the visual drive. Our analysis yielded significant phase coupling of the COP to the stimulus for all tested frequencies. The phase coupling of body segments revealed a shift in postural response as a function of frequency. At the low frequency of 0.2 Hz, we found strong and significant phase coupling homogeneously distributed across the body. At the higher frequencies of 0.8 Hz and 1.2 Hz, however, overall phase coupling became weaker and was centred around the lower torso and hip segments.

SIGNIFICANCE

Information on how the visual percept of self-motion affects balance control is crucial for understanding visuomotor processing in health and disease. Our setup and methods constitute a reliable tool for assessing perturbed balance control, which can be utilized in future clinical trials.

Final results of the NINFA project: impact of new technologies in the daily life of elderly people

BACKGROUND

The paper presents the work carried out within NINFA (iNtelligent Integrated Network For Aged people), a project for the wellbeing of the elderly people at home.

AIMS

The impact of new technologies on elderly people is evaluated with respect to the three main topics faced by NINFA.

METHODS

NINFA was structured into three main topics: (1) active user engagement from the very beginning of the planning stage: the use of specially designed questionnaires to evaluate the acceptability of new technology in general and robot caregiver specifically; (2) assessment of the well-being through non-invasive techniques: natural language processing for language change monitoring in elderly subjects; (3) automated assessment of motor and cognitive functions at home: systems to deliver tests and exergames through user interfaces compliant with elderly subjects.

RESULTS

The analysis shows that there is no a priori closure to support the technology, but it must not be invasive and must allow social interactions. The study of speech transcripts shows that a large variations in the number of words used to describe the same situation could be a sign on the onset of cognitive impairments. The specifically designed systems highlight, after the training period, significant improvements in the performances of the participants and a satisfaction with regards to the systems usability.

CONCLUSIONS

The outcomes of NINFA project highlight some important aspects of the relationship between elderly people and new technologies concerning: engagement and acceptability, assessment of the wellbeing and of the modifications of motor, cognitive and language functions.

Continuous measurement of attachment behavior: A multimodal view of the strange situation procedure

Infant attachment is a critical indicator of healthy infant social-emotional functioning, which is typically measured using the gold-standard Strange Situation Procedure (SSP). However, expert-based attachment classifications from the SSP are time-intensive (with respect both to expert training and rating), and do not provide an objective, continuous record of infant behavior. To continuously quantify predictors of key attachment behaviors and dimensions, multimodal movement and audio data were collected during the SSP. Forty-nine 1-year-olds and their mothers participated in the SSP and were tracked in three-dimensional space using five synchronized Kinect sensors; LENA recordings were used to quantify crying duration. Theoretically-informed multimodal measures of attachment-related behavior (e.g., dyadic contact duration, infant velocity of approach toward the mother, and infant crying) were used to predict expert rating scales and dimensional summaries of attachment outcomes. Stepwise regressions identified sets of multimodal objective measures that were significant predictors of eight of nine of the expert ratings of infant attachment behaviors in the SSP's two reunions. These multimodal measures predicted approximately half of the variance in the summary approach/avoidance and resistance/disorganization attachment dimensions. Incorporating all objective measures as predictors regardless of significance levels, predicted individual ratings within an average of one point on the original Likert scales. The results indicate that relatively inexpensive Kinect and LENA sensors can be harnessed to quantify attachment behavior in a key assessment protocol, suggesting the promise of objective measurement to understanding infant-parent interaction.

Mother-Infant Interaction Kinect Analysis (MIIKA): An automatic kinematic-based methodology for the investigation of interpersonal distance during early exchanges

Interpersonal distance is a core aspect of mother-child interaction. While conventional measures based on human coders do not fully capture the dynamics of this feature, computational methods provide automatic measures which can detect even small changes and more accurate estimates both spatially and temporally. Using RGB-D sensors (Microsoft Kinect V2), the present study describes a setup to automatically examine interpersonal distance during mother-child interactions, termed Mother-Infant Interaction Kinect Analysis (MIIKA). First, the laboratory setting and the data extraction method are described. By using an ad-hoc algorithm for kinematic data extraction, MIIKA returns three metrics: barycenter position (distance and velocity of approach and separation), movements (number of small, medium and large approaches and separations) and contributions (proportional contributions of mother and child to approaches and separations). Secondly, preliminary MIIKA metrics are described for a non-clinical mother-child dyad as an exemplification of the protocol. As interpersonal distance can be affected by contingent situations, we detected mother-infant full skeleton during three interactional contexts characterized by different kinds of dyadic exchanges: a free play session, a task-oriented activity and an emotionally arousing condition. Results highlighted similarities and differences between the three interactional contexts. MIIKA appears to be a promising setup to automatically examine interpersonal distance in early mother-child interactions.

A Solution for the Remote Care of Frail Elderly Individuals via Exergames

Internet of Things (IoT) solutions are a concrete answer to many needs in the healthcare framework since they enable remote support for patients and foster continuity of care. Currently, frail elderly people are among end users who most need and would benefit from IoT solutions from both a social and a healthcare point of view. Indeed, IoT technologies can provide a set of services to monitor the healthcare of the elderly or support them in order to reduce the risk of injuries, and preserve their motor and cognitive abilities. The main feature of IoT solutions for the elderly population is ease of use. Indeed, to fully exploit the potential of an IoT solution, patients should be able to autonomously deal with it. The remote-monitoring validation engineering system (ReMoVES) described here is an IoT solution that caters to the specific needs of frail elderly individuals. Its architecture was designed for use at rehabilitation centers and at patients' homes. The system is user-friendly and comfortably usable by persons who are not familiar with technology. In addition, exergames enhance patient engagement in order to curb therapy abandonment. Along with the technical presentation of the solution, a real-life scenario application is described referring to sit-to-stand activity.

Alleviation of masticatory disturbance with an occlusal splint in a Duchenne muscular dystrophy patient

Aim

To present an occlusal splint effective for alleviating masticatory disturbance in Duchenne muscular dystrophy (DMD).

Case report

A 13‐year‐old male DMD patient with masticatory disturbance presented with an open bite, with occlusal contact only between the first and second molars bilaterally and reduced masticatory performance. We applied an occlusal splint that achieved occlusal contact for all teeth and monitored its effects on masticatory function over 6 years. The occlusal splint increased occlusal contact points from 11 to 60. Although occlusal force remained at 13.9‒16 kg, masticatory performance increased, and the number of mastication strokes increased from 124 to 169. Masseter muscle activity decreased from 76.8% to 33.4% maximum voluntary contraction (MVC) and digastric muscle activity increased from 8.7% to 18.0% MVC. Time from start of peanut mastication to swallowing decreased, and the vertical mastication cycle diameter and its width on the habitual side increased.

Conclusions

Masticatory disturbance in a DMD patient was alleviated using an occlusal splint. The number of mastication strokes and the digastric to masseter muscle activity ratio were increased. Furthermore, the mastication cycle was enlarged, which increased masticatory movement. As masseter muscle activity during mastication decreased, the occlusal splint likely reduced muscle fatigue during masticatory movement.

Kinect V2-Based Gait Analysis for Children with Cerebral Palsy: Validity and Reliability of Spatial Margin of Stability and Spatiotemporal Variables

Children with cerebral palsy (CP) have high risks of falling. It is necessary to evaluate gait stability for children with CP. In comparison to traditional motion capture techniques, the Kinect has the potential to be utilised as a cost-effective gait stability assessment tool, ensuring frequent and uninterrupted gait monitoring. To evaluate the validity and reliability of this measurement, in this study, ten children with CP performed two testing sessions, of which gait data were recorded by a Kinect V2 sensor and a referential Motion Analysis system. The margin of stability (MOS) and gait spatiotemporal metrics were examined. For the spatiotemporal parameters, intraclass correlation coefficient (ICC_2,k) values were from 0.83 to 0.99 between two devices and from 0.78 to 0.88 between two testing sessions. For the MOS outcomes, ICC_2,k values ranged from 0.42 to 0.99 between two devices and 0.28 to 0.69 between two test sessions. The Kinect V2 was able to provide valid and reliable spatiotemporal gait parameters, and it could also offer accurate outcome measures for the minimum MOS. The reliability of the Kinect V2 when assessing time-specific MOS variables was limited. The Kinect V2 shows the potential to be used as a cost-effective tool for CP gait stability assessment.

Automatic Ankle Angle Detection by Integrated RGB and Depth Camera System

Depth cameras are developing widely. One of their main virtues is that, based on their data and by applying machine learning algorithms and techniques, it is possible to perform body tracking and make an accurate three-dimensional representation of body movement. Specifically, this paper will use the Kinect v2 device, which incorporates a random forest algorithm for 25 joints detection in the human body. However, although Kinect v2 is a powerful tool, there are circumstances in which the device's design does not allow the extraction of such data or the accuracy of the data is low, as is usually the case with foot position. We propose a method of acquiring this data in circumstances where the Kinect v2 device does not recognize the body when only the lower limbs are visible, improving the ankle angle's precision employing projection lines. Using a region-based convolutional neural network (Mask RCNN) for body recognition, raw data extraction for automatic ankle angle measurement has been achieved. All angles have been evaluated by inertial measurement units (IMUs) as gold standard. For the six tests carried out at different fixed distances between 0.5 and 4 m to the Kinect, we have obtained (mean ± SD) a Pearson's coefficient, r = 0.89 ± 0.04, a Spearman's coefficient, ρ = 0.83 ± 0.09, a root mean square error, RMSE = 10.7 ± 2.6 deg and a mean absolute error, MAE = 7.5 ± 1.8 deg. For the walking test, or variable distance test, we have obtained a Pearson's coefficient, r = 0.74, a Spearman's coefficient, ρ = 0.72, an RMSE = 6.4 deg and an MAE = 4.7 deg.