Motion tracking and gait feature estimation for recognising Parkinson's disease using MS Kinect

Markerless Motion Capture to Quantify Functional Performance in Neurodegeneration: Systematic Review

BACKGROUND

Markerless motion capture (MMC) uses video cameras or depth sensors for full body tracking and presents a promising approach for objectively and unobtrusively monitoring functional performance within community settings, to aid clinical decision-making in neurodegenerative diseases such as dementia.

OBJECTIVE

The primary objective of this systematic review was to investigate the application of MMC using full-body tracking, to quantify functional performance in people with dementia, mild cognitive impairment, and Parkinson disease.

METHODS

A systematic search of the Embase, MEDLINE, CINAHL, and Scopus databases was conducted between November 2022 and February 2023, which yielded a total of 1595 results. The inclusion criteria were MMC and full-body tracking. A total of 157 studies were included for full-text screening, out of which 26 eligible studies that met the selection criteria were included in the review. .

RESULTS

Primarily, the selected studies focused on gait analysis (n=24), while other functional tasks, such as sit to stand (n=5) and stepping in place (n=1), were also explored. However, activities of daily living were not evaluated in any of the included studies. MMC models varied across the studies, encompassing depth cameras (n=18) versus standard video cameras (n=5) or mobile phone cameras (n=2) with postprocessing using deep learning models. However, only 6 studies conducted rigorous comparisons with established gold-standard motion capture models.

CONCLUSIONS

Despite its potential as an effective tool for analyzing movement and posture in individuals with dementia, mild cognitive impairment, and Parkinson disease, further research is required to establish the clinical usefulness of MMC in quantifying mobility and functional performance in the real world.

Assessment of Sensorized Insoles in Balance and Gait in Individuals With Parkinson's Disease

Individuals with Parkinson's disease (PD) are characterized by gait and balance disorders limiting their independence and quality of life. Home-based rehabilitation programs, combined with drug therapy, demonstrated to be beneficial in the daily-life activities of PD subjects. Sensorized shoes can extract balance- and gait-related data in home-based scenarios and allow clinicians to monitor subjects' activities. In this study, we verified the capability of a pair of sensorized shoes (including pressure-sensitive insoles and one inertial measurement unit) in assessing ground-level walking and body weight shift exercises. The shoes can potentially be combined with a sensory biofeedback module that provides vibrotactile cues to individuals. Sensorized shoes have been assessed in terms of the capability of detecting relevant gait events (heel strike, flat foot, toe off), estimating spatiotemporal parameters of gait (stance, swing, and double support duration, stride length), estimating gait variables (vertical ground-reaction force, vGRF; coordinate of the center of pressure along the longitudinal axes of the feet, yCoP; and the dorsiflexion angle of the feet, Pitch angle). The assessment compared the outcomes with those extracted from the gold standard equipment, namely force platforms and a motion capture system. Results of this comparison with 9 PD subjects showed an overall median absolute error lower than 0.03 s in detecting the foot-contact, foot-off, and heel-off gait events while performing ground-level walking and lower than 0.15 s in body weight shift exercises. The computation of spatiotemporal parameters of gait showed median errors of 1.62 % of the stance phase duration and 0.002 m of the step length. Regarding the estimation of vGRF, yCoP, and Pitch angle, the median across-subjects Pearson correlation coefficient was 0.90, 0.94, and 0.91, respectively. These results confirm the suitability of the sensorized shoes for quantifying biomechanical features during body weight shift and gait exercises of PD and pave the way to exploit the biofeedback modules of the bidirectional interface in future studies.

Cross-Spatiotemporal Graph Convolution Networks for Skeleton-Based Parkinsonian Gait MDS-UPDRS Score Estimation

Gait impairment in Parkinson's Disease (PD) is quantitatively assessed using the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS), a well-established clinical tool. Objective and efficient PD gait assessment is crucial for developing interventions to slow or halt its advancement. Skeleton-based PD gait MDS-UPDRS score estimation has attracted increasing interest in improving diagnostic efficiency and objectivity. However, previous works ignore the important cross-spacetime dependencies between joints in PD gait. Moreover, existing PD gait skeleton datasets are very small, which is a big issue in deep learning-based gait studies. In this work, we collect a sizable PD gait skeleton dataset by multi-view Azure Kinect sensors. The collected dataset contains 102 PD patients and 30 healthy older adults. In addition, gait data from 16 young adults (aged 24-50 years) are collected to further examine the effect of age on PD gait assessment. For skeleton-based automatic PD gait analysis, we propose a novel cross-spatiotemporal graph convolution network (CST-GCN) to learn complex features of gait patterns. Specifically, a gait graph labeling strategy is designed to assemble and group cross-spacetime neighbors of the root node according to the spatiotemporal semantics of the gait skeleton. Based on this strategy, the CST-GCN module explicitly models the cross-spacetime dependencies among joints. Finally, a dual-path model is presented to realize the modeling and fusion of spatial, temporal, and cross-spacetime gait features. Extensive experiments validate the effectiveness of our method on the collected dataset.

Objective measurement versus clinician-based assessment for Parkinson's disease

INTRODUCTION

Although clinician-based assessment through standardized clinical rating scales is currently the gold standard for quantifying motor impairment in Parkinson's disease (PD), it is not without limitations, including intra- and inter-rater variability and a degree of approximation. There is increasing evidence supporting the use of objective motion analyses to complement clinician-based assessment. Objective measurement tools hold significant potential for improving the accuracy of clinical and research-based evaluations of patients.

AREAS COVERED

The authors provide several examples from the literature demonstrating how different motion measurement tools, including optoelectronics, contactless and wearable systems allow for both the objective quantification and monitoring of key motor symptoms (such as bradykinesia, rigidity, tremor, and gait disturbances), and the identification of motor fluctuations in PD patients. Furthermore, they discuss how, from a clinician's perspective, objective measurements can help in various stages of PD management.

EXPERT OPINION

In our opinion, sufficient evidence supports the assertion that objective monitoring systems enable accurate evaluation of motor symptoms and complications in PD. A range of devices can be utilized not only to support diagnosis but also to monitor motor symptom during the disease progression and can become relevant in the therapeutic decision-making process.

A systematic review of the applications of markerless motion capture (MMC) technology for clinical measurement in rehabilitation

BACKGROUND

Markerless motion capture (MMC) technology has been developed to avoid the need for body marker placement during motion tracking and analysis of human movement. Although researchers have long proposed the use of MMC technology in clinical measurement-identification and measurement of movement kinematics in a clinical population, its actual application is still in its preliminary stages. The benefits of MMC technology are also inconclusive with regard to its use in assessing patients' conditions. In this review we put a minor focus on the method's engineering components and sought primarily to determine the current application of MMC as a clinical measurement tool in rehabilitation.

METHODS

A systematic computerized literature search was conducted in PubMed, Medline, CINAHL, CENTRAL, EMBASE, and IEEE. The search keywords used in each database were "Markerless Motion Capture OR Motion Capture OR Motion Capture Technology OR Markerless Motion Capture Technology OR Computer Vision OR Video-based OR Pose Estimation AND Assessment OR Clinical Assessment OR Clinical Measurement OR Assess." Only peer-reviewed articles that applied MMC technology for clinical measurement were included. The last search took place on March 6, 2023. Details regarding the application of MMC technology for different types of patients and body parts, as well as the assessment results, were summarized.

RESULTS

A total of 65 studies were included. The MMC systems used for measurement were most frequently used to identify symptoms or to detect differences in movement patterns between disease populations and their healthy counterparts. Patients with Parkinson's disease (PD) who demonstrated obvious and well-defined physical signs were the largest patient group to which MMC assessment had been applied. Microsoft Kinect was the most frequently used MMC system, although there was a recent trend of motion analysis using video captured with a smartphone camera.

CONCLUSIONS

This review explored the current uses of MMC technology for clinical measurement. MMC technology has the potential to be used as an assessment tool as well as to assist in the detection and identification of symptoms, which might further contribute to the use of an artificial intelligence method for early screening for diseases. Further studies are warranted to develop and integrate MMC system in a platform that can be user-friendly and accurately analyzed by clinicians to extend the use of MMC technology in the disease populations.

Usability of the REHOME Solution for the Telerehabilitation in Neurological Diseases: Preliminary Results on Motor and Cognitive Platforms

The progressive aging of the population and the consequent growth of individuals with neurological diseases and related chronic disabilities, will lead to a general increase in the costs and resources needed to ensure treatment and care services. In this scenario, telemedicine and e-health solutions, including remote monitoring and rehabilitation, are attracting increasing interest as tools to ensure the sustainability of the healthcare system or, at least, to support the burden for health care facilities. Technological advances in recent decades have fostered the development of dedicated and innovative Information and Communication Technology (ICT) based solutions, with the aim of complementing traditional care and treatment services through telemedicine applications that support new patient and disease management strategies. This is the background for the REHOME project, whose technological solution, presented in this paper, integrates innovative methodologies and devices for remote monitoring and rehabilitation of cognitive, motor, and sleep disorders associated with neurological diseases. One of the primary goals of the project is to meet the needs of patients and clinicians, by ensuring continuity of treatment from healthcare facilities to the patient's home. To this end, it is important to ensure the usability of the solution by elderly and pathological individuals. Preliminary results of usability and user experience questionnaires on 70 subjects recruited in three experimental trials are presented here.

A summary index derived from Kinect to evaluate postural abnormalities severity in Parkinson’s Disease patients

Postural abnormalities are common disabling motor complications affecting patients with Parkinson’s disease (PD). We proposed a summary index for postural abnormalities (IPA) based on Kinect depth camera and explored the clinical value of this indicator. Seventy individuals with PD and thirty age-matched healthy controls (HCs) were enrolled. All participants were tested using a Kinect-based system with IPA automatically obtained by algorithms. Significant correlations were detected between IPA and the Movement Disorder Society-Sponsored Revision of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS) total score (rs = 0.369, p = 0.002), MDS-UPDRS-III total score (rs = 0.431, p < 0.001), MDS-UPDRS-III 3.13 score (rs = 0.573, p < 0.001), MDS-UPDRS-III-bradykinesia score (rs = 0.311, p = 0.010), the 39-item Parkinson’s Disease Questionnaire (PDQ-39) (rs = 0.272, p = 0.0027) and the Berg Balance Scale (BBS) score (rs = −0.350, p = 0.006). The optimal cut-off value of IPA for distinguishing PD from HCs was 12.96 with a sensitivity of 97.14%, specificity of 100.00%, area under the curve (AUC) of 0.999 (0.997–1.002, p < 0.001), and adjusted AUC of 0.998 (0.993–1.000, p < 0.001). The optimal cut-off value of IPA for distinguishing between PD with and without postural abnormalities was 20.14 with a sensitivity, specificity, AUC and adjusted AUC of 77.78%, 73.53%, 0.817 (0.720–0.914, p < 0.001), and 0.783 (0.631–0.900, p < 0.001), respectively. IPA was significantly correlated to the clinical manifestations of PD patients, and could reflect the global severity of postural abnormalities in PD with important value in distinguishing PD from HCs and distinguishing PD with postural abnormalities from those without.

Assessment Tasks and Virtual Exergames for Remote Monitoring of Parkinson's Disease: An Integrated Approach Based on Azure Kinect

Motor impairments are among the most relevant, evident, and disabling symptoms of Parkinson’s disease that adversely affect quality of life, resulting in limited autonomy, independence, and safety. Recent studies have demonstrated the benefits of physiotherapy and rehabilitation programs specifically targeted to the needs of Parkinsonian patients in supporting drug treatments and improving motor control and coordination. However, due to the expected increase in patients in the coming years, traditional rehabilitation pathways in healthcare facilities could become unsustainable. Consequently, new strategies are needed, in which technologies play a key role in enabling more frequent, comprehensive, and out-of-hospital follow-up. The paper proposes a vision-based solution using the new Azure Kinect DK sensor to implement an integrated approach for remote assessment, monitoring, and rehabilitation of Parkinsonian patients, exploiting non-invasive 3D tracking of body movements to objectively and automatically characterize both standard evaluative motor tasks and virtual exergames. An experimental test involving 20 parkinsonian subjects and 15 healthy controls was organized. Preliminary results show the system’s ability to quantify specific and statistically significant (p < 0.05) features of motor performance, easily monitor changes as the disease progresses over time, and at the same time permit the use of exergames in virtual reality both for training and as a support for motor condition assessment (for example, detecting an average reduction in arm swing asymmetry of about 14% after arm training). The main innovation relies precisely on the integration of evaluative and rehabilitative aspects, which could be used as a closed loop to design new protocols for remote management of patients tailored to their actual conditions.

Machine Learning Classifiers to Evaluate Data From Gait Analysis With Depth Cameras in Patients With Parkinson’s Disease

Introduction

The assessments of the motor symptoms in Parkinson’s disease (PD) are usually limited to clinical rating scales (MDS UPDRS III), and it depends on the clinician’s experience. This study aims to propose a machine learning technique algorithm using the variables from upper and lower limbs, to classify people with PD from healthy people, using data from a portable low-cost device (RGB-D camera). And can be used to support the diagnosis and follow-up of patients in developing countries and remote areas.

Methods

We used Kinect®eMotion system to capture the spatiotemporal gait data from 30 patients with PD and 30 healthy age-matched controls in three walking trials. First, a correlation matrix was made using the variables of upper and lower limbs. After this, we applied a backward feature selection model using R and Python to determine the most relevant variables. Three further analyses were done using variables selected from backward feature selection model (Dataset A), movement disorders specialist (Dataset B), and all the variables from the dataset (Dataset C). We ran seven machine learning models for each model. Dataset was divided 80% for algorithm training and 20% for evaluation. Finally, a causal inference model (CIM) using the DoWhy library was performed on Dataset B due to its accuracy and simplicity.

Results

The Random Forest model is the most accurate for all three variable Datasets (Dataset A: 81.8%; Dataset B: 83.6%; Dataset C: 84.5%) followed by the support vector machine. The CIM shows a relation between leg variables and the arms swing asymmetry (ASA) and a proportional relationship between ASA and the diagnosis of PD with a robust estimator (1,537).

Conclusions

Machine learning techniques based on objective measures using portable low-cost devices (Kinect®eMotion) are useful and accurate to classify patients with Parkinson’s disease. This method can be used to evaluate patients remotely and help clinicians make decisions regarding follow-up and treatment.

Review-Emerging Portable Technologies for Gait Analysis in Neurological Disorders

The understanding of locomotion in neurological disorders requires technologies for quantitative gait analysis. Numerous modalities are available today to objectively capture spatiotemporal gait and postural control features. Nevertheless, many obstacles prevent the application of these technologies to their full potential in neurological research and especially clinical practice. These include the required expert knowledge, time for data collection, and missing standards for data analysis and reporting. Here, we provide a technological review of wearable and vision-based portable motion analysis tools that emerged in the last decade with recent applications in neurological disorders such as Parkinson's disease and Multiple Sclerosis. The goal is to enable the reader to understand the available technologies with their individual strengths and limitations in order to make an informed decision for own investigations and clinical applications. We foresee that ongoing developments toward user-friendly automated devices will allow for closed-loop applications, long-term monitoring, and telemedical consulting in real-life environments.

A Systematic Review of Machine Learning Based Gait characteristics in Parkinson's disease

OBJECTIVE

Parkinson's disease is a pervasive neuro disorder that affects people's quality of life throughout the world. The unsatisfactory results of clinical rating scales open the door for more research. PD treatment using current biomarkers seems a difficult task. So automatic evaluation at an early stage may enhance the quality and time-period of life.

METHODS

Grading of Recommendations Assessment, Development, and Evaluation (GRADE) and Population, intervention, comparison, and outcome (PICO) search methodology schemes are followed to search the data and eligible studies for this survey. Approximate 1500 articles were extracted using related search strings. After the stepwise mapping and elimination of studies, 94 papers are found suitable for the present review.

RESULTS

After the quality assessment of extracted studies, nine inhibitors are identified to analyze people's gait with Parkinson's disease, where four are critical. This review also differentiates the various machine learning classification techniques with their PD analysis characteristics in previous studies. The extracted research gaps are described as future perspectives. Results can help practitioners understand the PD gait as a valuable biomarker for detection, quantification, and classification.

CONCLUSION

Due to less cost and easy recording of gait, gait-based techniques are becoming popular in PD detection. By encapsulating the gait-based studies, it gives an in-depth knowledge of PD, different measures that affect gait detection and classification.

Technology-based therapy-response and prognostic biomarkers in a prospective study of a de novo Parkinson's disease cohort

Early noninvasive reliable biomarkers are among the major unmet needs in Parkinson's disease (PD) to monitor therapy response and disease progression. Objective measures of motor performances could allow phenotyping of subtle, undetectable, early stage motor impairments of PD patients. This work aims at identifying prognostic biomarkers in newly diagnosed PD patients and quantifying therapy-response. Forty de novo PD patients underwent clinical and technology-based kinematic assessments performing motor tasks (MDS-UPDRS part III) to assess tremor, bradykinesia, gait, and postural stability (T0). A visit after 6 months (T1) and a clinical and kinematic assessment after 12 months (T2) where scheduled. A clinical follow-up was provided between 30 and 36 months after the diagnosis (T3). We performed an ANOVA for repeated measures to compare patients' kinematic features at baseline and at T2 to assess therapy response. Pearson correlation test was run between baseline kinematic features and UPDRS III score variation between T0 and T3, to select candidate kinematic prognostic biomarkers. A multiple linear regression model was created to predict the long-term motor outcome using T0 kinematic measures. All motor tasks significantly improved after the dopamine replacement therapy. A significant correlation was found between UPDRS scores variation and some baseline bradykinesia (toe tapping amplitude decrement, p = 0.009) and gait features (velocity of arms and legs, sit-to-stand time, p = 0.007; p = 0.009; p = 0.01, respectively). A linear regression model including four baseline kinematic features could significantly predict the motor outcome (p = 0.000214). Technology-based objective measures represent possible early and reproducible therapy-response and prognostic biomarkers.

Supporting the Assessment of Hereditary Transthyretin Amyloidosis Patients Based On 3-D Gait Analysis and Machine Learning

Hereditary Transthyretin Amyloidosis (vATTR-V30M) is a rare and highly incapacitating sensorimotor neuropathy caused by an inherited mutation (Val30Met), which typically affects gait, among other symptoms. In this context, we investigated the possibility of using machine learning (ML) techniques to build a model(s) that can be used to support the detection of the Val30Met mutation (possibility of developing the disease), as well as symptom onset detection for the disease, given the gait characteristics of a person. These characteristics correspond to 24 gait parameters computed from 3-D body data, provided by a Kinect v2 camera, acquired from a person while walking towards the camera. To build the model(s), different ML algorithms were explored: k-nearest neighbors, decision tree, random forest, support vector machines (SVM), and multilayer perceptron. For a dataset corresponding to 66 subjects (25 healthy controls, 14 asymptomatic mutation carriers, and 27 patients) and several gait cycles per subject, we were able to obtain a model that distinguishes between controls and vATTR-V30M mutation carriers (with or without symptoms) with a mean accuracy of 92% (SVM). We also obtained a model that distinguishes between asymptomatic and symptomatic carriers with a mean accuracy of 98% (SVM). These results are very relevant, since this is the first study that proposes a ML approach to support vATTR-V30M patient assessment based on gait, being a promising foundation for the development of a computer-aided diagnosis tool to help clinicians in the identification and follow-up of this disease. Furthermore, the proposed method may also be used for other neuropathies.

Human Gait Analysis in Neurodegenerative Diseases: a Review

This paper reviews the recent literature on technologies and methodologies for quantitative human gait analysis in the context of neurodegnerative diseases. The use of technological instruments can be of great support in both clinical diagnosis and severity assessment of these pathologies. In this paper, sensors, features and processing methodologies have been reviewed in order to provide a highly consistent work that explores the issues related to gait analysis. First, the phases of the human gait cycle are briefly explained, along with some non-normal gait patterns (gait abnormalities) typical of some neurodegenerative diseases. The work continues with a survey on the publicly available datasets principally used for comparing results. Then the paper reports the most common processing techniques for both feature selection and extraction and for classification and clustering. Finally, a conclusive discussion on current open problems and future directions is outlined.

A New Software for Quantifying Motor Deficit After Stroke: A Case-Control Feasibility Pilot Study

Introduction: The degree of disability after stroke needs to be objectively measured to implement adequate rehabilitation programs. Here, we evaluate the feasibility of a custom-built software to assess motor status after stroke.

Methods: This is a prospective, case–control pilot study comparing stroke patients with healthy volunteers. A workout evaluation that included trunk and upper limb movement was captured with Kinect® and kinematic metrics were extracted with Akira®. Trunk and joint angles were analyzed and compared between cases and controls. Patients were evaluated within the first week from stroke onset using the National Institutes of Health Stroke Scale (NIHSS), Fulg-Meyer Assessment (FMA), and modified Rankin Scale (mRS) scales; the relationship with kinematic measurements was explored.

Results: Thirty-seven patients and 33 controls were evaluated. Median (IQR) NIHSS of cases was 2 (0–4). The kinematic metrics that showed better discriminatory capacity were body sway during walking (less in cases than in controls, p = 0.01) and the drift in the forearm–trunk angle during shoulder abduction in supination (greater in cases than in controls, p = 0.01). The body sway during walking was moderately correlated with NIHSS score (Rho = −0.39; p = 0.01) but better correlated with mRS score (Rho = −0.52; p < 0.001) and was associated with the absence of disability (mRS 0–1) (OR = 0.64; p = 0.02). The drift in the forearm–trunk angle in supination was associated with the presence of disability (mRS >1) (OR = 1.27; p = 0.04).

Conclusion: We present a new software that detects even mild motor impairment in stroke patients underestimated by clinical scales but with an impact on patient functionality.

What the Tech? The Management of Neurological Dysfunction Through the Use of Digital Technology

Worldwide, it is estimated that millions of individuals suffer from a neurological disorder which can be the result of head injuries, ischaemic events such as a stroke, or neurodegenerative disorders such as Parkinson's disease (PD) and multiple sclerosis (MS). Problems with mobility and hemiparesis are common for these patients, making daily life, social factors and independence heavily affected. Current therapies aimed at improving such conditions are often tedious in nature, with patients often losing vital motivation and positive outlook towards their rehabilitation. The interest in the use of digital technology in neuro-rehabilitation has skyrocketed in the past decade. To gain insight, a systematic review of the literature in the field was conducting following the Preferred Reporting Items for Systematic Review and Meta-analyses (PRISMA) guidelines for three categories: stroke, Parkinson's disease and multiple sclerosis. It was found that the majority of the literature (84%) was in favour of the use of digital technologies in the management of neurological dysfunction; with some papers taking a "neutral" or "against" standpoint. It was found that the use of technologies such as virtual reality (VR), robotics, wearable sensors and telehealth was highly accepted by patients, helped to improve function, reduced anxiety and make therapy more accessible to patients living in more remote areas. The most successful therapies were those that used a combination of conventional therapies and new digital technologies.

Research on badminton action feature recognition based on improved HMM model

The badminton movement speed is fast, and the movement is complicated. Therefore, it is difficult to effectively recognize the athlete’s movement through the monitoring level in the competition and training, which makes it difficult for the athlete to effectively improve his skill. In order to effectively improve the training effect and the quality of the athletes, this study uses badminton as the research object, analyzes the sports characteristics research algorithm through literature review, and finds the shortcomings of traditional algorithms. At the same time, this paper combines the actual situation to improve the algorithm and combines GMM and HMM to builds the GMM-HMM model. In addition, this paper uses the Baum-Welch unsupervised learning algorithm for data processing, and based on the learning machine training, the recognition results are obtained. Finally, in order to verify the validity of the model, this study uses the mobile phone badminton action as the data foundation and performs training recognition in the model to summarize the recognition results. The research shows that the algorithm has good performance and can meet the actual needs and can be used as a reference for the subsequent related research corporal punishment theory.

Extraction and selection of gait recognition features using skeleton point detection and improved fuzzy decision

It is of great importance to effectively measure gait features and recognize the signature gait patterns for gait rehabilitation. In this work, we used a skeleton point detection to extract gait features and proposed an improved fuzzy decision to select the most significant features for classifying gait patterns. Thirteen gait recognition features were extracted from the obtained skeleton points data. Taking the extracted features as an input, our improved fuzzy similarity priority decision method has obtained important sequences of all features based on the relatively important scores. Then, the ranked features were delivered in different classifiers by a sequential forward selection strategy to select the optimal feature subset. There were significant differences between groups in each of the thirteen gait recognition features (p < 0.005), indicating that all extracted features are potential influence factors for classifying gait patterns. We also found that the highest classification accuracy of 100% for gait feature subsets included the stride frequency, maximum flexion angle of knee, and toe-out angle, on the all classifiers. The results suggest that the proposed approaches are very useful in searching for the optimal feature subset in present dataset.

Rehabilitative Effects of Virtual Reality Technology for Mild Cognitive Impairment: A Systematic Review With Meta-Analysis

Objective: To evaluate the impact of virtual reality (VR) technology on the cognitive functions (overall cognitive ability, executive function, short-term memory, and long-term memory) of people with mild cognitive impairment (MCI).

Methods: All major databases, including Web of Science, PubMed, Scopus, Proquest, WanFang, and CNKI, were searched to identify all relevant studies published in English or Chinese since October 28th, 2019. Two researchers independently conducted document retrieval, study selection, data extraction, and methodological quality evaluation.

Result: 15 randomized controlled trials were analyzed (N = 612 people with MCI), with the methodological quality evaluation score ranging from 5 to 7 points. A random effects model was selected to combine effect sizes. The result of the meta-analysis indicates that VR significantly enhanced MCI patients' overall cognitive ability (SMD = 0.869, 95% confidence interval [CI] = 0.330–1.407, P = 0.002, I² = 86.822, n = 537) and executive function (SMD = 1.083, 95%, 95%CI = 00.134–2.031, P = 0.025, I² = 93.748, n = 220). The meta-analysis indicated that after VR training, effects on short-term memory (SMD = 0.488, 95%CI = −0.108–1.084, P = 0.109, I² = 62.354, n = 131) and long-term memory (SMD = 0.335, 95%CI = −1.194–0.863, P = 0.0.214, I² = 58.868, n = 152) were not statistically significant.

Conclusions: The present meta-analysis verifies the potential rehabilitative effects of VR technology for mild cognitive impairment.

Measuring movements in adolescents with psychosis using the Microsoft Kinect sensor: a pilot study exploring a new tool for assessing aspects of antipsychotic-induced parkinsonism

BACKGROUND

The assessment of motor disturbances in antipsychotic-treated adolescent patients is often limited to the use of observer-based rating scales with interobserver variability. The objectives of this pilot study were to measure movement patterns associated with antipsychotic-induced parkinsonism in young patients with psychosis and initiating/treated with antipsychotics, using a computer application connected with the Microsoft Kinect sensor (Motorgame).

METHOD

All participants were assessed by neurological examination, clinical side effect rating scales (Udvalg for Kliniske Undersøgelser Side Effect Rating Scale, Barnes Akathisia Rating Scale, Simpson Angus Scale (SAS), and Abnormal Involuntary Movement Scale), and the Motorgame. Furthermore, speed of information processing and motor speed with subtests from the Brief Assessment of Cognition in Schizophrenia test battery was assessed.

RESULTS

We included 21 adolescents with first-episode psychosis (62% treated with antipsychotics; males 38%; mean age 16 ± 1.4 years) and 69 healthy controls (males 36%; mean age 16 ± 1.5 years). Prolonged time of motor performance (TOMP) in the Motorgame was associated with higher SAS scores for arm dropping (p = .009). A consistent practice effect was detected (p < .001). We found no significant associations between TOMP and age, height, body weight, sex, antipsychotic dosage, or information processing speed.

CONCLUSIONS

We found an uncorrected significant association between prolonged TOMP and shoulder bradykinesia. The Motorgame was found useful in assessing parkinsonian symptoms in early-onset psychosis and accepted by participants. Future studies of larger cohorts, including patients with high scores in clinical motor side effect scales, are required to establish solid validity of the novel test.

Sleep Apnea Detection with Polysomnography and Depth Sensors

This paper is devoted to proving two goals, to show that various depth sensors can be used to record breathing rate with the same accuracy as contact sensors used in polysomnography (PSG), in addition to proving that breathing signals from depth sensors have the same sensitivity to breathing changes as in PSG records. The breathing signal from depth sensors can be used for classification of sleep [d=R2]apneaapnoa events with the same success rate as with PSG data. The recent development of computational technologies has led to a big leap in the usability of range imaging sensors. New depth sensors are smaller, have a higher sampling rate, with better resolution, and have bigger precision. They are widely used for computer vision in robotics, but they can be used as non-contact and non-invasive systems for monitoring breathing and its features. The breathing rate can be easily represented as the frequency of a recorded signal. All tested depth sensors (MS Kinect v2, RealSense SR300, R200, D415 and D435) are capable of recording depth data with enough precision in depth sensing and sampling frequency in time (20-35 frames per second (FPS)) to capture breathing rate. The spectral analysis shows a breathing rate between 0.2 Hz and 0.33 Hz, which corresponds to the breathing rate of an adult person during sleep. To test the quality of breathing signal processed by the proposed workflow, a neural network classifier (simple competitive NN) was trained on a set of 57 whole night polysomnographic records with a classification of sleep [d=R2]apneaapnoas by a sleep specialist. The resulting classifier can mark all [d=R2]apneaapnoa events with 100% accuracy when compared to the classification of a sleep specialist, which is useful to estimate the number of events per hour. [d=R2]When compared to the classification of polysomnographic breathing signal segments by a sleep specialistand, which is used for calculating length of the event, the classifier has an [d=R1] F 1 score of 92.2%Accuracy of 96.8% (sensitivity 89.1% and specificity 98.8%). The classifier also proves successful when tested on breathing signals from MS Kinect v2 and RealSense R200 with simulated sleep [d=R2]apneaapnoa events. The whole process can be fully automatic after implementation of automatic chest area segmentation of depth data.

Random forest-based classsification and analysis of hemiplegia gait using low-cost depth cameras

Hemiplegia is a form of paralysis that typically has the symptom of dysbasia. In current clinical rehabilitations, to measure the level of hemiplegia gaits, clinicians often conduct subject evaluations through observations, which is unreliable and inaccurate. The Microsoft Kinect sensor (MS Kinect) is a widely used, low-cost depth sensor that can be used to detect human behaviors in real time. The purpose of this study is to investigate the usage of the Kinect data for the classification and analysis of hemiplegia gait. We first acquire the gait data by using a MS Kinect and extract a set of gait features including the stride length, gait speed, left/right moving distances, and up/down moving distances. With the gait data of 60 subjects including 20 hemiplegia patients and 40 healthy subjects, we employ a random forest-based classification approach to analyze the importances of different gait features for hemiplegia classification. Thanks to the over-fitting avoidance nature of the random forest approach, we do not need to have a careful control over the percentage of patients in the training data. In our experiments, our approach obtained the averaged classification accuracy of 90.65% among all the combinations of the gait features, which substantially outperformed state-of-the-art methods. The best classification accuracy of our approach is 95.45%, which is superior than all existing methods. Additionally, our approach also correctly reveals the importance of different gait features for hemiplegia classification. Our random forest-based approach outperforms support vector machine-based method and the Bayesian-based method, and can effectively extract gait features of subjects with hemiplegia for the classification and analysis of hemiplegia. Graphical Abstract Random Forest based Classsification and Analysis of Hemiplegia Gait using Low-cost Depth Cameras. Left: Motion capture with MS Kinect; Top-right: Random Forest Classsification based on the extracted gait features; Bottom-right: Sensitivity and specificity evaluation of the proposed classification approach.

A low-cost vision system based on the analysis of motor features for recognition and severity rating of Parkinson's Disease

BACKGROUND

Assessment and rating of Parkinson's Disease (PD) are commonly based on the medical observation of several clinical manifestations, including the analysis of motor activities. In particular, medical specialists refer to the MDS-UPDRS (Movement Disorder Society - sponsored revision of Unified Parkinson's Disease Rating Scale) that is the most widely used clinical scale for PD rating. However, clinical scales rely on the observation of some subtle motor phenomena that are either difficult to capture with human eyes or could be misclassified. This limitation motivated several researchers to develop intelligent systems based on machine learning algorithms able to automatically recognize the PD. Nevertheless, most of the previous studies investigated the classification between healthy subjects and PD patients without considering the automatic rating of different levels of severity.

METHODS

In this context, we implemented a simple and low-cost clinical tool that can extract postural and kinematic features with the Microsoft Kinect v2 sensor in order to classify and rate PD. Thirty participants were enrolled for the purpose of the present study: sixteen PD patients rated according to MDS-UPDRS and fourteen healthy paired subjects. In order to investigate the motor abilities of the upper and lower body, we acquired and analyzed three main motor tasks: (1) gait, (2) finger tapping, and (3) foot tapping. After preliminary feature selection, different classifiers based on Support Vector Machine (SVM) and Artificial Neural Networks (ANN) were trained and evaluated for the best solution.

RESULTS

Concerning the gait analysis, results showed that the ANN classifier performed the best by reaching 89.4% of accuracy with only nine features in diagnosis PD and 95.0% of accuracy with only six features in rating PD severity. Regarding the finger and foot tapping analysis, results showed that an SVM using the extracted features was able to classify healthy subjects versus PD patients with great performances by reaching 87.1% of accuracy. The results of the classification between mild and moderate PD patients indicated that the foot tapping features were the most representative ones to discriminate (81.0% of accuracy).

CONCLUSIONS

The results of this study have shown how a low-cost vision-based system can automatically detect subtle phenomena featuring the PD. Our findings suggest that the proposed tool can support medical specialists in the assessment and rating of PD patients in a real clinical scenario.

Noninvasive and quantitative evaluation of movement disorder disability using an infrared depth sensor

Cerebellar ataxia and Parkinson's disease are neurodegenerative disorders clinically characterized by motor disabilities including gait disturbance. This study aimed to investigate the usefulness of an infrared depth sensor device to quantitatively evaluate gait disturbances in patients with movement disorders. 25 ataxic, 25 Parkinson's disease, and 25 control subjects were enrolled and evaluated their walk. Stride length, feet interval, gait rhythm, and a ratio of the actual walking route length to the linear distance between the start and goal points (A/L ratio) were assessed and compared. Outcome correlations with clinical scales were also analyzed. The average stride length was shorter in ataxic subjects or Parkinson's disease subjects than in control subjects. The average feet interval was larger in ataxic subjects than in control subjects. The stride length coefficient of variation (CV), gait rhythm CV, and average and standard deviations of the A/L ratio were larger in ataxic or Parkinson's disease subjects than in control subjects. Ataxic subjects exhibited significant positive correlations between the CV of stride length or average feet interval and scale for the assessment and rating of ataxia scores or international cooperative ataxia rating scale scores. Parkinson's disease subjects exhibited a significant correlation between the average stride length, CV of stride length, or standard deviation of A/L ratio and unified Parkinson's disease rating scale score. The device used in this study differentiated the characteristics of gait disturbance in each movement disorder and quantitatively evaluated ataxia or Parkinson's disease severity, indicating its potential clinical utility across applications.

Can Kinect aid motor learning in sportsmen? A study for three standing techniques in judo

Our objective was to examine how exercises with the second generation of the Microsoft Kinect sensor may aid in the process of motor learning in young judo practitioners. We addressed improvements in spatio-temporal accuracy during execution of three standing techniques in judo, in a simple paradigm designed to study short-term practice effects. Two groups of judokas, 12 athletes each—one aided with Kinect and our dedicated software vs a group of controls—were asked to mimic previously recorded master-level performances of the three techniques, established as benchmarks by a two times world champion in judo. In five training sessions, athletes of the aided group used a virtual-reality setup in which they trained with a virtual representation of the master displayed on a large screen with a simultaneous real-time visualisation of their own movements in the form of an avatar based on body joint localisation, as determined by Kinect, which also measured their performance. The control group used Kinect in the 1st and 5th session, which was necessary for the measurements that constituted the basis for subsequent statistical comparisons, whereas the 2nd, 3rd, and 4th session in this group was guided by a coach, without the use of the Kinect setup. In addition, athletes of the two groups had unrestricted access to a video recording of the master performing the three throws. We found statistically significant improvements (p < 0.05) in the accuracy of executing the three techniques between the 1st and the 5th training session for the aided group but not for the control group. We conclude that incorporating Kinect based exercises into a judo training programme may be a useful means to supporting motor learning, therefore enhancing training efficiency, and thus improving performance.

Recent advances in rehabilitation for Parkinson's Disease with Exergames: A Systematic Review

OBJECTIVE

The goal of this contribution is to gather and to critically analyze recent evidence regarding the potential of exergaming for Parkinson's disease (PD) rehabilitation and to provide an up-to-date analysis of the current state of studies on exergame-based therapy in PD patients.

METHODS

We performed our search based on the conclusions of a previous systematic review published in 2014. Inclusion criteria were articles published in the indexed databases Pubmed, Scopus, Sciencedirect, IEEE and Cochrane published since January 1, 2014. Exclusion criteria were papers with a target group other than PD patients exclusively, or contributions not based on exergames. Sixty-four publications out of 525 matches were selected.

RESULTS

The analysis of the 64 selected publications confirmed the putative improvement in motor skills suggested by the results of the previous review. The reliability and safety of both Microsoft Kinect and Wii Balance Board in the proposed scenarios was further confirmed by several recent studies. Clinical trials present better (n = 5) or similar (n = 3) results than control groups (traditional rehabilitation or regular exercise) in motor (TUG, BBS) and cognitive (attention, alertness, working memory, executive function), thus emphasizing the potential of exergames in PD. Pilot studies (n = 11) stated the safety and feasibility of both Microsoft Kinect and Wii Balance Board, potentially in home scenarios as well. Technical papers (n = 30) stated the reliability of balance and gait data captured by both devices. Related meta-analyses and systematic reviews (n = 15) further support these statements, generally citing the need for adaptation to patient's skills and new input devices and sensors as identified gaps.

CONCLUSION

Recent evidence indicates exergame-based therapy has been widely proven to be feasible, safe, and at least as effective as traditional PD rehabilitation. Further insight into new sensors, best practices and different cognitive stadiums of PD (such as PD with Mild Cognitive Impairment), as well as task specificity, are required. Also, studies linking game parameters and results with traditional assessment methods, such as UPDRS scores, are required. Outcomes for randomized controlled trials (RCTs) should be standardized, and follow-up studies are required, particularly for motor outcomes.

Using Kinect to classify Parkinson's disease stages related to severity of gait impairment

BACKGROUND

Parkinson's Disease (PD) is a chronic neurodegenerative disease associated with motor problems such as gait impairment. Different systems based on 3D cameras, accelerometers or gyroscopes have been used in related works in order to study gait disturbances in PD. Kinect Ⓡ has also been used to build these kinds of systems, but contradictory results have been reported: some works conclude that Kinect does not provide an accurate method of measuring gait kinematics variables, but others, on the contrary, report good accuracy results.

METHODS

In this work, we have built a Kinect-based system that can distinguish between different PD stages, and have performed a clinical study with 30 patients suffering from PD belonging to three groups: early PD patients without axial impairment, more evolved PD patients with higher gait impairment but without Freezing of Gait (FoG), and patients with advanced PD and FoG. Those patients were recorded by two Kinect devices when they were walking in a hospital corridor. The datasets obtained from the Kinect were preprocessed, 115 features identified, some methods were applied to select the relevant features (correlation based feature selection, information gain, and consistency subset evaluation), and different classification methods (decision trees, Bayesian networks, neural networks and K-nearest neighbours classifiers) were evaluated with the goal of finding the most accurate method for PD stage classification.

RESULTS

The classifier that provided the best results is a particular case of a Bayesian Network classifier (similar to a Naïve Bayesian classifier) built from a set of 7 relevant features selected by the correlation-based on feature selection method. The accuracy obtained for that classifier using 10-fold cross validation is 93.40%. The relevant features are related to left shin angles, left humerus angles, frontal and lateral bents, left forearm angles and the number of steps during spin.

CONCLUSIONS

In this paper, it is shown that using Kinect is adequate to build a inexpensive and comfortable system that classifies PD into three different stages related to FoG. Compared to the results of previous works, the obtained accuracy (93.40%) can be considered high. The relevant features for the classifier are: a) movement and position of the left arm, b) trunk position for slightly displaced walking sequences, and c) left shin angle, for straight walking sequences. However, we have obtained a better accuracy (96.23%) for a classifier that only uses features extracted from slightly displaced walking steps and spin walking steps. Finally, the obtained set of relevant features may lead to new rehabilitation therapies for PD patients with gait problems.

A Review on Accelerometry-Based Gait Analysis and Emerging Clinical Applications

Gait analysis continues to be an important technique for many clinical applications to diagnose and monitor certain diseases. Many mental and physical abnormalities cause measurable differences in a person's gait. Gait analysis has applications in sport, computer games, physical rehabilitation, clinical assessment, surveillance, human recognition, modeling, and many other fields. There are established methods using various sensors for gait analysis, of which accelerometers are one of the most often employed. Accelerometer sensors are generally more user friendly and less invasive. In this paper, we review research regarding accelerometer sensors used for gait analysis with particular focus on clinical applications. We provide a brief introduction to accelerometer theory followed by other popular sensing technologies. Commonly used gait phases and parameters are enumerated. The details of selecting the papers for review are provided. We also review several gait analysis software. Then we provide an extensive report of accelerometry-based gait analysis systems and applications, with additional emphasis on trunk accelerometry. We conclude this review with future research directions.

Vision-based gait impairment analysis for aided diagnosis

Gait is a firsthand reflection of health condition. This belief has inspired recent research efforts to automate the analysis of pathological gait, in order to assist physicians in decision-making. However, most of these efforts rely on gait descriptions which are difficult to understand by humans, or on sensing technologies hardly available in ambulatory services. This paper proposes a number of semantic and normalized gait features computed from a single video acquired by a low-cost sensor. Far from being conventional spatio-temporal descriptors, features are aimed at quantifying gait impairment, such as gait asymmetry from several perspectives or falling risk. They were designed to be invariant to frame rate and image size, allowing cross-platform comparisons. Experiments were formulated in terms of two databases. A well-known general-purpose gait dataset is used to establish normal references for features, while a new database, introduced in this work, provides samples under eight different walking styles: one normal and seven impaired patterns. A number of statistical studies were carried out to prove the sensitivity of features at measuring the expected pathologies, providing enough evidence about their accuracy. Graphical Abstract Graphical abstract reflecting main contributions of the manuscript: at the top, a robust, semantic and easy-to-interpret feature set to describe impaired gait patterns; at the bottom, a new dataset consisting of video-recordings of a number of volunteers simulating different patterns of pathological gait, where features were statistically assessed.

Utilising the Intel RealSense Camera for Measuring Health Outcomes in Clinical Research

Applications utilising 3D Camera technologies for the measurement of health outcomes in the health and wellness sector continues to expand. The Intel® RealSense™ is one of the leading 3D depth sensing cameras currently available on the market and aligns itself for use in many applications, including robotics, automation, and medical systems. One of the most prominent areas is the production of interactive solutions for rehabilitation which includes gait analysis and facial tracking. Advancements in depth camera technology has resulted in a noticeable increase in the integration of these technologies into portable platforms, suggesting significant future potential for pervasive in-clinic and field based health assessment solutions. This paper reviews the Intel RealSense technology's technical capabilities and discusses its application to clinical research and includes examples where the Intel RealSense camera range has been used for the measurement of health outcomes. This review supports the use of the technology to develop robust, objective movement and mobility-based endpoints to enable accurate tracking of the effects of treatment interventions in clinical trials.

Healthcare Applications of Smart Watches

The aim of this systematic review is to synthesize research studies involving the use of smart watch devices for healthcare.

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was chosen as the systematic review methodology. We searched PubMed, CINAHL Plus, EMBASE, ACM, and IEEE Xplore. In order to include ongoing clinical trials, we also searched ClinicalTrials.gov. Two investigators evaluated the retrieved articles for inclusion. Discrepancies between investigators regarding article inclusion and extracted data were resolved through team discussion.

356 articles were screened and 24 were selected for review. The most common publication venue was in conference proceedings (13, 54%). The majority of studies were published or presented in 2015 (19, 79%). We identified two registered clinical trials underway. A large proportion of the identified studies focused on applications involving health monitoring for the elderly (6, 25%). Five studies focused on patients with Parkinson’s disease and one on cardiac arrest. There were no studies which reported use of usability testing before implementation.

Most of the reviewed studies focused on the chronically ill elderly. There was a lack of detailed description of user-centered design or usability testing before implementation. Based on our review, the most commonly used platform in healthcare research was that of the Android Wear. The clinical application of smart watches as assistive devices deserves further attention.

Smart watches are unobtrusive and easy to wear. While smart watch technology supplied with biosensors has potential to be useful in a variety of healthcare applications, rigorous research with their use in clinical settings is needed.

Citation: Lu T-C, Fu C-M, Ma M H-M, Fang C-C, Turner AM. Healthcare applications of smart watches: A systematic review.

Novel Noninvasive Brain Disease Detection System Using a Facial Image Sensor

Brain disease including any conditions or disabilities that affect the brain is fast becoming a leading cause of death. The traditional diagnostic methods of brain disease are time-consuming, inconvenient and non-patient friendly. As more and more individuals undergo examinations to determine if they suffer from any form of brain disease, developing noninvasive, efficient, and patient friendly detection systems will be beneficial. Therefore, in this paper, we propose a novel noninvasive brain disease detection system based on the analysis of facial colors. The system consists of four components. A facial image is first captured through a specialized sensor, where four facial key blocks are next located automatically from the various facial regions. Color features are extracted from each block to form a feature vector for classification via the Probabilistic Collaborative based Classifier. To thoroughly test the system and its performance, seven facial key block combinations were experimented. The best result was achieved using the second facial key block, where it showed that the Probabilistic Collaborative based Classifier is the most suitable. The overall performance of the proposed system achieves an accuracy −95%, a sensitivity −94.33%, a specificity −95.67%, and an average processing time (for one sample) of <1 min at brain disease detection.

Accurate estimation of joint motion trajectories for rehabilitation using Kinect

Kinect as an effective tool for clinical assessment and rehabilitation, suffers from drawbacks of lower accuracy of measuring human body kinematic data when compared to clinical gold standard motion capture devices. The accuracy of time-varying 3D locations of a fixed number of body joints obtained from Kinect skeletal tracking utility is affected by the presence of noise and precision limits of the Kinect depth sensor. In this paper, a framework for improving accuracy of Kinect skeletal tracking is proposed, that uses a set of parametric models to represent and track the human body. Each of the models represents the 3D geometric properties of a body segment connecting two adjacent joints. The temporal trajectories of the joints are recovered via particle filter-based motion tracking of each model. The proposed method was evaluated on Active Range of Motion exercises by 7 healthy subjects. The joint motion trajectories obtained using the proposed framework exhibit a greater motion smoothness (by 36%) along with reduced coefficient of variation of radius (by 34%), and lower value of root-mean-squared-error (by 53%), when compared to Kinect joint trajectories. This indicates an improvement in accuracy of joint motion trajectories using Kinect device, rendering it more suitable for clinical assessment and rehabilitation.

Inertial Sensor-Based Robust Gait Analysis in Non-Hospital Settings for Neurological Disorders

The gold standards for gait analysis are instrumented walkways and marker-based motion capture systems, which require costly infrastructure and are only available in hospitals and specialized gait clinics. Even though the completeness and the accuracy of these systems are unquestionable, a mobile and pervasive gait analysis alternative suitable for non-hospital settings is a clinical necessity. Using inertial sensors for gait analysis has been well explored in the literature with promising results. However, the majority of the existing work does not consider realistic conditions where data collection and sensor placement imperfections are imminent. Moreover, some of the underlying assumptions of the existing work are not compatible with pathological gait, decreasing the accuracy. To overcome these challenges, we propose a foot-mounted inertial sensor-based gait analysis system that extends the well-established zero-velocity update and Kalman filtering methodology. Our system copes with various cases of data collection difficulties and relaxes some of the assumptions invalid for pathological gait (e.g., the assumption of observing a heel strike during a gait cycle). The system is able to extract a rich set of standard gait metrics, including stride length, cadence, cycle time, stance time, swing time, stance ratio, speed, maximum/minimum clearance and turning rate. We validated the spatio-temporal accuracy of the proposed system by comparing the stride length and swing time output with an IR depth-camera-based reference system on a dataset comprised of 22 subjects. Furthermore, to highlight the clinical applicability of the system, we present a clinical discussion of the extracted metrics on a disjoint dataset of 17 subjects with various neurological conditions.

Healthcare Applications of Smart Watches. A Systematic Review

OBJECTIVE

The aim of this systematic review is to synthesize research studies involving the use of smart watch devices for healthcare.

MATERIALS AND METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was chosen as the systematic review methodology. We searched PubMed, CINAHL Plus, EMBASE, ACM, and IEEE Xplore. In order to include ongoing clinical trials, we also searched ClinicalTrials.gov. Two investigators evaluated the retrieved articles for inclusion. Discrepancies between investigators regarding article inclusion and extracted data were resolved through team discussion.

RESULTS

356 articles were screened and 24 were selected for review. The most common publication venue was in conference proceedings (13, 54%). The majority of studies were published or presented in 2015 (19, 79%). We identified two registered clinical trials underway. A large proportion of the identified studies focused on applications involving health monitoring for the elderly (6, 25%). Five studies focused on patients with Parkinson's disease and one on cardiac arrest. There were no studies which reported use of usability testing before implementation.

DISCUSSION

Most of the reviewed studies focused on the chronically ill elderly. There was a lack of detailed description of user-centered design or usability testing before implementation. Based on our review, the most commonly used platform in healthcare research was that of the Android Wear. The clinical application of smart watches as assistive devices deserves further attention.

CONCLUSION

Smart watches are unobtrusive and easy to wear. While smart watch technology supplied with biosensors has potential to be useful in a variety of healthcare applications, rigorous research with their use in clinical settings is needed.

Microsoft Kinect Visual and Depth Sensors for Breathing and Heart Rate Analysis

This paper is devoted to a new method of using Microsoft (MS) Kinect sensors for non-contact monitoring of breathing and heart rate estimation to detect possible medical and neurological disorders. Video sequences of facial features and thorax movements are recorded by MS Kinect image, depth and infrared sensors to enable their time analysis in selected regions of interest. The proposed methodology includes the use of computational methods and functional transforms for data selection, as well as their denoising, spectral analysis and visualization, in order to determine specific biomedical features. The results that were obtained verify the correspondence between the evaluation of the breathing frequency that was obtained from the image and infrared data of the mouth area and from the thorax movement that was recorded by the depth sensor. Spectral analysis of the time evolution of the mouth area video frames was also used for heart rate estimation. Results estimated from the image and infrared data of the mouth area were compared with those obtained by contact measurements by Garmin sensors (www.garmin.com). The study proves that simple image and depth sensors can be used to efficiently record biomedical multidimensional data with sufficient accuracy to detect selected biomedical features using specific methods of computational intelligence. The achieved accuracy for non-contact detection of breathing rate was 0.26% and the accuracy of heart rate estimation was 1.47% for the infrared sensor. The following results show how video frames with depth data can be used to differentiate different kinds of breathing. The proposed method enables us to obtain and analyse data for diagnostic purposes in the home environment or during physical activities, enabling efficient human–machine interaction.