Deep learning for freezing of gait detection in Parkinson’s disease patients in their homes using a waist-worn inertial measurement unit

A deep explainable artificial intelligent framework for neurological disorders discrimination

Pathological hand tremor (PHT) is a common symptom of Parkinson's disease (PD) and essential tremor (ET), which affects manual targeting, motor coordination, and movement kinetics. Effective treatment and management of the symptoms relies on the correct and in-time diagnosis of the affected individuals, where the characteristics of PHT serve as an imperative metric for this purpose. Due to the overlapping features of the corresponding symptoms, however, a high level of expertise and specialized diagnostic methodologies are required to correctly distinguish PD from ET. In this work, we propose the data-driven [Formula: see text] model, which processes the kinematics of the hand in the affected individuals and classifies the patients into PD or ET. [Formula: see text] is trained over 90 hours of hand motion signals consisting of 250 tremor assessments from 81 patients, recorded at the London Movement Disorders Centre, ON, Canada. The [Formula: see text] outperforms its state-of-the-art counterparts achieving exceptional differential diagnosis accuracy of [Formula: see text]. In addition, using the explainability and interpretability measures for machine learning models, clinically viable and statistically significant insights on how the data-driven model discriminates between the two groups of patients are achieved.

Artificial intelligence in neurodegenerative diseases: A review of available tools with a focus on machine learning techniques

Neurodegenerative diseases have shown an increasing incidence in the older population in recent years. A significant amount of research has been conducted to characterize these diseases. Computational methods, and particularly machine learning techniques, are now very useful tools in helping and improving the diagnosis as well as the disease monitoring process. In this paper, we provide an in-depth review on existing computational approaches used in the whole neurodegenerative spectrum, namely for Alzheimer's, Parkinson's, and Huntington's Diseases, Amyotrophic Lateral Sclerosis, and Multiple System Atrophy. We propose a taxonomy of the specific clinical features, and of the existing computational methods. We provide a detailed analysis of the various modalities and decision systems employed for each disease. We identify and present the sleep disorders which are present in various diseases and which represent an important asset for onset detection. We overview the existing data set resources and evaluation metrics. Finally, we identify current remaining open challenges and discuss future perspectives.

Multi-Layer Picture of Neurodegenerative Diseases: Lessons from the Use of Big Data through Artificial Intelligence

In the big data era, artificial intelligence techniques have been applied to tackle traditional issues in the study of neurodegenerative diseases. Despite the progress made in understanding the complex (epi)genetics signatures underlying neurodegenerative disorders, performing early diagnosis and developing drug repurposing strategies remain serious challenges for such conditions. In this context, the integration of multi-omics, neuroimaging, and electronic health records data can be exploited using deep learning methods to provide the most accurate representation of patients possible. Deep learning allows researchers to find multi-modal biomarkers to develop more effective and personalized treatments, early diagnosis tools, as well as useful information for drug discovering and repurposing in neurodegenerative pathologies. In this review, we will describe how relevant studies have been able to demonstrate the potential of deep learning to enhance the knowledge of neurodegenerative disorders such as Alzheimer's and Parkinson's diseases through the integration of all sources of biomedical data.

Visualising the knowledge structure and evolution of wearable device research

In recent years, the literature associated with wearable devices has grown rapidly, but few studies have used bibliometrics and a visualisation approach to conduct deep mining and reveal a panorama of the wearable devices field. To explore the foundational knowledge and research hotspots of the wearable devices field, this study conducted a series of bibliometric analyses on the related literature, including papers' production trends in the field and the distribution of countries, a keyword co-occurrence analysis, theme evolution analysis and research hotspots and trends for the future. By conducting a literature content analysis and structure analysis, we found the following: (a) The subject evolution path includes sensor research, sensitivity research and multi-functional device research. (b) Wearable device research focuses on information collection, sensor materials, manufacturing technology and application, artificial intelligence technology application, energy supply and medical applications. The future development trend will be further studied in combination with big data analysis, telemedicine and personalised precision medical application.

Deep learning in systems medicine

Systems medicine (SM) has emerged as a powerful tool for studying the human body at the systems level with the aim of improving our understanding, prevention and treatment of complex diseases. Being able to automatically extract relevant features needed for a given task from high-dimensional, heterogeneous data, deep learning (DL) holds great promise in this endeavour. This review paper addresses the main developments of DL algorithms and a set of general topics where DL is decisive, namely, within the SM landscape. It discusses how DL can be applied to SM with an emphasis on the applications to predictive, preventive and precision medicine. Several key challenges have been highlighted including delivering clinical impact and improving interpretability. We used some prototypical examples to highlight the relevance and significance of the adoption of DL in SM, one of them is involving the creation of a model for personalized Parkinson's disease. The review offers valuable insights and informs the research in DL and SM.

Crowdsourcing digital health measures to predict Parkinson's disease severity: the Parkinson's Disease Digital Biomarker DREAM Challenge

Consumer wearables and sensors are a rich source of data about patients' daily disease and symptom burden, particularly in the case of movement disorders like Parkinson's disease (PD). However, interpreting these complex data into so-called digital biomarkers requires complicated analytical approaches, and validating these biomarkers requires sufficient data and unbiased evaluation methods. Here we describe the use of crowdsourcing to specifically evaluate and benchmark features derived from accelerometer and gyroscope data in two different datasets to predict the presence of PD and severity of three PD symptoms: tremor, dyskinesia, and bradykinesia. Forty teams from around the world submitted features, and achieved drastically improved predictive performance for PD status (best AUROC = 0.87), as well as tremor- (best AUPR = 0.75), dyskinesia- (best AUPR = 0.48) and bradykinesia-severity (best AUPR = 0.95).

Deep learning for brain disorders: from data processing to disease treatment

In order to reach precision medicine and improve patients' quality of life, machine learning is increasingly used in medicine. Brain disorders are often complex and heterogeneous, and several modalities such as demographic, clinical, imaging, genetics and environmental data have been studied to improve their understanding. Deep learning, a subpart of machine learning, provides complex algorithms that can learn from such various data. It has become state of the art in numerous fields, including computer vision and natural language processing, and is also growingly applied in medicine. In this article, we review the use of deep learning for brain disorders. More specifically, we identify the main applications, the concerned disorders and the types of architectures and data used. Finally, we provide guidelines to bridge the gap between research studies and clinical routine.

Prediction of Freezing of Gait in Parkinson's Disease from Foot Plantar-Pressure Arrays using a Convolutional Neural Network

Freezing of gait (FOG) is a sudden cessation of locomotion in advanced Parkinson's disease (PD). A FOG episode can lead to falls, decreased mobility, and decreased overall quality of life. Prediction of FOG episodes provides an opportunity for intervention and freeze prevention. A novel method of FOG prediction that uses foot plantar pressure data acquired during gait was developed and evaluated, with plantar pressure data treated as 2D images and classified using a convolutional neural network (CNN). Data from five people with PD and a history of FOG were collected during walking trials. FOG instances were identified and data preceding each freeze were labeled as Pre-FOG. Left and right foot FScan pressure frames were concatenated into a single 60x42 pressure array. Each frame was considered as an independent image and classified as Pre-FOG, FOG, or Non-FOG, using the CNN. From prediction models using different Pre-FOG durations, shorter Pre-FOG durations performed best, with Pre-FOG class sensitivity 94.3%, and specificity 95.1%. These results demonstrated that foot pressure distribution alone can be a good FOG predictor when treating each plantar pressure frame as a 2D image, and classifying the images using a CNN. Furthermore, the CNN eliminated the need for feature extraction and selection.Clinical Relevance- This research demonstrated that foot plantar pressure data can be used to predict freezing of gait occurrence, using a convolutional neural network deep learning technique. This had the added advantage of eliminating the need for feature extraction and selection.

Convolutional Neural Network for Freezing of Gait Detection Leveraging the Continuous Wavelet Transform on Lower Extremities Wearable Sensors Data

Freezing of Gait is the most disabling gait disturbance in Parkinson's disease. For the past decade, there has been a growing interest in applying machine learning and deep learning models to wearable sensor data to detect Freezing of Gait episodes. In our study, we recruited sixty-seven Parkinson's disease patients who have been suffering from Freezing of Gait, and conducted two clinical assessments while the patients wore two wireless Inertial Measurement Units on their ankles. We converted the recorded time-series sensor data into continuous wavelet transform scalograms and trained a Convolutional Neural Network to detect the freezing episodes. The proposed model achieved a generalisation accuracy of 89.2% and a geometric mean of 88.8%.

World competitive contest-based artificial neural network: A new class-specific method for classification of clinical and biological datasets

Many data mining methods have been proposed to generate computer-aided diagnostic systems, which may determine diseases in their early stages by categorizing the data into some proper classes. Considering the importance of the existence of a suitable classifier, the present study aims to introduce an efficient approach based on the World Competitive Contests (WCC) algorithm as well as a multi-layer perceptron artificial neural network (ANN). Unlike the previously introduced methods, which each has developed a universal model for all different kinds of data classes, our proposed approach generates a single specific model for each individual class of data. The experimental results show that the proposed method (ANNWCC), which can be applied to both the balanced and unbalanced datasets, yields more than 76% (without applying feature selection methods) and 90% (with applying feature selection methods) of the average five-fold cross-validation accuracy on the 13 clinical and biological datasets. The findings also indicate that under different conditions, our proposed method can produce better results in comparison to some state-of-art meta-heuristic algorithms and methods in terms of various statistical and classification measurements. To classify the clinical and biological data, a multi-layer ANN and the WCC algorithm were combined. It was shown that developing a specific model for each individual class of data may yield better results compared with creating a universal model for all of the existing data classes. Besides, some efficient algorithms proved to be essential to generate acceptable biological results, and the methods' performance was found to be enhanced by fuzzifying or normalizing the biological data.

•

We combined multi-layer artificial neural networks and world competitive contests algorithms to classify biological datasets

•

The proposed method has been investigated on 13 clinical datasets with different properties

•

Efficient models may yield better classification models and health diagnostic systems

•

Feature selection methods can improve the performance of a model in separating case and control samples

Deep Learning Approaches for Detecting Freezing of Gait in Parkinson's Disease Patients through On-Body Acceleration Sensors

Freezing of gait (FOG) is one of the most incapacitating motor symptoms in Parkinson's disease (PD). The occurrence of FOG reduces the patients' quality of live and leads to falls. FOG assessment has usually been made through questionnaires, however, this method can be subjective and could not provide an accurate representation of the severity of this symptom. The use of sensor-based systems can provide accurate and objective information to track the symptoms' evolution to optimize PD management and treatments. Several authors have proposed specific methods based on wearables and the analysis of inertial signals to detect FOG in laboratory conditions, however, its performance is usually lower when being used at patients' homes. This study presents a new approach based on a recurrent neural network (RNN) and a single waist-worn triaxial accelerometer to enhance the FOG detection performance to be used in real home-environments. Also, several machine and deep learning approaches for FOG detection are evaluated using a leave-one-subject-out (LOSO) cross-validation. Results show that modeling spectral information of adjacent windows through an RNN can bring a significant improvement in the performance of FOG detection without increasing the length of the analysis window (required to using it as a cue-system).

Towards a Smart Smoking Cessation App: A 1D-CNN Model Predicting Smoking Events

Nicotine consumption is considered a major health problem, where many of those who wish to quit smoking relapse. The problem is that overtime smoking as behaviour is changing into a habit, in which it is connected to internal (e.g., nicotine level, craving) and external (action, time, location) triggers. Smoking cessation apps have proved their efficiency to support smoking who wish to quit smoking. However, still, these applications suffer from several drawbacks, where they are highly relying on the user to initiate the intervention by submitting the factor the causes the urge to smoke. This research describes the creation of a combined Control Theory and deep learning model that can learn the smoker’s daily routine and predict smoking events. The model’s structure combines a Control Theory model of smoking with a 1D-CNN classifier to adapt to individual differences between smokers and predict smoking events based on motion and geolocation values collected using a mobile device. Data were collected from 5 participants in the UK, and analysed and tested on 3 different machine learning model (SVM, Decision tree, and 1D-CNN), 1D-CNN has proved it’s efficiency over the three methods with average overall accuracy 86.6%. The average MSE of forecasting the nicotine level was (0.04) in the weekdays, and (0.03) in the weekends. The model has proved its ability to predict the smoking event accurately when the participant is well engaged with the app.

Prediction of Freezing of Gait in Patients With Parkinson's Disease by Identifying Impaired Gait Patterns

Freezing of gait (FoG) prediction, combined with rhythmic laser cues, may help Parkinson's disease (PD) patients overcome FoG episodes. This study aimed to utilize the impaired gait patterns preceding FoG to build a machine-learning-based model for FoG prediction. Acceleration signals were collected using an accelerometer attached to the lower back of 12 PD patients with FoG while they were performing designed FoG-provoking walking tasks. Step-based impaired gait features and conventional FoG detection features were extracted from the signals, based on which two FoG prediction models were built using AdaBoost to validate if the use of the impaired gait features can better predict FoG. For the correct labeling of the gait prior to FoG (pre-FoG), the personalized pre-FoG phase was defined according to the slope of the impaired gait pattern. The impaired gait features were relabeled based on the pre-FoG phase upon which the personalized labeled FoG prediction model was built. This was compared with the model built using unified labeling. Results showed that impaired gait features could better predict FoG than conventional FoG detection features with low time latency, and personalized labeling could further improve the FoG prediction accuracy. Using impaired gait features and personalized labeling, we built a FoG prediction model with 0.93 sec of latency. Compared to using conventional features and unified labeling, our model achieved 5.7% higher accuracy (82.7%) in patient-dependent test and 9.8% higher accuracy (77.9%) in patient-independent test. Therefore, using the impaired gait patterns is a promising approach to accurately predict FoG with low latency.

WiFreeze: Multiresolution Scalograms for Freezing of Gait Detection in Parkinson’s Leveraging 5G Spectrum with Deep Learning

Freezing of Gait (FOG) is an episodic absence of forward movement in Parkinson’s Disease (PD) patients and represents an onset of disabilities. FOG hinders daily activities and increases fall risk. There is high demand for automating the process of FOG detection due to its impact on health and well being of individuals. This work presents WiFreeze, a noninvasive, line of sight, and lighting agnostic WiFi-based sensing system, which exploits ambient 5G spectrum for detection and classification of FOG. The core idea is to utilize the amplitude variations of wireless Channel State Information (CSI) to differentiate between FOG and activities of daily life. A total of 225 events with 45 FOG cases are captured from 15 patients with the help of 30 subcarriers and classification is performed with a deep neural network. Multiresolution scalograms are proposed for time–frequency signatures of human activities, due to their ability to capture and detect transients in CSI signals caused by transitions in human movements. A very deep Convolutional Neural Network (CNN), VGG-8K, with 8K neurons each, in fully connected layers is engineered and proposed for transfer learning with multiresolution scalogram features for detection of FOG. The proposed WiFreeze system outperforms all existing wearable and vision-based systems as well as deep CNN architectures with the highest accuracy of 99.7% for FOG detection. Furthermore, the proposed system provides the highest classification accuracies of 94.3% for voluntary stop and 97.6% for walking slow activities, with improvements of 9% and 23%, respectively, over the best performing state-of-the-art deep CNN architecture.

Wearable-Sensor-based Detection and Prediction of Freezing of Gait in Parkinson's Disease: A Review

Freezing of gait (FOG) is a serious gait disturbance, common in mid- and late-stage Parkinson's disease, that affects mobility and increases fall risk. Wearable sensors have been used to detect and predict FOG with the ultimate aim of preventing freezes or reducing their effect using gait monitoring and assistive devices. This review presents and assesses the state of the art of FOG detection and prediction using wearable sensors, with the intention of providing guidance on current knowledge, and identifying knowledge gaps that need to be filled and challenges to be considered in future studies. This review searched the Scopus, PubMed, and Web of Science databases to identify studies that used wearable sensors to detect or predict FOG episodes in Parkinson's disease. Following screening, 74 publications were included, comprising 68 publications detecting FOG, seven predicting FOG, and one in both categories. Details were extracted regarding participants, walking task, sensor type and body location, detection or prediction approach, feature extraction and selection, classification method, and detection and prediction performance. The results showed that increasingly complex machine-learning algorithms combined with diverse feature sets improved FOG detection. The lack of large FOG datasets and highly person-specific FOG manifestation were common challenges. Transfer learning and semi-supervised learning were promising for FOG detection and prediction since they provided person-specific tuning while preserving model generalization.

Toward a Wearable System for Predicting Freezing of Gait in People Affected by Parkinson's Disease

Some wearable solutions exploiting on-body acceleration sensors have been proposed to recognize Freezing of Gait (FoG) in people affected by Parkinson Disease (PD). Once a FoG event is detected, these systems generate a sequence of rhythmic stimuli to allow the patient restarting the gait. While these solutions are effective in detecting FoG events, they are unable to predict FoG to prevent its occurrence. This paper fills in the gap by presenting a machine learning-based approach that classifies accelerometer data from PD patients, recognizing a pre-FOG phase to further anticipate FoG occurrence in advance. Gait was monitored by three tri-axial accelerometer sensors worn on the back, hip and ankle. Gait features were then extracted from the accelerometer's raw data through data windowing and non-linear dimensionality reduction. A k-nearest neighbor algorithm (k-NN) was used to classify gait in three classes of events: pre-FoG, no-FoG and FoG. The accuracy of the proposed solution was compared to state-of-the-art approaches. Our study showed that: (i) we achieved performances overcoming the state-of-the-art approaches in terms of FoG detection, (ii) we were able, for the very first time in the literature, to predict FoG by identifying the pre-FoG events with an average sensitivity and specificity of, respectively, 94.1% and 97.1%, and (iii) our algorithm can be executed on resource-constrained devices. Future applications include the implementation on a mobile device, and the administration of rhythmic stimuli by a wearable device to help the patient overcome the FoG.

A Dual-Modal Attention-Enhanced Deep Learning Network for Quantification of Parkinson's Disease Characteristics

It is well known that most patients with Parkinson's disease (PD) have different degree of movement disorders, such as shuffling, festination and akinetic episodes, which could degenerate the life quality of PD patients. Therefore, it is very useful to develop a computerized tool to provide an objective evaluation of PD patients' gait. In this study, we implemented a novel gait evaluating approach to provide not only a binary classification of PD gaits and normal walking, but also a quantification of the PD gaits to relate them to the PD severity level. The proposed system is a dual-modal deep-learning-based model, where left and right gait is modeled separately by a convolutional neural network (CNN) followed by an attention-enhanced long short-term memory (LSTM) network. The left and right samples for model training and testing were segmented sequentially from multiple 1D vertical ground reaction force (VGRF) signals according to the detected gait cycle. Experimental results indicate that our model can provide state-of-the-art performance in terms of classification accuracy. It is expected that the proposed model can be a useful gait assistance to provide a quantitative evaluation of PD gaits with high confidence and accuracy if trained suitably.

Towards Real-Time Prediction of Freezing of Gait in Patients With Parkinson's Disease: Addressing the Class Imbalance Problem

Freezing of gait (FoG) is a common motor symptom in patients with Parkinson's disease (PD). FoG impairs gait initiation and walking and increases fall risk. Intelligent external cueing systems implementing FoG detection algorithms have been developed to help patients recover gait after freezing. However, predicting FoG before its occurrence enables preemptive cueing and may prevent FoG. Such prediction remains challenging given the relative infrequency of freezing compared to non-freezing events. In this study, we investigated the ability of individual and ensemble classifiers to predict FoG. We also studied the effect of the ADAptive SYNthetic (ADASYN) sampling algorithm and classification cost on classifier performance. Eighteen PD patients performed a series of daily walking tasks wearing accelerometers on their ankles, with nine experiencing FoG. The ensemble classifier formed by Support Vector Machines, K-Nearest Neighbors, and Multi-Layer Perceptron using bagging techniques demonstrated highest performance (F1 = 90.7) when synthetic FoG samples were added to the training set and class cost was set as twice that of normal gait. The model identified 97.4% of the events, with 66.7% being predicted. This study demonstrates our algorithm's potential for accurate prediction of gait events and the provision of preventive cueing in spite of limited event frequency.

The Detection of Freezing of Gait in Parkinson's Disease Using Asymmetric Basis Function TV-ARMA Time-Frequency Spectral Estimation Method

Freezing of gait (FOG) is an episodic gait disturbance affecting locomotion in Parkinson's disease. As a biomarker to detect FOG, the Freeze index (FI), which is defined as the ratio of the areas under power spectra in 'freeze' band and in 'locomotion' band, can negatively be affected by poor time and frequency resolution of time-frequency spectrum estimate when short-time Fourier transform (STFT) or Wavelet transform (WT) is used. In this study, a novel high-resolution parametric time-frequency spectral estimation method is proposed to improve the accuracy of FI. A time-varying autoregressive moving average model (TV-ARMA) is first identified where the time-varying parameters are estimated using an asymmetric basis function expansion method. The TV-ARMA model is then transformed into frequency domain to estimate the time-frequency spectrum and calculate the FI. Results evaluated on the Daphnet Freezing of Gait Dataset show that the new method improves the time and frequency resolutions of the time-frequency spectrum and the associate FI has better performance in the detection of FOG than its counterparts based on STFT and WT methods do. Moreover, FOGs can be predicted in advance of its occurrence in most cases using the new method.

Treatment options for postural instability and gait difficulties in Parkinson's disease

Introduction: Gait and balance disorders in Parkinson's disease (PD) represent a major therapeutic challenge as frequent falls and freezing of gait impair quality of life and predict mortality. Limited dopaminergic therapy responses implicate non-dopaminergic mechanisms calling for alternative therapies.Areas covered: The authors provide a review that encompasses pathophysiological changes involved in axial motor impairments in PD, pharmacological approaches, exercise, and physical therapy, improving physical activity levels, invasive and non-invasive neurostimulation, cueing interventions and wearable technology, and cognitive interventions.Expert opinion: There are many promising therapies available that, to a variable degree, affect gait and balance disorders in PD. However, not one therapy is the 'silver bullet' that provides full relief and ultimately meaningfully improves the patient's quality of life. Sedentariness, apathy, and emergence of frailty in advancing PD, especially in the setting of medical comorbidities, are perhaps the biggest threats to experience sustained benefits with any of the available therapeutic options and therefore need to be aggressively treated as early as possible. Multimodal or combination therapies may provide complementary benefits to manage axial motor features in PD, but selection of treatment modalities should be tailored to the individual patient's needs.

A novel single-sensor-based method for the detection of gait-cycle breakdown and freezing of gait in Parkinson's disease

Objective measurement of walking speed and gait deficits are an important clinical tool in chronic illness management. We previously reported in Parkinson's disease that different types of gait tests can now be implemented and administered in the clinic or at home using Ambulosono smartphone-sensor technology, whereby movement sensing protocols can be standardized under voice instruction. However, a common challenge that remains for such wearable sensor systems is how meaningful data can be extracted from seemingly "noisy" raw sensor data, and do so with a high level of accuracy and efficiency. Here, we describe a novel pattern recognition algorithm for the automated detection of gait-cycle breakdown and freezing episodes. Ambulosono-gait-cycle-breakdown-and-freezing-detection (Free-D) integrates a nonlinear m-dimensional phase-space data extraction method with machine learning and Monte Carlo analysis for model building and pattern generalization. We first trained Free-D using a small number of data samples obtained from thirty participants during freezing of gait tests. We then tested the accuracy of Free-D via Monte Carlo cross-validation. We found Free-D to be remarkably effective at detecting gait-cycle breakdown, with mode error rates of 0% and mean error rates < 5%. We also demonstrate the utility of Free-D by applying it to continuous holdout traces not used for either training or testing, and found it was able to identify gait-cycle breakdown and freezing events of varying duration. These results suggest that advanced artificial intelligence and automation tools can be developed to enhance the quality, efficiency, and the expansion of wearable sensor data processing capabilities to meet market and industry demand.

A Wearable, Patient-Adaptive Freezing of Gait Detection System for Biofeedback Cueing in Parkinson's Disease

Freezing of Gait (FoG) is a common motor-related impairment among Parkinson's disease patients, which substantially reduces their quality of life and puts them at risk of falls. These patients benefit from wearable FoG detection systems that provide timely biofeedback cues and hence help them regain control over their gait. Unfortunately, the systems proposed thus far are bulky and obtrusive when worn. The objective of this paper is to demonstrate the first integration of an FoG detection system into a single sensor node. To achieve such an integration, features with low computational load are selected and dedicated hardware is designed that limits area and memory utilization. Classification is achieved with a neural network that is capable of learning in real time and thus allows the system to adapt to a patient during run-time. A small form factor FPGA implements the feature extraction and classification, whereas a custom PCB integrates the system into a single node. The system fits into a 4.5 × 3.5 × 1.5 cm ³ housing case, weighs 32 g, and achieves 95.6% sensitivity and 90.2% specificity when adapted to a patient. Biofeedback cues are provided either through auditory or somatosensory means and the system can remain operational for longer than 9 h while providing cues. The proposed system is highly competitive in terms of classification performance and excels with respect to wearability and real-time patient adaptivity.

Kin-FOG: Automatic Simulated Freezing of Gait (FOG) Assessment System for Parkinson's Disease

Parkinson’s disease (PD) is one of the leading neurological disorders in the world with an increasing incidence rate for the elderly. Freezing of Gait (FOG) is one of the most incapacitating symptoms for PD especially in the later stages of the disease. FOG is a short absence or reduction of ability to walk for PD patients which can cause fall, reduction in patients’ quality of life, and even death. Existing FOG assessments by doctors are based on a patient’s diaries and experts’ manual video analysis which give subjective, inaccurate, and unreliable results. In the present research, an automatic FOG assessment system is designed for PD patients to provide objective information to neurologists about the FOG condition and the symptom’s characteristics. The proposed FOG assessment system uses an RGB-D sensor based on Microsoft Kinect V2 for capturing data for 5 healthy subjects who are trained to imitate the FOG phenomenon. The proposed FOG assessment system is called “Kin-FOG”. The analysis of foot joint trajectory of the motion captured by Kinect is used to find the FOG episodes. The evaluation of Kin-FOG is performed by two types of experiments, including: (1) simple walking (SW); and (2) walking with turning (WWT). Since the standing mode has features similar to a FOG episode, our Kin-FOG system proposes a method to distinguish between the FOG and standing episodes. Therefore, two general groups of experiments are conducted with standing state (WST) and without standing state (WOST). The gradient displacement of the angle between the foot and the ground is used as the feature for discriminating between FOG and standing modes. These experiments are conducted with different numbers of FOGs for getting reliable and general results. The Kin-FOG system reports the number of FOGs, their lengths, and the time slots when they occur. Experimental results demonstrate Kin-FOG has around 90% accuracy rate for FOG prediction in both experiments for different tasks (SW, WWT). The proposed Kin-FOG system can be used as a remote application at a patient’s home or a rehabilitation clinic for sending a neurologist the required FOG information. The reliability and generality of the proposed system will be evaluated for bigger data sets of actual PD subjects.

Gait impairments in Parkinson's disease

Gait impairments are among the most common and disabling symptoms of Parkinson's disease. Nonetheless, gait is not routinely assessed quantitatively but is described in general terms that are not sensitive to changes ensuing with disease progression. Quantifying multiple gait features (eg, speed, variability, and asymmetry) under natural and more challenging conditions (eg, dual-tasking, turning, and daily living) enhanced sensitivity of gait quantification. Studies of neural connectivity and structural network topology have provided information on the mechanisms of gait impairment. Advances in the understanding of the multifactorial origins of gait changes in patients with Parkinson's disease promoted the development of new intervention strategies, such as neurostimulation and virtual reality, aimed at alleviating gait impairments and enhancing functional mobility. For clinical applicability, it is important to establish clear links between specific gait impairments, their underlying mechanisms, and disease progression to foster the acceptance and usability of quantitative gait measures as outcomes in future disease-modifying clinical trials.

A Non-Invasive Medical Device for Parkinson's Patients with Episodes of Freezing of Gait

A critical symptom of Parkinson’s disease (PD) is the occurrence of Freezing of Gait (FOG), an episodic disorder that causes frequent falls and consequential injuries in PD patients. There are various auditory, visual, tactile, and other types of stimulation interventions that can be used to induce PD patients to escape FOG episodes. In this article, we describe a low cost wearable system for non-invasive gait monitoring and external delivery of superficial vibratory stimulation to the lower extremities triggered by FOG episodes. The intended purpose is to reduce the duration of the FOG episode, thus allowing prompt resumption of gait to prevent major injuries. The system, based on an Android mobile application, uses a tri-axial accelerometer device for gait data acquisition. Gathered data is processed via a discrete wavelet transform-based algorithm that precisely detects FOG episodes in real time. Detection activates external vibratory stimulation of the legs to reduce FOG time. The integration of detection and stimulation in one low cost device is the chief novel contribution of this work. We present analyses of sensitivity, specificity and effectiveness of the proposed system to validate its usefulness.

Wearable sensors for Parkinson's disease: which data are worth collecting for training symptom detection models

Machine learning algorithms that use data streams captured from soft wearable sensors have the potential to automatically detect PD symptoms and inform clinicians about the progression of disease. However, these algorithms must be trained with annotated data from clinical experts who can recognize symptoms, and collecting such data are costly. Understanding how many sensors and how much labeled data are required is key to successfully deploying these models outside of the clinic. Here we recorded movement data using 6 flexible wearable sensors in 20 individuals with PD over the course of multiple clinical assessments conducted on 1 day and repeated 2 weeks later. Participants performed 13 common tasks, such as walking or typing, and a clinician rated the severity of symptoms (bradykinesia and tremor). We then trained convolutional neural networks and statistical ensembles to detect whether a segment of movement showed signs of bradykinesia or tremor based on data from tasks performed by other individuals. Our results show that a single wearable sensor on the back of the hand is sufficient for detecting bradykinesia and tremor in the upper extremities, whereas using sensors on both sides does not improve performance. Increasing the amount of training data by adding other individuals can lead to improved performance, but repeating assessments with the same individuals—even at different medication states—does not substantially improve detection across days. Our results suggest that PD symptoms can be detected during a variety of activities and are best modeled by a dataset incorporating many individuals.

Novelty Detection using Deep Normative Modeling for IMU-Based Abnormal Movement Monitoring in Parkinson's Disease and Autism Spectrum Disorders

Detecting and monitoring of abnormal movement behaviors in patients with Parkinson's Disease (PD) and individuals with Autism Spectrum Disorders (ASD) are beneficial for adjusting care and medical treatment in order to improve the patient's quality of life. Supervised methods commonly used in the literature need annotation of data, which is a time-consuming and costly process. In this paper, we propose deep normative modeling as a probabilistic novelty detection method, in which we model the distribution of normal human movements recorded by wearable sensors and try to detect abnormal movements in patients with PD and ASD in a novelty detection framework. In the proposed deep normative model, a movement disorder behavior is treated as an extreme of the normal range or, equivalently, as a deviation from the normal movements. Our experiments on three benchmark datasets indicate the effectiveness of the proposed method, which outperforms one-class SVM and the reconstruction-based novelty detection approaches. Our contribution opens the door toward modeling normal human movements during daily activities using wearable sensors and eventually real-time abnormal movement detection in neuro-developmental and neuro-degenerative disorders.

Classification of Alzheimer's Disease Based on Eight-Layer Convolutional Neural Network with Leaky Rectified Linear Unit and Max Pooling

Alzheimer's disease (AD) is a progressive brain disease. The goal of this study is to provide a new computer-vision based technique to detect it in an efficient way. The brain-imaging data of 98 AD patients and 98 healthy controls was collected using data augmentation method. Then, convolutional neural network (CNN) was used, CNN is the most successful tool in deep learning. An 8-layer CNN was created with optimal structure obtained by experiences. Three activation functions (AFs): sigmoid, rectified linear unit (ReLU), and leaky ReLU. The three pooling-functions were also tested: average pooling, max pooling, and stochastic pooling. The numerical experiments demonstrated that leaky ReLU and max pooling gave the greatest result in terms of performance. It achieved a sensitivity of 97.96%, a specificity of 97.35%, and an accuracy of 97.65%, respectively. In addition, the proposed approach was compared with eight state-of-the-art approaches. The method increased the classification accuracy by approximately 5% compared to state-of-the-art methods.