Detecting Motor Impairment in Early Parkinson's Disease via Natural Typing Interaction With Keyboards: Validation of the neuroQWERTY Approach in an Uncontrolled At-Home Setting

A novel digital tool for detection and monitoring of amyotrophic lateral sclerosis motor impairment and progression via keystroke dynamics

Amyotrophic lateral sclerosis (ALS) is a debilitating neurodegenerative condition leading to progressive muscle weakness, atrophy, and ultimately death. Traditional ALS clinical evaluations often depend on subjective metrics, making accurate disease detection and monitoring disease trajectory challenging. To address these limitations, we developed the nQiALS toolkit, a machine learning-powered system that leverages smartphone typing dynamics to detect and track motor impairment in people with ALS. The study included 63 ALS patients and 30 age- and sex-matched healthy controls. We introduce the three core components of this toolkit: the nQiALS-Detection, which differentiated ALS from healthy typing patterns with an AUC of 0.89; the nQiALS-Progression, which separated slow and fast progression at specific thresholds with AUCs ranging between 0.65 and 0.8; and the nQiALS-Fine Motor, which identified subtle progression in fine motor dysfunction, suggesting earlier prediction than the state-of-the-art assessment. Together, these tools represent an innovative approach to ALS assessment, offering a complementary, objective metric to traditional clinical methods and which may reshape our understanding and monitoring of ALS progression.

Generalizing Parkinson's disease detection using keystroke dynamics: a self-supervised approach

OBJECTIVE

Passive monitoring of touchscreen interactions generates keystroke dynamic signals that can be used to detect and track neurological conditions such as Parkinson's disease (PD) and psychomotor impairment with minimal burden on the user. However, this typically requires datasets with clinically confirmed labels collected in standardized environments, which is challenging, especially for a large subject pool. This study validates the efficacy of a self-supervised learning method in reducing the reliance on labels and evaluates its generalizability.

MATERIALS AND METHODS

We propose a new type of self-supervised loss combining Barlow Twins loss, which attempts to create similar feature representations with reduced feature redundancy for samples coming from the same subject, and a Dissimilarity loss, which promotes uncorrelated features for samples generated by different subjects. An encoder is first pre-trained using this loss on unlabeled data from an uncontrolled setting, then fine-tuned with clinically validated data. Our experiments test the model generalizability with controls and subjects with PD on 2 independent datasets.

RESULTS

Our approach showed better generalization compared to previous methods, including a feature engineering strategy, a deep learning model pre-trained on Parkinsonian signs, and a traditional supervised model.

DISCUSSION

The absence of standardized data acquisition protocols and the limited availability of annotated datasets compromise the generalizability of supervised models. In these contexts, self-supervised models offer the advantage of learning more robust patterns from the data, bypassing the need for ground truth labels.

CONCLUSION

This approach has the potential to accelerate the clinical validation of touchscreen typing software for neurodegenerative diseases.

Exploring Asymmetric Fine Motor Impairment Trends in Early Parkinson's Disease via Keystroke Typing

Background

The nQiMechPD algorithm transforms natural typing data into a numerical index that characterizes motor impairment in people with Parkinson's Disease (PwPD).

Objectives

Use nQiMechPD to compare asymmetrical progression of PD-related impairment in dominant (D-PD) versus non-dominant side onset (ND-PD) de-novo patients.

Methods

Keystroke data were collected from 53 right-handed participants (15 D-PD, 13 ND-PD, 25 controls). We apply linear mixed effects modeling to evaluate participants' right, left, and both hands nQiMechPD relative change by group.

Results

The 6-month nQiMechPD trajectories of right (**P = 0.002) and both (*P = 0.043) hands showed a significant difference in nQiMechPD trends between D-PD and ND-PD participants. Left side trends were not significantly different between these two groups (P = 0.328).

Conclusions

Significant differences between D-PD and ND-PD groups were observed, likely driven by contrasting dominant hand trends. Our findings suggest disease onset side may influence motor impairment progression, medication response, and functional outcomes in PwPD.

Parkinson Disease Recognition Using a Gamified Website: Machine Learning Development and Usability Study

BACKGROUND

Parkinson disease (PD) affects millions globally, causing motor function impairments. Early detection is vital, and diverse data sources aid diagnosis. We focus on lower arm movements during keyboard and trackpad or touchscreen interactions, which serve as reliable indicators of PD. Previous works explore keyboard tapping and unstructured device monitoring; we attempt to further these works with structured tests taking into account 2D hand movement in addition to finger tapping. Our feasibility study uses keystroke and mouse movement data from a remotely conducted, structured, web-based test combined with self-reported PD status to create a predictive model for detecting the presence of PD.

OBJECTIVE

Analysis of finger tapping speed and accuracy through keyboard input and analysis of 2D hand movement through mouse input allowed differentiation between participants with and without PD. This comparative analysis enables us to establish clear distinctions between the two groups and explore the feasibility of using motor behavior to predict the presence of the disease.

METHODS

Participants were recruited via email by the Hawaii Parkinson Association (HPA) and directed to a web application for the tests. The 2023 HPA symposium was also used as a forum to recruit participants and spread information about our study. The application recorded participant demographics, including age, gender, and race, as well as PD status. We conducted a series of tests to assess finger tapping, using on-screen prompts to request key presses of constant and random keys. Response times, accuracy, and unintended movements resulting in accidental presses were recorded. Participants performed a hand movement test consisting of tracing straight and curved on-screen ribbons using a trackpad or mouse, allowing us to evaluate stability and precision of 2D hand movement. From this tracing, the test collected and stored insights concerning lower arm motor movement.

RESULTS

Our formative study included 31 participants, 18 without PD and 13 with PD, and analyzed their lower limb movement data collected from keyboards and computer mice. From the data set, we extracted 28 features and evaluated their significances using an extra tree classifier predictor. A random forest model was trained using the 6 most important features identified by the predictor. These selected features provided insights into precision and movement speed derived from keyboard tapping and mouse tracing tests. This final model achieved an average F1-score of 0.7311 (SD 0.1663) and an average accuracy of 0.7429 (SD 0.1400) over 20 runs for predicting the presence of PD.

CONCLUSIONS

This preliminary feasibility study suggests the possibility of using technology-based limb movement data to predict the presence of PD, demonstrating the practicality of implementing this approach in a cost-effective and accessible manner. In addition, this study demonstrates that structured mouse movement tests can be used in combination with finger tapping to detect PD.

Machine learning models for diagnosis and prognosis of Parkinson's disease using brain imaging: general overview, main challenges, and future directions

Parkinson's disease (PD) is a progressive and complex neurodegenerative disorder associated with age that affects motor and cognitive functions. As there is currently no cure, early diagnosis and accurate prognosis are essential to increase the effectiveness of treatment and control its symptoms. Medical imaging, specifically magnetic resonance imaging (MRI), has emerged as a valuable tool for developing support systems to assist in diagnosis and prognosis. The current literature aims to improve understanding of the disease's structural and functional manifestations in the brain. By applying artificial intelligence to neuroimaging, such as deep learning (DL) and other machine learning (ML) techniques, previously unknown relationships and patterns can be revealed in this high-dimensional data. However, several issues must be addressed before these solutions can be safely integrated into clinical practice. This review provides a comprehensive overview of recent ML techniques analyzed for the automatic diagnosis and prognosis of PD in brain MRI. The main challenges in applying ML to medical diagnosis and its implications for PD are also addressed, including current limitations for safe translation into hospitals. These challenges are analyzed at three levels: disease-specific, task-specific, and technology-specific. Finally, potential future directions for each challenge and future perspectives are discussed.

A scoping review of neurodegenerative manifestations in explainable digital phenotyping

Neurologists nowadays no longer view neurodegenerative diseases, like Parkinson's and Alzheimer's disease, as single entities, but rather as a spectrum of multifaceted symptoms with heterogeneous progression courses and treatment responses. The definition of the naturalistic behavioral repertoire of early neurodegenerative manifestations is still elusive, impeding early diagnosis and intervention. Central to this view is the role of artificial intelligence (AI) in reinforcing the depth of phenotypic information, thereby supporting the paradigm shift to precision medicine and personalized healthcare. This suggestion advocates the definition of disease subtypes in a new biomarker-supported nosology framework, yet without empirical consensus on standardization, reliability and interpretability. Although the well-defined neurodegenerative processes, linked to a triad of motor and non-motor preclinical symptoms, are detected by clinical intuition, we undertake an unbiased data-driven approach to identify different patterns of neuropathology distribution based on the naturalistic behavior data inherent to populations in-the-wild. We appraise the role of remote technologies in the definition of digital phenotyping specific to brain-, body- and social-level neurodegenerative subtle symptoms, emphasizing inter- and intra-patient variability powered by deep learning. As such, the present review endeavors to exploit digital technologies and AI to create disease-specific phenotypic explanations, facilitating the understanding of neurodegenerative diseases as "bio-psycho-social" conditions. Not only does this translational effort within explainable digital phenotyping foster the understanding of disease-induced traits, but it also enhances diagnostic and, eventually, treatment personalization.

Quick computer aided differential diagnostics based on repetitive finger tapping in Parkinson’s disease and atypical parkinsonisms

Background

Parkinson's disease (PD) is the second most common neurodegenerative disorder whose prevalence rises with age, yet clinical diagnosis is still a challenging task due to similar manifestations of other neurodegenerative movement disorders. In untreated patients or those with unclear responses to medication, correct percentages of early diagnoses go as low as 26%. Technology has been used in various forms to facilitate discerning between persons with PD and healthy individuals, but much less work has been dedicated to separating PD and atypical parkinsonisms.

Methods

A wearable system was developed based on inertial sensors that capture the movements of fingers during repetitive finger tapping. A k-nearest-neighbor classifier was used on features extracted from gyroscope recordings for quick aid in differential diagnostics, discerning patients with PD, progressive supranuclear palsy (PSP), multiple system atrophy (MSA) and healthy controls (HC).

Results

The overall classification accuracy achieved was 85.18% in the multiclass setup. MSA and HC groups were the easiest to discern (100%), while PSP was the most elusive diagnosis, as some patients were incorrectly assigned to MSA and HC groups.

Conclusions

The system shows potential for use as a tool for quick diagnostic aid, and in the era of big data, offers a means of standardization of data collection that could allow scientists to aggregate multi-center data for further research.

Keystroke-Dynamics for Parkinson's Disease Signs Detection in an At-Home Uncontrolled Population: A New Benchmark and Method

Parkinson's disease (PD) is the second most prevalent neurodegenerative disease disorder in the world. A prompt diagnosis would enable clinical trials for disease-modifying neuroprotective therapies. Recent research efforts have unveiled imaging and blood markers that have the potential to be used to identify PD patients promptly, however, the idiopathic nature of PD makes these tests very hard to scale to the general population. To this end, we need an easily deployable tool that would enable screening for PD signs in the general population. In this work, we propose a new set of features based on keystroke dynamics, i.e., the time required to press and release keyboard keys during typing, and used to detect PD in an ecologically valid data acquisition setup at the subject's homes, without requiring any pre-defined task. We compare and contrast existing models presented in the literature and present a new model that combines a new type of keystroke dynamics signal representation using hold time and flight time series as a function of key types and asymmetry in the time series using a convolutional neural network. We show how this model achieves an Area Under the Receiving Operating Characteristic curve ranging from 0.80 to 0.83 on a dataset of subjects who actively interacted with their computers for at least 5 months and positively compares against other state-of-the-art approaches previously tested on keystroke dynamics data acquired with mechanical keyboards.

Associations between smartphone keystroke dynamics and cognition in MS

Objective

Examine the associations between smartphone keystroke dynamics and cognitive functioning among persons with multiple sclerosis (MS).

Methods

Sixteen persons with MS with no self-reported upper extremity or typing difficulties and 10 healthy controls (HCs) completed six weeks of remote monitoring of their keystroke dynamics (i.e., how they typed on their smartphone keyboards). They also completed a comprehensive neuropsychological assessment and symptom ratings about fatigue, depression, and anxiety at baseline.

Results

A total of 1,335,787 keystrokes were collected, which were part of 30,968 typing sessions. The MS group typed slower (P < .001) and more variably (P = .032) than the HC group. Faster typing speed was associated with better performance on measures of processing speed (P = .016), attention (P = .022), and executive functioning (cognitive flexibility: P = .029; behavioral inhibition: P = .002; verbal fluency: P = .039), as well as less severe impact from fatigue (P < .001) and less severe anxiety symptoms (P = .007). Those with better cognitive functioning and less severe symptoms showed a stronger correlation between the use of backspace and autocorrection events (P < .001).

Conclusion

Typing speed may be sensitive to cognitive functions subserved by the frontal-subcortical brain circuits. Individuals with better cognitive functioning and less severe symptoms may be better at monitoring their typing errors. Keystroke dynamics have the potential to be used as an unobtrusive remote monitoring method for real-life cognitive functioning among persons with MS, which may improve the detection of relapses, evaluate treatment efficacy, and track disability progression.

Detection of Mental Fatigue in the General Population: Feasibility Study of Keystroke Dynamics as a Real-world Biomarker

BACKGROUND

Mental fatigue is a common and potentially debilitating state that can affect individuals' health and quality of life. In some cases, its manifestation can precede or mask early signs of other serious mental or physiological conditions. Detecting and assessing mental fatigue can be challenging nowadays as it relies on self-evaluation and rating questionnaires, which are highly influenced by subjective bias. Introducing more objective, quantitative, and sensitive methods to characterize mental fatigue could be critical to improve its management and the understanding of its connection to other clinical conditions.

OBJECTIVE

This paper aimed to study the feasibility of using keystroke biometrics for mental fatigue detection during natural typing. As typing involves multiple motor and cognitive processes that are affected by mental fatigue, our hypothesis was that the information captured in keystroke dynamics can offer an interesting mean to characterize users' mental fatigue in a real-world setting.

METHODS

We apply domain transformation techniques to adapt and transform TypeNet, a state-of-the-art deep neural network, originally intended for user authentication, to generate a network optimized for the fatigue detection task. All experiments were conducted using 3 keystroke databases that comprise different contexts and data collection protocols.

RESULTS

Our preliminary results showed area under the curve performances ranging between 72.2% and 80% for fatigue versus rested sample classification, which is aligned with previously published models on daily alertness and circadian cycles. This demonstrates the potential of our proposed system to characterize mental fatigue fluctuations via natural typing patterns. Finally, we studied the performance of an active detection approach that leverages the continuous nature of keystroke biometric patterns for the assessment of users' fatigue in real time.

CONCLUSIONS

Our results suggest that the psychomotor patterns that characterize mental fatigue manifest during natural typing, which can be quantified via automated analysis of users' daily interaction with their device. These findings represent a step towards the development of a more objective, accessible, and transparent solution to monitor mental fatigue in a real-world environment.

Digital Devices for Assessing Motor Functions in Mobility-Impaired and Healthy Populations: Systematic Literature Review

Background

With the advent of smart sensing technology, mobile and wearable devices can provide continuous and objective monitoring and assessment of motor function outcomes.

Objective

We aimed to describe the existing scientific literature on wearable and mobile technologies that are being used or tested for assessing motor functions in mobility-impaired and healthy adults and to evaluate the degree to which these devices provide clinically valid measures of motor function in these populations.

Methods

A systematic literature review was conducted by searching Embase, MEDLINE, CENTRAL (January 1, 2015, to June 24, 2020), the United States and European Union clinical trial registries, and the United States Food and Drug Administration website using predefined study selection criteria. Study selection, data extraction, and quality assessment were performed by 2 independent reviewers.

Results

A total of 91 publications representing 87 unique studies were included. The most represented clinical conditions were Parkinson disease (n=51 studies), followed by stroke (n=5), Huntington disease (n=5), and multiple sclerosis (n=2). A total of 42 motion-detecting devices were identified, and the majority (n=27, 64%) were created for the purpose of health care–related data collection, although approximately 25% were personal electronic devices (eg, smartphones and watches) and 11% were entertainment consoles (eg, Microsoft Kinect or Xbox and Nintendo Wii). The primary motion outcomes were related to gait (n=30), gross motor movements (n=25), and fine motor movements (n=23). As a group, sensor-derived motion data showed a mean sensitivity of 0.83 (SD 7.27), a mean specificity of 0.84 (SD 15.40), a mean accuracy of 0.90 (SD 5.87) in discriminating between diseased individuals and healthy controls, and a mean Pearson r validity coefficient of 0.52 (SD 0.22) relative to clinical measures. We did not find significant differences in the degree of validity between in-laboratory and at-home sensor-based assessments nor between device class (ie, health care–related device, personal electronic devices, and entertainment consoles).

Conclusions

Sensor-derived motion data can be leveraged to classify and quantify disease status for a variety of neurological conditions. However, most of the recent research on digital clinical measures is derived from proof-of-concept studies with considerable variation in methodological approaches, and much of the reviewed literature has focused on clinical validation, with less than one-quarter of the studies performing analytical validation. Overall, future research is crucially needed to further consolidate that sensor-derived motion data may lead to the development of robust and transformative digital measurements intended to predict, diagnose, and quantify neurological disease state and its longitudinal change.

Use of deep learning-based radiomics to differentiate Parkinson's disease patients from normal controls: a study based on [18F]FDG PET imaging

OBJECTIVES

We proposed a novel deep learning-based radiomics (DLR) model to diagnose Parkinson's disease (PD) based on [¹⁸F]fluorodeoxyglucose (FDG) PET images.

METHODS

In this two-center study, 255 normal controls (NCs) and 103 PD patients were enrolled from Huashan Hospital, China; 26 NCs and 22 PD patients were enrolled as a separate test group from Wuxi 904 Hospital, China. The proposed DLR model consisted of a convolutional neural network-based feature encoder and a support vector machine (SVM) model-based classifier. The DLR model was trained and validated in the Huashan cohort and tested in the Wuxi cohort, and accuracy, sensitivity, specificity and receiver operator characteristic (ROC) curve graphs were used to describe the model's performance. Comparative experiments were performed based on four other models including the scale model, radiomics model, standard uptake value ratio (SUVR) model and DLR model.

RESULTS

The DLR model demonstrated superiority in differentiating PD patients and NCs in comparison to other models, with an accuracy of 95.17% [90.35%, 98.13%] (95% confidence intervals, CI) in the Huashan cohort. Moreover, the DLR model also demonstrated greater performance in diagnosing PD early than routine methods, with an accuracy of 85.58% [78.60%, 91.57%] in the Huashan cohort.

CONCLUSIONS

We developed a DLR model based on [¹⁸F]FDG PET images that showed good performance in the noninvasive, individualized prediction of PD and was superior to traditional handcrafted methods. This model has the potential to guide and facilitate clinical diagnosis and contribute to the development of precision treatment.

KEY POINTS

The DLR method on [¹⁸F]FDG PET images helps clinicians to diagnose PD and PD subgroups from normal controls. A prospective two-center study showed that the DLR method provides greater diagnostic accuracy.

Self-management Interventions for People With Parkinson Disease: Scoping Review

BACKGROUND

Parkinson disease can impose substantial distress and costs on patients, their families and caregivers, and health care systems. To address these burdens for families and health care systems, there is a need to better support patient self-management. To achieve this, an overview of the current state of the literature on self-management is needed to identify what is being done, how well it is working, and what might be missing.

OBJECTIVE

The aim of this scoping review was to provide an overview of the current body of research on self-management interventions for people with Parkinson disease and identify any knowledge gaps.

METHODS

The PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) and Population, Intervention, Comparator, Outcome, and Study type frameworks were used to structure the methodology of the review. Due to time and resource constraints, 1 reviewer systematically searched 4 databases (PubMed, Ovid, Scopus, and Web of Science) for the evaluations of self-management interventions for Parkinson disease published in English. The references were screened using the EndNote X9 citation management software, titles and abstracts were manually reviewed, and studies were selected for inclusion based on the eligibility criteria. Data were extracted into a pre-established form and synthesized in a descriptive analysis.

RESULTS

There was variation among the studies on study design, sample size, intervention type, and outcomes measured. The randomized controlled trials had the strongest evidence of effectiveness: 5 out of 8 randomized controlled trials found a significant difference between groups favoring the intervention on their primary outcome, and the remaining 3 had significant effects on at least some of the secondary outcomes. The 2 interventions included in the review that targeted mental health outcomes both found significant changes over time, and the 3 algorithms evaluated performed well. The remaining studies examined patient perceptions, acceptability, and cost-effectiveness and found generally positive results.

CONCLUSIONS

This scoping review identified a wide variety of interventions designed to support various aspects of self-management for people with Parkinson disease. The studies all generally reported positive results, and although the strength of the evidence varied, it suggests that self-management interventions are promising for improving the care and outcomes of people with Parkinson disease. However, the research tended to focus on the motor aspects of Parkinson disease, with few nonmotor or holistic interventions, and there was a lack of evaluation of cost-effectiveness. This research will be important to providing self-management interventions that meet the varied and diverse needs of people with Parkinson disease and determining which interventions are worth promoting for widespread adoption.

A novel framework to estimate cognitive impairment via finger interaction with digital devices

Measuring cognitive function is essential for characterizing brain health and tracking cognitive decline in Alzheimer’s Disease and other neurodegenerative conditions. Current tools to accurately evaluate cognitive impairment typically rely on a battery of questionnaires administered during clinical visits which is essential for the acquisition of repeated measurements in longitudinal studies. Previous studies have shown that the remote data collection of passively monitored daily interaction with personal digital devices can measure motor signs in the early stages of synucleinopathies, as well as facilitate longitudinal patient assessment in the real-world scenario with high patient compliance. This was achieved by the automatic discovery of patterns in the time series of keystroke dynamics, i.e. the time required to press and release keys, by machine learning algorithms. In this work, our hypothesis is that the typing patterns generated from user-device interaction may reflect relevant features of the effects of cognitive impairment caused by neurodegeneration. We use machine learning algorithms to estimate cognitive performance through the analysis of keystroke dynamic patterns that were extracted from mechanical and touchscreen keyboard use in a dataset of cognitively normal (n = 39, 51% male) and cognitively impaired subjects (n = 38, 60% male). These algorithms are trained and evaluated using a novel framework that integrates items from multiple neuropsychological and clinical scales into cognitive subdomains to generate a more holistic representation of multifaceted clinical signs. In our results, we see that these models based on typing input achieve moderate correlations with verbal memory, non-verbal memory and executive function subdomains [Spearman’s ρ between 0.54 (P < 0.001) and 0.42 (P < 0.001)] and a weak correlation with language/verbal skills [Spearman’s ρ 0.30 (P < 0.05)]. In addition, we observe a moderate correlation between our typing-based approach and the Total Montreal Cognitive Assessment score [Spearman’s ρ 0.48 (P < 0.001)]. Finally, we show that these machine learning models can perform better by using our subdomain framework that integrates the information from multiple neuropsychological scales as opposed to using the individual items that make up these scales. Our results support our hypothesis that typing patterns are able to reflect the effects of neurodegeneration in mild cognitive impairment and Alzheimer’s disease and that this new subdomain framework both helps the development of machine learning models and improves their interpretability.

Diagnostic accuracy of keystroke dynamics as digital biomarkers for fine motor decline in neuropsychiatric disorders: a systematic review and meta-analysis

The unmet timely diagnosis requirements, that take place years after substantial neural loss and neuroperturbations in neuropsychiatric disorders, affirm the dire need for biomarkers with proven efficacy. In Parkinson's disease (PD), Mild Cognitive impairment (MCI), Alzheimers disease (AD) and psychiatric disorders, it is difficult to detect early symptoms given their mild nature. We hypothesize that employing fine motor patterns, derived from natural interactions with keyboards, also knwon as keystroke dynamics, could translate classic finger dexterity tests from clinics to populations in-the-wild for timely diagnosis, yet, further evidence is required to prove this efficiency. We have searched PubMED, Medline, IEEEXplore, EBSCO and Web of Science for eligible diagnostic accuracy studies employing keystroke dynamics as an index test for the detection of neuropsychiatric disorders as the main target condition. We evaluated the diagnostic performance of keystroke dynamics across 41 studies published between 2014 and March 2022, comprising 3791 PD patients, 254 MCI patients, and 374 psychiatric disease patients. Of these, 25 studies were included in univariate random-effect meta-analysis models for diagnostic performance assessment. Pooled sensitivity and specificity are 0.86 (95% Confidence Interval (CI) 0.82-0.90, I2 = 79.49%) and 0.83 (CI 0.79-0.87, I2 = 83.45%) for PD, 0.83 (95% CI 0.65-1.00, I2 = 79.10%) and 0.87 (95% CI 0.80-0.93, I2 = 0%) for psychomotor impairment, and 0.85 (95% CI 0.74-0.96, I2 = 50.39%) and 0.82 (95% CI 0.70-0.94, I2 = 87.73%) for MCI and early AD, respectively. Our subgroup analyses conveyed the diagnosis efficiency of keystroke dynamics for naturalistic self-reported data, and the promising performance of multimodal analysis of naturalistic behavioral data and deep learning methods in detecting disease-induced phenotypes. The meta-regression models showed the increase in diagnostic accuracy and fine motor impairment severity index with age and disease duration for PD and MCI. The risk of bias, based on the QUADAS-2 tool, is deemed low to moderate and overall, we rated the quality of evidence to be moderate. We conveyed the feasibility of keystroke dynamics as digital biomarkers for fine motor decline in naturalistic environments. Future work to evaluate their performance for longitudinal disease monitoring and therapeutic implications is yet to be performed. We eventually propose a partnership strategy based on a "co-creation" approach that stems from mechanistic explanations of patients' characteristics derived from data obtained in-clinics and under ecologically valid settings. The protocol of this systematic review and meta-analysis is registered in PROSPERO; identifier CRD42021278707. The presented work is supported by the KU-KAIST joint research center.

Application of Artificial Intelligence in Community-Based Primary Health Care: Systematic Scoping Review and Critical Appraisal

BACKGROUND

Research on the integration of artificial intelligence (AI) into community-based primary health care (CBPHC) has highlighted several advantages and disadvantages in practice regarding, for example, facilitating diagnosis and disease management, as well as doubts concerning the unintended harmful effects of this integration. However, there is a lack of evidence about a comprehensive knowledge synthesis that could shed light on AI systems tested or implemented in CBPHC.

OBJECTIVE

We intended to identify and evaluate published studies that have tested or implemented AI in CBPHC settings.

METHODS

We conducted a systematic scoping review informed by an earlier study and the Joanna Briggs Institute (JBI) scoping review framework and reported the findings according to PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analysis-Scoping Reviews) reporting guidelines. An information specialist performed a comprehensive search from the date of inception until February 2020, in seven bibliographic databases: Cochrane Library, MEDLINE, EMBASE, Web of Science, Cumulative Index to Nursing and Allied Health Literature (CINAHL), ScienceDirect, and IEEE Xplore. The selected studies considered all populations who provide and receive care in CBPHC settings, AI interventions that had been implemented, tested, or both, and assessed outcomes related to patients, health care providers, or CBPHC systems. Risk of bias was assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). Two authors independently screened the titles and abstracts of the identified records, read the selected full texts, and extracted data from the included studies using a validated extraction form. Disagreements were resolved by consensus, and if this was not possible, the opinion of a third reviewer was sought. A third reviewer also validated all the extracted data.

RESULTS

We retrieved 22,113 documents. After the removal of duplicates, 16,870 documents were screened, and 90 peer-reviewed publications met our inclusion criteria. Machine learning (ML) (41/90, 45%), natural language processing (NLP) (24/90, 27%), and expert systems (17/90, 19%) were the most commonly studied AI interventions. These were primarily implemented for diagnosis, detection, or surveillance purposes. Neural networks (ie, convolutional neural networks and abductive networks) demonstrated the highest accuracy, considering the given database for the given clinical task. The risk of bias in diagnosis or prognosis studies was the lowest in the participant category (4/49, 4%) and the highest in the outcome category (22/49, 45%).

CONCLUSIONS

We observed variabilities in reporting the participants, types of AI methods, analyses, and outcomes, and highlighted the large gap in the effective development and implementation of AI in CBPHC. Further studies are needed to efficiently guide the development and implementation of AI interventions in CBPHC settings.

Collecting, exploring and sharing personal data: Why, how and where

New, multi-channel personal data sources (like heart rate, sleep patterns, travel patterns, or social activities) are enabled by ever increased availability of miniaturised technologies embedded within smartphones and wearables. These data sources enable personal self-management of lifestyle choices (e.g., exercise, move to a bike-friendly area) and, on a large scale, scientific discoveries to improve health and quality of life. However, there are no simple and reliable ways for individuals to securely collect, explore and share these sources. Additionally, much data is also wasted, especially when the technology provider ceases to exist, leaving the users without any opportunity to retrieve own datasets from “dead” devices or systems. Our research reveals evidence of what we term human data bleeding and offers guidance on how to address current issues by reasoning upon five core aspects, namely technological, financial, legal, institutional and cultural factors. To this end, we present preliminary specifications of an open platform for personal data storage and quality of life research. The Open Health Archive (OHA) is a platform that would support individual, community and societal needs by facilitating collecting, exploring and sharing personal health and QoL data.

Multi-Dimensional, Short-Timescale Quantification of Parkinson's Disease and Essential Tremor Motor Dysfunction

Introduction: Parkinson's disease (PD) is a progressive movement disorder characterized by heterogenous motor dysfunction with fluctuations in severity. Objective, short-timescale characterization of this dysfunction is necessary as therapies become increasingly adaptive.

Objectives: This study aims to characterize a novel, naturalistic, and goal-directed tablet-based task and complementary analysis protocol designed to characterize the motor features of PD.

Methods: A total of 26 patients with PD and without deep brain stimulation (DBS), 20 control subjects, and eight patients with PD and with DBS completed the task. Eight metrics, each designed to capture an aspect of motor dysfunction in PD, were calculated from 1-second, non-overlapping epochs of the raw positional and pressure data captured during task completion. These metrics were used to generate a classifier using a support vector machine (SVM) model to produce a unifying, scalar “motor error score” (MES). The data generated from these patients with PD were compared to same-day standard clinical assessments. Additionally, these data were compared to analogous data generated from a separate group of 12 patients with essential tremor (ET) to assess the task's specificity for different movement disorders. Finally, an SVM model was generated for each of the eight patients with PD and with DBS to differentiate between their motor dysfunction in the “DBS On” and “DBS Off” stimulation states.

Results: The eight metrics calculated from the raw positional and force data captured during task completion were non-redundant. MES generated by the SVM analysis protocol showed a strong correlation with MDS-UPDRS-III scores assigned by movement disorder specialists. Analysis of the relative contributions of each of the eight metrics showed a significant difference between the motor dysfunction of PD and ET. Much of this difference was attributable to the homogenous, tremor-dominant phenotype of ET motor dysfunction. Finally, in individual patients with PD with DBS, task performance and subsequent SVM classification effectively differentiated between the “DBS On” and “DBS Off” stimulation states.

Conclusion: This tablet-based task and analysis protocol correlated strongly with expert clinical assessments of PD motor dysfunction. Additionally, the task showed specificity for PD when compared to ET, another common movement disorder. This specificity was driven by the relative heterogeneity of motor dysfunction of PD compared to ET. Finally, the task was able to distinguish between the “DBS On” and “DBS Off” states within single patients with PD. This task provides temporally-precise and specific information about motor dysfunction in at least two movement disorders that could feasibly correlate to neural activity.

Screening of Parkinsonian subtle fine-motor impairment from touchscreen typing via deep learning

Fine-motor impairment (FMI) is progressively expressed in early Parkinson’s Disease (PD) patients and is now known to be evident in the immediate prodromal stage of the condition. The clinical techniques for detecting FMI may not be robust enough and here, we show that the subtle FMI of early PD patients can be effectively estimated from the analysis of natural smartphone touchscreen typing via deep learning networks, trained in stages of initialization and fine-tuning. In a validation dataset of 36,000 typing sessions from 39 subjects (17 healthy/22 PD patients with medically validated UPDRS Part III single-item scores), the proposed approach achieved values of area under the receiver operating characteristic curve (AUC) of 0.89 (95% confidence interval: 0.80–0.96) with sensitivity/specificity: 0.90/0.83. The derived estimations result in statistically significant (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p<0.05$$\end{document}p<0.05) correlation of 0.66/0.73/0.58 with the clinical standard UPDRS Part III items 22/23/31, respectively. Further validation analysis on 9 de novo PD patients vs. 17 healthy controls classification resulted in AUC of 0.97 (0.93–1.00) with 0.93/0.90. For 253 remote study participants, with self-reported health status providing 252.000 typing sessions via a touchscreen typing data acquisition mobile app (iPrognosis), the proposed approach predicted 0.79 AUC (0.66–0.91) with 0.76/0.71. Remote and unobtrusive screening of subtle FMI via natural smartphone usage, may assist in consolidating early and accurate diagnosis of PD.

New Sensor and Wearable Technologies to Aid in the Diagnosis and Treatment Monitoring of Parkinson's Disease

Parkinson's disease (PD) is a degenerative disorder of the brain characterized by the impairment of the nigrostriatal system. This impairment leads to specific motor manifestations (i.e., bradykinesia, tremor, and rigidity) that are assessed through clinical examination, scales, and patient-reported outcomes. New sensor-based and wearable technologies are progressively revolutionizing PD care by objectively measuring these manifestations and improving PD diagnosis and treatment monitoring. However, their use is still limited in clinical practice, perhaps because of the absence of external validation and standards for their continuous use at home. In the near future, these systems will progressively complement traditional tools and revolutionize the way we diagnose and monitor patients with PD.

Long-term unsupervised mobility assessment in movement disorders

Mobile health technologies (wearable, portable, body-fixed sensors, or domestic-integrated devices) that quantify mobility in unsupervised, daily living environments are emerging as complementary clinical assessments. Data collected in these ecologically valid, patient-relevant settings can overcome limitations of conventional clinical assessments, as they capture fluctuating and rare events. These data could support clinical decision making and could also serve as outcomes in clinical trials. However, studies that directly compared assessments made in unsupervised and supervised (eg, in the laboratory or hospital) settings point to large disparities, even in the same parameters of mobility. These differences appear to be affected by psychological, physiological, cognitive, environmental, and technical factors, and by the types of mobilities and diagnoses assessed. To facilitate the successful adaptation of the unsupervised assessment of mobility into clinical practice and clinical trials, clinicians and researchers should consider these disparities and the multiple factors that contribute to them.

Systematic Review Looking at the Use of Technology to Measure Free-Living Symptom and Activity Outcomes in Parkinson's Disease in the Home or a Home-like Environment

BACKGROUND

The emergence of new technologies measuring outcomes in Parkinson's disease (PD) to complement the existing clinical rating scales has introduced the possibility of measurement occurring in patients' own homes whilst they freely live and carry out normal day-to-day activities.

OBJECTIVE

This systematic review seeks to provide an overview of what technology is being used to test which outcomes in PD from free-living participant activity in the setting of the home environment. Additionally, this review seeks to form an impression of the nature of validation and clinimetric testing carried out on the technological device(s) being used.

METHODS

Five databases (Medline, Embase, PsycInfo, Cochrane and Web of Science) were systematically searched for papers dating from 2000. Study eligibility criteria included: adults with a PD diagnosis; the use of technology; the setting of a home or home-like environment; outcomes measuring any motor and non-motor aspect relevant to PD, as well as activities of daily living; unrestricted/unscripted activities undertaken by participants.

RESULTS

65 studies were selected for data extraction. There were wide varieties of participant sample sizes (<10 up to hundreds) and study durations (<2 weeks up to a year). The metrics evaluated by technology, largely using inertial measurement units in wearable devices, included gait, tremor, physical activity, bradykinesia, dyskinesia and motor fluctuations, posture, falls, typing, sleep and activities of daily living.

CONCLUSIONS

Home-based free-living testing in PD is being conducted by multiple groups with diverse approaches, focussing mainly on motor symptoms and sleep.

Artificial intelligence for assisting diagnostics and assessment of Parkinson's disease-A review

Artificial intelligence, specifically machine learning, has found numerous applications in computer-aided diagnostics, monitoring and management of neurodegenerative movement disorders of parkinsonian type. These tasks are not trivial due to high inter-subject variability and similarity of clinical presentations of different neurodegenerative disorders in the early stages. This paper aims to give a comprehensive, high-level overview of applications of artificial intelligence through machine learning algorithms in kinematic analysis of movement disorders, specifically Parkinson's disease (PD). We surveyed papers published between January 2007 and January 2019, within online databases, including PubMed and Science Direct, with a focus on the most recently published studies. The search encompassed papers dealing with the implementation of machine learning algorithms for diagnosis and assessment of PD using data describing motion of upper and lower extremities. This systematic review presents an overview of 48 relevant studies published in the abovementioned period, which investigate the use of artificial intelligence for diagnostics, therapy assessment and progress prediction in PD based on body kinematics. Different machine learning algorithms showed promising results, particularly for early PD diagnostics. The investigated publications demonstrated the potentials of collecting data from affordable and globally available devices. However, to fully exploit artificial intelligence technologies in the future, more widespread collaboration is advised among medical institutions, clinicians and researchers, to facilitate aligning of data collection protocols, sharing and merging of data sets.

Remote Monitoring of Treatment Response in Parkinson's Disease: The Habit of Typing on a Computer

OBJECTIVE

The recent advances in technology are opening a new opportunity to remotely evaluate motor features in people with Parkinson's disease (PD). We hypothesized that typing on an electronic device, a habitual behavior facilitated by the nigrostriatal dopaminergic pathway, could allow for objectively and nonobtrusively monitoring parkinsonian features and response to medication in an at-home setting.

METHODS

We enrolled 31 participants recently diagnosed with PD who were due to start dopaminergic treatment and 30 age-matched controls. We remotely monitored their typing pattern during a 6-month (24 weeks) follow-up period before and while dopaminergic medications were being titrated. The typing data were used to develop a novel algorithm based on recursive neural networks and detect participants' responses to medication. The latter were defined by the Unified Parkinson's Disease Rating Scale-III (UPDRS-III) minimal clinically important difference. Furthermore, we tested the accuracy of the algorithm to predict the final response to medication as early as 21 weeks prior to the final 6-month clinical outcome.

RESULTS

The score on the novel algorithm based on recursive neural networks had an overall moderate kappa agreement and fair area under the receiver operating characteristic (ROC) curve with the time-coincident UPDRS-III minimal clinically important difference. The participants classified as responders at the final visit (based on the UPDRS-III minimal clinically important difference) had higher scores on the novel algorithm based on recursive neural networks when compared with the participants with stable UPDRS-III, from the third week of the study onward.

CONCLUSIONS

This preliminary study suggests that remotely gathered unsupervised typing data allows for the accurate detection and prediction of drug response in PD. © 2019 International Parkinson and Movement Disorder Society.

Smartwatch for the analysis of rest tremor in patients with Parkinson's disease

Wearable technology used in Parkinson's disease (PD) research has become an increasing focus of interest in this field. Our group assessed the feasibility, clinical correlation, reliability, and acceptance of smartwatches in order to quantify arm resting tremors in PD patients. An Android application on a smartwatch was used to obtain raw data from the smartwatch's gyroscopes. Twenty-two PD patients were consecutively recruited and followed for 1 year. Arm rest tremors were video filmed and scored by two independent raters using the motor subscale of the Unified Parkinson's Disease Rating Scale (UPDRS-III). The tremor intensity parameter was defined by the root mean square of the angular speed measured by the smartwatch at the wrist. Sixty-four smartwatch evaluations were completed. The Spearman coefficient among the mean of the resting tremor (UPDRS-III) scores and smartwatch measurements for tremor intensity was 0.81 (p < .001); smartwatch reliability to quantify tremors was checked by intraclass reliability coefficient with a resting tremor = 0.89, minimum detectable change = 59.03%. Good acceptance of the system was shown. Smartwatch use for PD tremor analysis is possible, reliable, well-correlated with clinical scores, and well-accepted by patients for clinical follow-up. The results from these experiments suggest that this commodity hardware has the potential to quantify PD patients' tremors objectively in a consulting-room.