Online Handwriting, Signature and Touch Dynamics: Tasks and Potential Applications in the Field of Security and Health

A tablet-based multi-dimensional drawing system can effectively distinguish patients with amnestic MCI from healthy individuals

The population with dementia is expected to rise to 152 million in 2050 due to the aging population worldwide. Therefore, it is significant to identify and intervene in the early stage of dementia. The Rey-Osterreth complex figure (ROCF) test is a visuospatial test scale. Its scoring methods are numerous, time-consuming, and inconsistent, which is unsuitable for wide application as required by the high number of people at risk. Therefore, there is an urgent need for a rapid, objective, and sensitive digital scoring method to detect cognitive dysfunction in the early stage accurately. This study aims to clarify the organizational strategy of aMCI patients to draw complex figures through a multi-dimensional digital evaluation system. At the same time, a rapid, objective, and sensitive digital scoring method is established to replace traditional scoring. The data of 64 subjects (38 aMCI patients and 26 NC individuals) were analyzed in this study. All subjects completed the tablet's Geriatric Complex Figure (GCF) test, including copying, 3-min recall, and 20-min delayed recall, and also underwent a standardized neuropsychological test battery and classic ROCF test. Digital GCF (dGCF) variables and conventional GCF (cGCF) scores were input into the forward stepwise logistic regression model to construct classification models. Finally, ROC curves were made to visualize the difference in the diagnostic value of dGCF variables vs. cGCF scores in categorizing the diagnostic groups. In 20-min delayed recall, aMCI patients' time in air and pause time were longer than NC individuals. Patients with aMCI had more short strokes and poorer ability of detail integration (all p < 0.05). The diagnostic sensitivity of dGCF variables for aMCI patients was 89.47%, slightly higher than cGCF scores (sensitivity: 84.21%). The diagnostic accuracy of both was comparable (dGCF: 70.3%; cGCF: 73.4%). Moreover, combining dGCF variables and cGCF scores could significantly improve the diagnostic accuracy and specificity (accuracy: 78.1%, specificity: 84.62%). At the same time, we construct the regression equations of the two models. Our study shows that dGCF equipment can quantitatively evaluate drawing performance, and its performance is comparable to the time-consuming cGCF score. The regression equation of the model we constructed can well identify patients with aMCI in clinical application. We believe this new technique can be a highly effective screening tool for patients with MCI.

Analysis of Gender Differences in Online Handwriting Signals for Enhancing e-Health and e-Security Applications

Handwriting is a complex perceptual–motor skill that is mastered around the age of 8. Although its computerized analysis has been utilized in many biometric and digital health applications, the possible effect of gender is frequently neglected. The aim of this paper is to analyze different online handwritten tasks performed by intact subjects and explore gender differences in commonly used temporal, kinematic, and dynamic features. The differences were explored in the BIOSECUR-ID database. We have identified a significant gender difference in on-surface/in-air time of genuine and skilled forgery signatures, on-surface time in cursive letters and numbers, and pressure, speed, and acceleration in text written in capital letters. Our findings accent the need to consider gender as an important confounding factor in studies dealing with online handwriting signal processing.

A survey of visual and procedural handwriting analysis for neuropsychological assessment

To date, Artificial Intelligence systems for handwriting and drawing analysis have primarily targeted domains such as writer identification and sketch recognition. Conversely, the automatic characterization of graphomotor patterns as biomarkers of brain health is a relatively less explored research area. Despite its importance, the work done in this direction is limited and sporadic. This paper aims to provide a survey of related work to provide guidance to novice researchers and highlight relevant study contributions. The literature has been grouped into “visual analysis techniques” and “procedural analysis techniques”. Visual analysis techniques evaluate offline samples of a graphomotor response after completion. On the other hand, procedural analysis techniques focus on the dynamic processes involved in producing a graphomotor reaction. Since the primary goal of both families of strategies is to represent domain knowledge effectively, the paper also outlines the commonly employed handwriting representation and estimation methods presented in the literature and discusses their strengths and weaknesses. It also highlights the limitations of existing processes and the challenges commonly faced when designing such systems. High-level directions for further research conclude the paper.