A Mobile Application for Smart Computer-Aided Self-Administered Testing of Cognition, Speech, and Motor Impairment

Spatial and Temporal Gait Characteristics in Patients Admitted to a Neuro-Rehabilitation Department with Age-Related White Matter Changes: A Gait Analysis and Clinical Study

BACKGROUND

Patients with age-related white matter changes (ARWMC) frequently present a gait disorder, depression and cognitive impairment. Our aims are to define which alterations in the gait parameters are associated with motor or neuro-psychological impairment and to assess the role of motor, mood or cognitive dysfunction in explaining the variance of the gait parameters.

METHODS

Patients with gait disorders admitted to a Neuro-rehabilitation Department, affected by vascular leukoencephalopathy who had ARWMC confirmed by a brain MRI, were consecutively enrolled, classified by a neuroradiological scale (Fazekas 1987) and compared to healthy controls. We excluded subjects unable to walk independently, subjects with hydrocephalus or severe aphasia, with orthopaedic and other neurological pathologies conditioning the walking pattern. Patients and controls were assessed by clinical and functional scales (Mini Mental State Examination, Geriatric Depression Scale, Nevitt Motor Performance Scale, Berg Balance Scale, Functional Independence Measure), and computerised gait analysis was performed to assess the spatial and temporal gait parameters in a cross-sectional study.

RESULTS

We recruited 76 patients (48 males, aged 78.3 ± 6.2 years) and 14 controls (6 males, aged 75.8 ± 5 years). In the multiple regression analysis, the gait parameter with overall best model summary values, associated with the ARWMC severity, was the stride length even after correction for age, sex, weight and height (R² = 0.327). The motor performances justified at least in part of the gait disorder (R² change = 0.220), but the mood state accounted independently for gait alterations (R² change = 0.039). The increase in ARWMC severity, the reduction of motor performance and a depressed mood state were associated with a reduction of stride length (R = 0.766, R² = 0.587), reduction of gait speed (R² = 0.573) and an increase in double support time (R² = 0.421).

CONCLUSION

The gait disorders in patients with ARWMC are related to motor impairment, but the presence of depression is an independent factor for determining gait alterations and functional status. These data pave the way for longitudinal studies, including gait parameters, to quantitatively assess gait changes after treatment or to monitor the natural progression of the gait disorders.

Intelligent speech technologies for transcription, disease diagnosis, and medical equipment interactive control in smart hospitals: A review

The growing and aging of the world population have driven the shortage of medical resources in recent years, especially during the COVID-19 pandemic. Fortunately, the rapid development of robotics and artificial intelligence technologies help to adapt to the challenges in the healthcare field. Among them, intelligent speech technology (IST) has served doctors and patients to improve the efficiency of medical behavior and alleviate the medical burden. However, problems like noise interference in complex medical scenarios and pronunciation differences between patients and healthy people hamper the broad application of IST in hospitals. In recent years, technologies such as machine learning have developed rapidly in intelligent speech recognition, which is expected to solve these problems. This paper first introduces IST's procedure and system architecture and analyzes its application in medical scenarios. Secondly, we review existing IST applications in smart hospitals in detail, including electronic medical documentation, disease diagnosis and evaluation, and human-medical equipment interaction. In addition, we elaborate on an application case of IST in the early recognition, diagnosis, rehabilitation training, evaluation, and daily care of stroke patients. Finally, we discuss IST's limitations, challenges, and future directions in the medical field. Furthermore, we propose a novel medical voice analysis system architecture that employs active hardware, active software, and human-computer interaction to realize intelligent and evolvable speech recognition. This comprehensive review and the proposed architecture offer directions for future studies on IST and its applications in smart hospitals.

The current state of artificial intelligence-augmented digitized neurocognitive screening test

The cognitive screening test is a brief cognitive examination that could be easily performed in a clinical setting. However, one of the main drawbacks of this test was that only a paper-based version was available, which restricts the test to be manually administered and graded by medical personnel at the health centers. The main solution to these problems was to develop a potential remote assessment for screening individuals with cognitive impairment. Currently, multiple studies have been adopting artificial intelligence (AI) technology into these tests, evolving the conventional paper-based neurocognitive test into a digitized AI-assisted neurocognitive test. These studies provided credible evidence of the potential of AI-augmented cognitive screening tests to be better and provided the framework for future studies to further improve the implementation of AI technology in the cognitive screening test. The objective of this review article is to discuss different types of AI used in digitized cognitive screening tests and their advantages and disadvantages.

Digital Devices for Assessing Motor Functions in Mobility-Impaired and Healthy Populations: Systematic Literature Review

Background

With the advent of smart sensing technology, mobile and wearable devices can provide continuous and objective monitoring and assessment of motor function outcomes.

Objective

We aimed to describe the existing scientific literature on wearable and mobile technologies that are being used or tested for assessing motor functions in mobility-impaired and healthy adults and to evaluate the degree to which these devices provide clinically valid measures of motor function in these populations.

Methods

A systematic literature review was conducted by searching Embase, MEDLINE, CENTRAL (January 1, 2015, to June 24, 2020), the United States and European Union clinical trial registries, and the United States Food and Drug Administration website using predefined study selection criteria. Study selection, data extraction, and quality assessment were performed by 2 independent reviewers.

Results

A total of 91 publications representing 87 unique studies were included. The most represented clinical conditions were Parkinson disease (n=51 studies), followed by stroke (n=5), Huntington disease (n=5), and multiple sclerosis (n=2). A total of 42 motion-detecting devices were identified, and the majority (n=27, 64%) were created for the purpose of health care–related data collection, although approximately 25% were personal electronic devices (eg, smartphones and watches) and 11% were entertainment consoles (eg, Microsoft Kinect or Xbox and Nintendo Wii). The primary motion outcomes were related to gait (n=30), gross motor movements (n=25), and fine motor movements (n=23). As a group, sensor-derived motion data showed a mean sensitivity of 0.83 (SD 7.27), a mean specificity of 0.84 (SD 15.40), a mean accuracy of 0.90 (SD 5.87) in discriminating between diseased individuals and healthy controls, and a mean Pearson r validity coefficient of 0.52 (SD 0.22) relative to clinical measures. We did not find significant differences in the degree of validity between in-laboratory and at-home sensor-based assessments nor between device class (ie, health care–related device, personal electronic devices, and entertainment consoles).

Conclusions

Sensor-derived motion data can be leveraged to classify and quantify disease status for a variety of neurological conditions. However, most of the recent research on digital clinical measures is derived from proof-of-concept studies with considerable variation in methodological approaches, and much of the reviewed literature has focused on clinical validation, with less than one-quarter of the studies performing analytical validation. Overall, future research is crucially needed to further consolidate that sensor-derived motion data may lead to the development of robust and transformative digital measurements intended to predict, diagnose, and quantify neurological disease state and its longitudinal change.

Testing of Motor Coordination in Degenerative Neurological Diseases

Parkinson’s disease (PD) is a progressive movement disorder caused by the death of dopamine-producing cells in the midbrain. PD is the most prevalent movement disorder of the central nervous system and affects more than 6.3 million people in the world. The changes in the motor functions of patients are not easy to be clearly and on-time observed by the clinicians and to make the most well-informed decisions for the treatment. The aim of this paper is the monitoring PD by designing, developing, and evaluating a prototype mobile App using a pressure pen, which collects quantitative and objective information about PD patients, thus allowing clinicians to understand better and make assumptions about the severity and the stage of Parkinson’s disease. This study presents a dynamic spiral test that can only be performed with tablet and pen pressure. Furthermore, the handwriting samples by PD patients and healthy controls individuals are collected by a computerized system, and the measurements of Spiral Deviation, Total Time, and Pen Pressure are processed. The results showed an accurate evaluation of the stage of Parkinson’s disease. Thus, the clinician may use the proposed PD telemonitoring system as a screening test, storing the history of all the patient’s measurements.

Classification of Dysphonic Voices in Parkinson's Disease with Semi-Supervised Competitive Learning Algorithm

This article proposes a novel semi-supervised competitive learning (SSCL) algorithm for vocal pattern classifications in Parkinson’s disease (PD). The acoustic parameters of voice records were grouped into the families of jitter, shimmer, harmonic-to-noise, frequency, and nonlinear measures, respectively. The linear correlations were computed within each acoustic parameter family. According to the correlation matrix results, the jitter, shimmer, and harmonic-to-noise parameters presented as highly correlated in terms of Pearson’s correlation coefficients. Then, the principal component analysis (PCA) technique was implemented to eliminate the redundant dimensions of the acoustic parameters for each family. The Mann−Whitney−Wilcoxon hypothesis test was used to evaluate the significant difference of the PCA-projected features between the healthy subjects and PD patients. Eight dominant PCA-projected features were selected based on the eigenvalue threshold criterion and the statistical significance level (p < 0.05) of the hypothesis test. The SSCL algorithm proposed in this paper included the procedures of the competitive prototype seed selection, K-means optimization, and the nearest neighbor classifications. The pattern classification experimental results showed that the proposed SSCL method can provide the excellent diagnostic performances in terms of accuracy (0.838), recall (0.825), specificity (0.85), precision (0.846), F-score (0.835), Matthews correlation coefficient (0.675), area under the receiver operating characteristic curve (0.939), and Kappa coefficient (0.675), which were consistently better than those results of conventional KNN or SVM classifiers.

Digital cognitive testing using a tablet-based app in patients with brain tumors: a single-center feasibility study comparing the app to the gold standard

OBJECTIVE

Healthcare digitization has led to increasing tablet-based apps to improve diagnostics, self-discipline, and well-being in patients. Moreover, patient-reported outcome measures are crucial for optimized treatment, with superior applicability if independent from patient visits. Whereas most uses cover health maintenance, only a few studies have focused on cognitive testing in neurosurgical patients despite its nature as one of the most integrative outcome measures in neurooncology.

METHODS

The authors performed a prospective single-center feasibility study including neurosurgical patients affected by intraaxial tumors and healthy subjects, testing cognitive function by using a digitized app-based approach and conventional paper-and-pencil (PP) tests. Healthy subjects underwent follow-up testing for retest reliability.

RESULTS

The authors included 24 patients with brain tumor and 10 healthy subjects, all of whom completed both tests. Equivalent mean performance results were found in the tablet-based digital app and PP counterparts; whereas the digital approach had shorter test duration in patients (29.9 minutes for PP vs 21.9 minutes for app, p = 0.019) and in the healthy cohort (23.2 minutes for PP vs 16.4 minutes for app, p = 0.003), patients with brain tumor scored lower when both test strategies were applied. Results were consistent in healthy subjects after a median of 3 months.

CONCLUSIONS

Cognitive function assessment is feasible using a digitized tablet-based app, with equivalent results to those of PP tests in healthy subjects and patients with brain tumor. Thus, this approach allows much closer follow-up independent of patient visits and might provide a viable option to improve patient follow-ups.

Vision-based Finger Tapping Test in Patients with Parkinson's Disease via Spatial-temporal 3D Hand Pose Estimation

Finger tapping test is crucial for diagnosing Parkinson's Disease (PD), but manual visual evaluations can result in score discrepancy due to clinicians' subjectivity. Moreover, applying wearable sensors requires making physical contact and may hinder PD patient's raw movement patterns. Accordingly, a novel computer-vision approach is proposed using depth camera and spatial-temporal 3D hand pose estimation to capture and evaluate PD patients' 3D hand movement. Within this approach, a temporal encoding module is leveraged to extend A2J's deep learning framework to counter the pose jittering problem, and a pose refinement process is utilized to alleviate dependency on massive data. Additionally, the first vision-based 3D PD hand dataset of 112 hand samples from 48 PD patients and 11 control subjects is constructed, fully annotated by qualified physicians under clinical settings. Testing on this real-world data, this new model achieves 81.2% classification accuracy, even surpassing that of individual clinicians in comparison, fully demonstrating this proposition's effectiveness. The demo video can be ac-cessed at https://github.com/ZhilinGuo/ST-A2J.

Using Automatic Speech Recognition to Assess Thai Speech Language Fluency in the Montreal Cognitive Assessment (MoCA)

The Montreal cognitive assessment (MoCA), a widely accepted screening tool for identifying patients with mild cognitive impairment (MCI), includes a language fluency test of verbal functioning; its scores are based on the number of unique correct words produced by the test taker. However, it is possible that unique words may be counted differently for various languages. This study focuses on Thai as a language that differs from English in terms of word combinations. We applied various automatic speech recognition (ASR) techniques to develop an assisted scoring system for the MoCA language fluency test with Thai language support. This was a challenge because Thai is a low-resource language for which domain-specific data are not publicly available, especially speech data from patients with MCIs. Furthermore, the great variety of pronunciation, intonation, tone, and accent of the patients, all of which might differ from healthy controls, bring more complexity to the model. We propose a hybrid time delay neural network hidden Markov model (TDNN-HMM) architecture for acoustic model training to create our ASR system that is robust to environmental noise and to the variation of voice quality impacted by MCI. The LOTUS Thai speech corpus was incorporated into the training set to improve the model’s generalization. A preprocessing algorithm was implemented to reduce the background noise and improve the overall data quality before feeding data into the TDNN-HMM system for automatic word detection and language fluency score calculation. The results show that the TDNN-HMM model in combination with data augmentation using lattice-free maximum mutual information (LF-MMI) objective function provides a word error rate (WER) of 30.77%. To our knowledge, this is the first study to develop an ASR with Thai language support to automate the scoring system of MoCA’s language fluency assessment.

Harris Hawks Sparse Auto-Encoder Networks for Automatic Speech Recognition System

Automatic speech recognition (ASR) is an effective technique that can convert human speech into text format or computer actions. ASR systems are widely used in smart appliances, smart homes, and biometric systems. Signal processing and machine learning techniques are incorporated to recognize speech. However, traditional systems have low performance due to a noisy environment. In addition to this, accents and local differences negatively affect the ASR system’s performance while analyzing speech signals. A precise speech recognition system was developed to improve the system performance to overcome these issues. This paper uses speech information from jim-schwoebel voice datasets processed by Mel-frequency cepstral coefficients (MFCCs). The MFCC algorithm extracts the valuable features that are used to recognize speech. Here, a sparse auto-encoder (SAE) neural network is used to classify the model, and the hidden Markov model (HMM) is used to decide on the speech recognition. The network performance is optimized by applying the Harris Hawks optimization (HHO) algorithm to fine-tune the network parameter. The fine-tuned network can effectively recognize speech in a noisy environment.

Local Pattern Transformation Based Feature Extraction for Recognition of Parkinson's Disease Based on Gait Signals

Parkinson’s disease (PD) is a neuro-degenerative disorder primarily triggered due to the deterioration of dopamine-producing neurons in the substantia nigra of the human brain. The early detection of Parkinson’s disease can assist in preventing deteriorating health. This paper analyzes human gait signals using Local Binary Pattern (LBP) techniques during feature extraction before classification. Supplementary to the LBP techniques, Local Gradient Pattern (LGP), Local Neighbour Descriptive Pattern (LNDP), and Local Neighbour Gradient Pattern (LNGP) were utilized to extract features from gait signals. The statistical features were derived and analyzed, and the statistical Kruskal–Wallis test was carried out for the selection of an optimal feature set. The classification was then carried out by an Artificial Neural Network (ANN) for the identified feature set. The proposed Symmetrically Weighted Local Neighbour Gradient Pattern (SWLNGP) method achieves a better performance, with 96.28% accuracy, 96.57% sensitivity, and 95.94% specificity. This study suggests that SWLNGP could be an effective feature extraction technique for the recognition of Parkinsonian gait.

Trends, Technologies, and Key Challenges in Smart and Connected Healthcare

Cardio Vascular Diseases (CVD) is the leading cause of death globally and is increasing at an alarming rate, according to the American Heart Association's Heart Attack and Stroke Statistics-2021. This increase has been further exacerbated because of the current coronavirus (COVID-19) pandemic, thereby increasing the pressure on existing healthcare resources. Smart and Connected Health (SCH) is a viable solution for the prevalent healthcare challenges. It can reshape the course of healthcare to be more strategic, preventive, and custom-designed, making it more effective with value-added services. This research endeavors to classify state-of-the-art SCH technologies via a thorough literature review and analysis to comprehensively define SCH features and identify the enabling technology-related challenges in SCH adoption. We also propose an architectural model that captures the technological aspect of the SCH solution, its environment, and its primary involved stakeholders. It serves as a reference model for SCH acceptance and implementation. We reflected the COVID-19 case study illustrating how some countries have tackled the pandemic differently in terms of leveraging the power of different SCH technologies, such as big data, cloud computing, Internet of Things, artificial intelligence, robotics, blockchain, and mobile applications. In combating the pandemic, SCH has been used efficiently at different stages such as disease diagnosis, virus detection, individual monitoring, tracking, controlling, and resource allocation. Furthermore, this review highlights the challenges to SCH acceptance, as well as the potential research directions for better patient-centric healthcare.

Text Messaging-Based Medical Diagnosis Using Natural Language Processing and Fuzzy Logic

The use of natural language processing (NLP) methods and their application to developing conversational systems for health diagnosis increases patients’ access to medical knowledge. In this study, a chatbot service was developed for the Covenant University Doctor (CUDoctor) telehealth system based on fuzzy logic rules and fuzzy inference. The service focuses on assessing the symptoms of tropical diseases in Nigeria. Telegram Bot Application Programming Interface (API) was used to create the interconnection between the chatbot and the system, while Twilio API was used for interconnectivity between the system and a short messaging service (SMS) subscriber. The service uses the knowledge base consisting of known facts on diseases and symptoms acquired from medical ontologies. A fuzzy support vector machine (SVM) is used to effectively predict the disease based on the symptoms inputted. The inputs of the users are recognized by NLP and are forwarded to the CUDoctor for decision support. Finally, a notification message displaying the end of the diagnosis process is sent to the user. The result is a medical diagnosis system which provides a personalized diagnosis utilizing self-input from users to effectively diagnose diseases. The usability of the developed system was evaluated using the system usability scale (SUS), yielding a mean SUS score of 80.4, which indicates the overall positive evaluation.