The MICK (Mobile integrated cognitive kit) app: Digital rapid automatized naming for visual assessment across the spectrum of neurological disorders

Testing the Validity and Reliability of a Standardized Virtual Examination for Concussion

Background and Objectives

We determined inter-modality (in-person vs telemedicine examination) and inter-rater agreement for telemedicine assessments (2 different examiners) using the Telemedicine Buffalo Concussion Physical Examination (Tele-BCPE), a standardized concussion examination designed for remote use.

Methods

Patients referred for an initial evaluation for concussion were invited to participate. Participants had a brief initial assessment by the treating neurologist. After a patient granted informed consent to participate in the study, the treating neurologist obtained a concussion-related history before leaving the examination room. Using the Tele-BCPE, 2 virtual examinations in no specific sequence were then performed from nearby rooms by the treating neurologist and another neurologist. After the 2 telemedicine examinations, the treating physician returned to the examination room to perform the in-person examination. Intraclass correlation coefficients (ICC) determined inter-modality validity (in-person vs remote examination by the same examiner) and inter-rater reliability (between remote examinations done by 2 examiners) of overall scores of the Tele-BCPE within the comparison datasets. Cohen's kappa, κ, measured levels of agreement of dichotomous ratings (abnormality present vs absent) on individual components of the Tele-BCPE to determine inter-modality and inter-rater agreement.

Results

For total scores of the Tele-BCPE, both inter-modality agreement (ICC = 0.95 [95% CI 0.86-0.98, p < 0.001]) and inter-rater agreement (ICC = 0.88 [95% CI 0.71-0.95, p < 0.001]) were reliable (ICC >0.70). There was at least substantial inter-modality agreement (κ ≥ 0.61) for 25 of 29 examination elements. For inter-rater agreement (2 telemedicine examinations), there was at least substantial agreement for 8 of 29 examination elements.

Discussion

Our study demonstrates that the Tele-BCPE yielded consistent clinical results, whether conducted in-person or virtually by the same examiner, or when performed virtually by 2 different examiners. The Tele-BCPE is a valid indicator of neurologic examination findings as determined by an in-person concussion assessment. The Tele-BCPE may also be performed with excellent levels of reliability by neurologists with different training and backgrounds in the virtual setting. These findings suggest that a combination of in-person and telemedicine modalities, or involvement of 2 telemedicine examiners for the same patient, can provide consistent concussion assessments across the continuum of care.

MICK (Mobile Integrated Cognitive Kit) App for Concussion Assessment in a Youth Ice Hockey League

BACKGROUND

Visual symptoms are common after concussion. Rapid automatized naming (RAN) tasks are simple performance measures that demonstrate worse time scores in the setting of acute or more remote injury.

METHODS

We evaluated the capacity for the Mobile Universal Lexicon Evaluation System (MULES) and Staggered Uneven Number (SUN) testing to be feasibly administered during preseason testing in a cohort of youth ice hockey athletes using a novel computerized app, the Mobile Integrated Cognitive Kit (MICK). Participants from a youth hockey league underwent preseason testing.

RESULTS

Among 60 participants, the median age was 13 years (range 6-17). The median best time for the MULES was 49.8 seconds (range = 34.2-141.0) and the median best time for the SUN was 70.1 (range = 36.6-200.0). As is characteristic of timed performance measures, there were learning effects between the first and second trials for both the MULES (median improvement = 10.6 seconds, range = -32.3 to 92.0, P < 0.001, Wilcoxon signed-rank test) and SUN (median improvement = 2.4 seconds, range= -8.0 to 15.1, P = 0.001, Wilcoxon signed-rank test). Age was a predictor of best baseline times, with longer (worse) times for younger participants for MULES (P < 0.001, rs = -0.67) and SUN (P < 0.001, rs = -0.54 Spearman rank correlation). Degrees of learning effect did not vary with age (P > 0.05, rs = -0.2).

CONCLUSIONS

Vision-based RAN tasks, such as the MULES and SUN, can be feasibly administered using the MICK app during preseason baseline testing in youth sports teams. The results suggest that more frequent baseline tests are necessary for preadolescent athletes because of the relation of RAN task performance to age.

Tablet app-based dexterity training in multiple sclerosis (TAD-MS): a randomized controlled trial

PURPOSE

Mobile health applications (mHealth apps) may lead to health benefits. In recent years, the use of apps in multiple sclerosis (MS) has increased. Apps to train and improve dexterity in MS are scarce. This study investigated the effectiveness of a tablet app-based home-based training to improve dexterity in individuals with MS.

MATERIALS AND METHODS

In a randomized controlled trial, two standardized 4-week home-based interventions focussing on different aspects of dexterity and upper limb function were compared. Assessments were done at baseline, post-intervention and 12-week follow-up. The primary endpoint was the Arm Function in Multiple Sclerosis Questionnaire, a dexterity-related measure of patient-reported activities of daily living. Secondary endpoints were dexterous function, grip strength and health-related quality of life.

RESULTS

Forty-eight individuals were randomly assigned to a tablet app-based program (n = 26) or a control strengthening exercise program (n = 22). No significant differences were found for the primary endpoint (p = 0.35). Some significant differences in favour of the app-group were found in fine coordinated finger movements and strength. No significant differences were found at the 12-week follow-up for all endpoints. Adherence in both groups was above 90%.

CONCLUSIONS

App-based training was not superior compared to a control strengthening exercise program concerning the arm- and hand function from the participant's perspective. However, app-based training was found to be effective in improving specific dimensions (finger movements and strength), and can easily be applied at home. Therefore, individuals living with MS with impaired dexterity should consider app-based training.

CLINICAL TRIAL REGISTRATION

Clinicaltrials.gov NCT03369470.

eHealth tools to assess the neurological function for research, in absence of the neurologist - a systematic review, part I (software)

BACKGROUND

Neurological disorders remain a worldwide concern due to their increasing prevalence and mortality, combined with the lack of available treatment, in most cases. Exploring protective and risk factors associated with the development of neurological disorders will allow for improving prevention strategies. However, ascertaining neurological outcomes in population-based studies can be both complex and costly. The application of eHealth tools in research may contribute to lowering the costs and increase accessibility. The aim of this systematic review is to map existing eHealth tools assessing neurological signs and/or symptoms for epidemiological research.

METHODS

Four search engines (PubMed, Web of Science, Scopus & EBSCOHost) were used to retrieve articles on the development, validation, or implementation of eHealth tools to assess neurological signs and/or symptoms. The clinical and technical properties of the software tools were summarised. Due to high numbers, only software tools are presented here.

FINDINGS

A total of 42 tools were retrieved. These captured signs and/or symptoms belonging to four neurological domains: cognitive function, motor function, cranial nerves, and gait and coordination. An additional fifth category of composite tools was added. Most of the tools were available in English and were developed for smartphone device, with the remaining tools being available as web-based platforms. Less than half of the captured tools were fully validated, and only approximately half were still active at the time of data collection.

INTERPRETATION

The identified tools often presented limitations either due to language barriers or lack of proper validation. Maintenance and durability of most tools were low. The present mapping exercise offers a detailed guide for epidemiologists to identify the most appropriate eHealth tool for their research.

FUNDING

The current study was funded by a PhD position at the University of Groningen. No additional funding was acquired.

An Examination of Visual Quality of Life and Functional Vision Among Collision and Non-Collision Athletes Over a Competitive Season

OBJECTIVE

Repetitive head impacts (RHIs) experienced during sports are gaining attention due to potential long-term neurological dysfunction, absent of a diagnosed concussion. One area susceptible to dysfunction is vision. The goal of this study was to evaluate changes in visual quality of life (VQOL) and functional vision scores from pre- to post-season among collision and non-collision athletes.

METHODS

The Visual Functioning Questionnaire-25 and Neuro-Ophthalmic Supplement (NOS), as well as functional vision testing (Mobile Universal Lexicon Evaluation System - MULES) were completed pre- and post-season by three groups: collision athletes, non-collision athletes, and minimally active controls (MACs).

RESULTS

There were 42 participants, with 41 (21 male, 20 female) completing both testing sessions, with a mean (standard deviation [SD]) age of 21 (2.46) years (collision group, n = 14; non-collision group, n = 13, MACs, n = 14). Baseline analyses revealed no significant differences between groups for VQOL or MULES scores. However, those with a family history of psychiatric disorder scored significantly worse on NOS. Post-season/follow-up testing revealed no significant differences between groups for VQOL scores. Non-collision athletes significantly improved on the MULES test by 2.46 ± 3.60 (SD) s (35.0 [95% confidence interval, 0.29-4.63]; p = .03). Change score results from pre- to post-season were not significant.

CONCLUSION

Although the groups were not significantly different from one another, non-collision athletes significantly improved MULES scores, whereas collision athletes performed the worst, suggesting exposure to RHIs may impact functional vision. Thus, further evaluation of RHIs and their impact on vision is warranted.

Vision as a piece of the head trauma puzzle

Approximately half of the brain's circuits are involved in vision and control of eye movements. Therefore, visual dysfunction is a common symptom of concussion, the mildest form of traumatic brain injury (TBI). Photosensitivity, vergence dysfunction, saccadic abnormalities, and distortions in visual perception have been reported as vision-related symptoms following concussion. Impaired visual function has also been reported in populations with a lifetime history of TBI. Consequently, vision-based tools have been developed to detect and diagnose concussion in the acute setting, and characterize visual and cognitive function in those with a lifetime history of TBI. Rapid automatized naming (RAN) tasks have provided widely accessible and quantitative measures of visual-cognitive function. Laboratory-based eye tracking approaches demonstrate promise in measuring visual function and validating results from RAN tasks in patients with concussion. Optical coherence tomography (OCT) has detected neurodegeneration in patients with Alzheimer's disease and multiple sclerosis and may provide critical insight into chronic conditions related to TBI, such as traumatic encephalopathy syndrome. Here, we review the literature and discuss the future directions of vision-based assessments of concussion and conditions related to TBI.

MICK (Mobile Integrated Cognitive Kit) app: Feasibility of an accessible tablet-based rapid picture and number naming task for concussion assessment in a division 1 college football cohort

Although visual symptoms are common following concussion, quantitative measures of visual function are missing from concussion evaluation protocols on the athletic sideline. For the past half century, rapid automatized naming (RAN) tasks have demonstrated promise as quantitative neuro-visual assessment tools in the setting of head trauma and other disorders but have been previously limited in accessibility and scalability. The Mobile Interactive Cognitive Kit (MICK) App is a digital RAN test that can be downloaded on most mobile devices and can therefore provide a quantitative measure of visual function anywhere, including the athletic sideline. This investigation examined the feasibility of MICK App administration in a cohort of Division 1 college football players. Participants (n = 82) from a National Collegiate Athletic Association (NCAA) Division 1 football team underwent baseline testing on the MICK app. Total completion times of RAN tests on the MICK app were recorded; magnitudes of best time scores and between-trial learning effects were determined by paired t-test. Consistent with most timed performance measures, there were significant learning effects between the two baseline trials for both RAN tasks on the MICK app: Mobile Universal Lexicon Evaluation System (MULES) (p < 0.001, paired t-test, mean improvement 13.3 s) and the Staggered Uneven Number (SUN) (p < 0.001, mean improvement 3.3 s). This study demonstrated that the MICK App can be feasibly administered in the setting of pre-season baseline testing in a Division I environment. These data provide a foundation for post-injury sideline testing that will include comparison to baseline in the setting of concussion.