Test-retest reliability of KINARM robot sensorimotor and cognitive assessment: in pediatric ice hockey players

Neurodata Tracker: Software for computational assessment of hand motor skills based on optical motion capture in a virtual environment

Objectives

Deficits affecting hand motor skills negatively impact the quality of life of patients. The NeuroData Tracker platform has been developed for the objective and precise evaluation of hand motor deficits. We describe the design and development of the platform and analyse the technological feasibility and usability in a relevant clinical setting.

Methods

A software application was developed in Unity (C#) to obtain kinematic data from hand movement tracking by a portable device with two cameras and three infrared sensors (leap motion®). Four exercises were implemented: (a) wrist flexion-extension (b) finger-grip opening-closing (c) finger spread (d) fist opening-closing. The most representative kinematic parameters were selected for each exercise. A script in Python was integrated in the platform to transform real-time kinematic data into relevant information for the clinician. The application was tested in a pilot study comparing the data provided by the tool from ten healthy subjects without any motor impairment and ten patients diagnosed with a stroke with mild to moderate hand motor deficit.

Results

The NeuroData Tracker allowed the parameterization of kinematics of hand movement and the issuance of a report with the results. The comparison of the data obtained suggests the feasibility of the tool for detecting differences between patients and healthy subjects.

Conclusions

This new platform based on optical motion capturing provides objective measurement of hand movement allowing quantification of motor deficits. These findings require further validation of the tool in larger trials to verify its usefulness in the clinical setting.

Using a Prism Paradigm to Identify Sensorimotor Impairment in Youth Following Concussion

OBJECTIVE

The study assesses the intrarater reliability and utility of a prism paradigm to identify sensorimotor impairment following sports-related concussion in youth, (recent and history of concussion) compared with youth with no concussion.

SETTING

University of Calgary.

PARTICIPANTS

Three groups of 40 ice hockey players ranging in age from 11 to 17 years were included: (1) no concussion; (2) recent concussion, mean number of days since last concussion 5 (95% CI, 4-6); and (3) history of concussion, mean number of days since last concussion 631 (95% CI, 505-730).

DESIGN

Cross-sectional study.

MAIN MEASURES

The vestibulo-ocular reflex is a fundamental reflex of the central nervous system that stabilizes the position of the eyes during head movement and adapts when sensory input is altered (the bend of the light on the retina by prism glasses). The prism adaptation measure was the number of throws taken to adapt to wearing prism glasses while throwing balls at a central target.

RESULTS

The intraclass correlation coefficient (0.73; 95% CI, 0.55-0.84) and the Bland-Altman 95% levels of agreement (lower limit -18.5; 95% CI, -22.4 to -14.6); and upper limit 16.6; 95% CI, 12.7-20.5) reflected good intrarater reliability. Prism adaptation measures were significantly different across groups ( F2,119 = 51.9, P < .001, r = 0.52, power of 90%), with the mean number of throws for youth (aged 11-17 years) in each group as follows: 10 (95% CI, 8-12) no concussion history; 25 (95% CI, 23-27) recent concussion (1-11 days); and 17 (95% CI, 15-20) history of concussion (90-1560 days).

CONCLUSION

Use of a prism paradigm as a clinical measurement tool has the potential to alter concussion management in youth. The prism paradigm is objective, is readily translatable to the clinical arena, has minimal associated costs, and is easily administered, reliable, and portable.

Emerging technologies for management of patients with amyotrophic lateral sclerosis: from telehealth to assistive robotics and neural interfaces

Amyotrophic lateral sclerosis (ALS), also known as motor neuron disease, is characterized by the degeneration of both upper and lower motor neurons, which leads to muscle weakness and subsequently paralysis. It begins subtly with focal weakness but spreads relentlessly to involve most muscles, thus proving to be effectively incurable. Typically, death due to respiratory paralysis occurs in 3–5 years. To date, it has been shown that the management of ALS patients is best achieved with a multidisciplinary approach, and with the help of emerging technologies ranging from multidisciplinary teleconsults (for monitoring the dysphagia, respiratory function, and nutritional status) to brain-computer interfaces and eye tracking for alternative augmentative communication, until robotics, it may increase effectiveness. The COVID-19 pandemic created a spasmodic need to accelerate the development and implementation of such technologies in clinical practice, to improve the daily lives of both ALS patients and caregivers. However, despite the remarkable strides that have been made in the field, there are still issues to be addressed. This review will be discussed on the eureka moment of emerging technologies for ALS, used as a blueprint not only for neurodegenerative diseases, examining the current technologies already in place or being evaluated, highlighting the pros and cons for future clinical applications.

Differentiating Motor Coordination in Children with Cerebral Palsy and Typically Developing Populations Through Exploratory Factor Analysis of Robotic Assessments

General motor and executive functions are integral for tasks of daily living and are typically assessed when quantifying impairment of an individual. Robotic tasks offer highly repeatable and objective measures of motor and cognitive function. Additionally, robotic tasks and measures have been used successfully to quantify impairment of children with cerebral palsy (CP). Many robotic tasks include multiple performance parameters, so interpretation of results and identification of impairment can be difficult, especially when multiple tasks are completed. This study used exploratory factor analysis to investigate a potential set of quantitative models of motor and cognitive function in children, and compare performance of participants with CP to these models. The three calculated factors achieved strong differentiation between participants with mild CP and the typically developing population. This demonstrates the feasibility of these factors to quantify impairment and track improvements related to therapies.Clinical Relevance- This establishes a method to differentiate atypical motor performance related to CP using a robotic reversed visually guided reaching task.

Measuring age differences in executive control using rapid motor decisions in a robotic object hit and avoid task

Age-related declines in executive control are commonly assessed with neuropsychological tests that also rely on sensory and motor processes that are not typically measured in those tasks. It is therefore difficult to isolate the cognitive contributions from sensorimotor contributions to performance impairments. Rapid motor decision-making tasks may also be sensitive to age differences in executive control but allow for the measurement of sensorimotor contributors to task performance. Recently developed object hit (OH) and object hit and avoid (OHA) tasks using a robotic manipulandum are sensitive to motor and cognitive aspects of performance in stroke and Parkinson's disease. However, the impact of healthy aging, and the specific cognitive mechanisms involved in these tasks has not been assessed. We administered the OH and OHA tasks to 77 younger and 59 healthy older adults to evaluate the relative age differences in the perceptual-motor/sensory, movement coordination, and cognitive measures of performance. The Trail Making Test (TMT) Parts A and B were administered to assess the extent to which the cognitive contributors to OHA task performance are associated with executive functioning. After controlling for hand movement speed, age differences were largest for cognitive measures, with smaller differences in perceptual-motor speed and sensory measures, and little differences in bimanual and spatial coordination measures of performance. The cognitive measures were associated with executive functioning measures from the TMT task. These findings provide evidence that rapid motor decision-making tasks are sensitive to age differences in executive control and can isolate the cognitive from the sensorimotor contributions to task performance. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Quantifying changes over 1 year in motor and cognitive skill after transient ischemic attack (TIA) using robotics

Recent work has highlighted that people who have had TIA may have abnormal motor and cognitive function. We aimed to quantify deficits in a cohort of individuals who had TIA and measured changes in their abilities to perform behavioural tasks over 1 year of follow-up using the Kinarm Exoskeleton robot. We additionally considered performance and change over time in an active control cohort of migraineurs. Individuals who had TIA or migraine completed 8 behavioural tasks that assessed cognition as well as motor and sensory functionality in the arm. Participants in the TIA cohort were assessed at 2, 6, 12, and 52 weeks after symptom resolution. Migraineurs were assessed at 2 and 52 weeks after symptom resolution. We measured overall performance on each task using an aggregate metric called Task Score and quantified any significant change in performance including the potential influence of learning. We recruited 48 individuals to the TIA cohort and 28 individuals to the migraine cohort. Individuals in both groups displayed impairments on robotic tasks within 2 weeks of symptom cessation and also at approximately 1 year after symptom cessation, most commonly in tests of cognitive-motor integration. Up to 51.3% of people in the TIA cohort demonstrated an impairment on a given task within 2-weeks of symptom resolution, and up to 27.3% had an impairment after 1 year. In the migraine group, these numbers were 37.5% and 31.6%, respectively. We identified that up to 18% of participants in the TIA group, and up to 10% in the migraine group, displayed impairments that persisted for up to 1 year after symptom resolution. Finally, we determined that a subset of both cohorts (25-30%) experienced statistically significant deteriorations in performance after 1 year. People who have experienced transient neurological symptoms, such as those that arise from TIA or migraine, may continue to experience lasting neurological impairments. Most individuals had relatively stable task performance over time, with some impairments persisting for up to 1 year. However, some individuals demonstrated substantial changes in performance, which highlights the heterogeneity of these neurological disorders. These findings demonstrate the need to consider factors that contribute to lasting neurological impairment, approaches that could be developed to alleviate the lasting effects of TIA or migraine, and the need to consider individual neurological status, even following transient neurological symptoms.

Acute kidney injury is associated with subtle but quantifiable neurocognitive impairments

BACKGROUND

Acute kidney injury (AKI) is associated with long-term morbidity and mortality. The effects of AKI on neurocognitive functioning remain unknown. Our objective was to quantify neurocognitive impairment after an episode of AKI.

METHODS

Survivors of AKI were compared to age-matched controls, as well as a convenience sample of patients matched for cardiovascular risk factors with normal kidney function (active control group). Patients with AKI completed two assessments, while the active control group completed one assessment. The assessment included a standardized test: The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), and a robotic assessment: Kinarm.

RESULTS

The cohort consisted of 21 patients with AKI, 16 of whom completed both assessments, and 21 active control patients. The majority of patients with AKI had Kidney Disease Improving Global Outcomes stage 3 AKI (86%), 57% received dialysis, and 43% recovered to ≤ 25% of their baseline serum creatinine by their first assessment. Compared to the RBANS, which detected little impairment, the Kinarm categorized patients as impaired in visuomotor (10/21, 48%), attention (10/20, 50%), and executive tasks (11/21, 52%) compared to healthy controls. Additionally, patients with AKI performed significantly worse in attention and visuomotor domains when compared to the active controls. Neurocognitive performance was generally not impacted by the need for dialysis or whether kidney function recovered.

CONCLUSION

Robotic technology identified quantifiable neurocognitive impairment in survivors of AKI. Deficits were noted particularly in attention, visuomotor, and executive domains. Further investigation into the downstream health consequences of these neurocognitive impairments is warranted.

Assessment of Postural Stability During an Upper Extremity Rapid, Bimanual Motor Task After Sport-Related Concussion

CONTEXT

Sport-related concussion (SRC) often presents with multidimensional and subtle neurologic deficits that are difficult to detect with standard clinical tests. New assessment approaches that efficiently quantify deficits across multiple neurologic domains are needed.

OBJECTIVE

To quantify impairments in postural movements during an assessment of rapid, bimanual motor ability in athletes within 10 days of experiencing an SRC and evaluate relationships between impairments in upper extremity and postural performance.

DESIGN

Cohort study.

SETTING

Sports medicine clinic.

PATIENTS OR OTHER PARTICIPANTS

Initial baseline assessments were completed for 711 athletes. Seventy-five athletes (age = 15.8 ± 3.3 years at baseline) sustained SRCs and were reassessed within 10 days. Seventy-eight athletes (age = 15.5 ± 2.0 years) completed 2 assessments in a healthy state.

MAIN OUTCOME MEASURE(S)

Athletes stood on force plates and performed a rapid, bimanual motor task, termed the object-hit task, delivered using a Kinesiological Instrument for Normal and Altered Reaching Movements endpoint robot. Measures of postural stability that quantified center-of-pressure movements and measures of upper extremity performance were used to characterize task performance.

RESULTS

Performance changes across assessments were converted to reliable change indices. We observed a difference in reliable change indices values between athletes with SRC and healthy control athletes on the combined postural measures (P = .01). Using measures to evaluate the change in postural movements from the early, easier portion of the task to the later, more difficult portion, we identified the highest levels of impairment (19%-25% of the sample impaired). We also noted a difference between individuals with concussion and healthy individuals on the combined upper extremity measures (P = .003), but these impairments were largely unrelated to those identified in the postural movements.

CONCLUSIONS

Measurement of postural movements during the object-hit task revealed impairments in postural stability that were not related to impairments in upper extremity performance. The findings demonstrated the benefits of using assessments that simultaneously evaluate multiple domains of neurologic function (eg, upper extremity and postural control) after SRC.

The feasibility of assessing cognitive and motor function in multiple sclerosis patients using robotics

Background

Multiple sclerosis (MS) causes pervasive motor, sensory and cognitive dysfunction. The Expanded Disability Status Scale (EDSS) is the gold standard for assessing MS disability. The EDSS is biased towards mobility and may not accurately measure MS-related disabilities in the upper limb or in cognitive functions (e.g. executive function).

Objective

Our objectives were to determine the feasibility of using the Kinarm robotic system to quantify neurological deficits related to arm function and cognition in MS patients, and examine relationships between traditional clinical assessments and Kinarm variables.

Methods

Individuals with MS performed 8 robotic tasks assessing motor, cognitive, and sensory ability. We additionally collected traditional clinical assessments and compared these to the results of the robotic assessment.

Results

Forty-three people with MS were assessed. Most participants could complete the robotic assessment. Twenty-six (60%) were impaired on at least one cognitive task and twenty-six (60%) were impaired on at least one upper-limb motor task. Cognitive domain task performance correlated most strongly with the EDSS.

Conclusions

Kinarm robotic assessment of people with MS is feasible, can identify a broad range of upper-limb motor and sensory, as well as cognitive, impairments, and complements current clinical rating scales in the assessment of MS-related disability.

Differentiating Motor Coordination and Position Sense in Children with Cerebral Palsy and Typically Developing Populations Through Robotic Assessments

Motor function and coordination improve as children age. Robotic assessments of motor function and coordination have been shown to be repeatable, objective, and accurate. Additionally, robotic assessments have been used to measure and quantify deficits in motor function and coordination in children with cerebral palsy (CP). Normative models of motor function and coordination based on age have not been used widely to differentiate impaired performance from typical performance. This study presents preliminary results of identifying deficits in motor function and coordination assessed with a robotic reaching task and using a normative model of typical performance that accounts for age, sex, and handedness. The models were compared with data from three participants with CP to evaluate whether the models could be used to identify deficits in motor function. The models indicated motor deficits in one participant when performing a visually guided reaching task with respect to initial speed and distance ratios. There was no evidence of motor control deficits in the other two participants. Future work will refine the models to be able to better identify and quantify motor control impairments with the potential to target therapy around quantifiable goals.

Sway Balance Mobile Application: Reliability, Acclimation, and Baseline Administration

OBJECTIVES

To describe historic baseline session administration practices, to assess the utility of a practice trial (an acclimation trial) before the official balance session, and to examine the within-session reliability of the Sway Balance Mobile Application (SBMA).

DESIGN

Retrospective observational study.

SETTING

Middle schools, high schools, and colleges across the United States.

PARTICIPANTS

More than 17 000 student-athletes were included in the Sway Medical database with 7968 individuals meeting this study's inclusion criteria.

INDEPENDENT VARIABLES

The Sway Medical database included the following subject characteristics for each student-athlete: age, sex, weight, and height.

MAIN OUTCOME MEASURES

Balance assessment score generated by the SBMA.

RESULTS

Variable administration practices with significant differences between baseline session averages across methods were found. Individuals who performed an acclimation trial had a significantly higher baseline session average than those who did not. Within-session reliability estimates were in the low to adequate range (r = 0.53-0.78), with higher estimates found for 2 consecutive baseline tests (r = 0.75-0.78).

CONCLUSIONS

For maximum clinical utility, a standardized protocol for postural control baseline acquisition is necessary. Acclimation trial should be administered before a baseline session to minimize variability, especially with only 1 to 2 baseline tests. The highest reliability was observed across 2 consecutive baseline tests within the same baseline session. We suggest obtaining baseline balance measurements with an acclimation trial followed by a baseline session with 2 baseline tests. Prospective studies are required for validation.

Statistical measures of motor, sensory and cognitive performance across repeated robot-based testing

BACKGROUND

Traditional clinical assessments are used extensively in neurology; however, they can be coarse, which can also make them insensitive to change. Kinarm is a robotic assessment system that has been used for precise assessment of individuals with neurological impairments. However, this precision also leads to the challenge of identifying whether a given change in performance reflects a significant change in an individual's ability or is simply natural variation. Our objective here is to derive confidence intervals and thresholds of significant change for Kinarm Standard Tests™ (KST).

METHODS

We assessed participants twice within 15 days on all tasks presently available in KST. We determined the 5-95% confidence intervals for each task parameter, and derived thresholds for significant change. We tested for learning effects and corrected for the false discovery rate (FDR) to identify task parameters with significant learning effects. Finally, we calculated intraclass correlation of type ICC [1, 2] (ICC-C) to quantify consistency across assessments.

RESULTS

We recruited an average of 56 participants per task. Confidence intervals for Z-Task Scores ranged between 0.61 and 1.55, and the threshold for significant change ranged between 0.87 and 2.19. We determined that 4/11 tasks displayed learning effects that were significant after FDR correction; these 4 tasks primarily tested cognition or cognitive-motor integration. ICC-C values for Z-Task Scores ranged from 0.26 to 0.76.

CONCLUSIONS

The present results provide statistical bounds on individual performance for KST as well as significant changes across repeated testing. Most measures of performance had good inter-rater reliability. Tasks with a higher cognitive burden seemed to be more susceptible to learning effects, which should be taken into account when interpreting longitudinal assessments of these tasks.

Multi-modal normalization of resting-state using local physiology reduces changes in functional connectivity patterns observed in mTBI patients

Blood oxygenation level dependent (BOLD) resting-state functional magnetic resonance imaging (rs-fMRI) may serve as a sensitive marker to identify possible changes in the architecture of large-scale networks following mild traumatic brain injury (mTBI). Differences in functional connectivity (FC) measurements derived from BOLD rs-fMRI may however be confounded by changes in local cerebrovascular physiology and neurovascular coupling mechanisms, without changes in the underlying neuronally driven connectivity of networks. In this study, multi-modal neuroimaging data including BOLD rs-fMRI, baseline cerebral blood flow (CBF0) and cerebrovascular reactivity (CVR; acquired using a hypercapnic gas breathing challenge) were collected in 23 subjects with reported mTBI (14.6±14.9 months post-injury) and 27 age-matched healthy controls. Despite no group differences in CVR within the networks of interest (P > 0.05, corrected), significantly higher CBF0 was documented in the mTBI subjects (P < 0.05, corrected), relative to the controls. A normalization method designed to account for differences in CBF0 post-mTBI was introduced to evaluate the effects of such an approach on reported group differences in network connectivity. Inclusion of regional perfusion measurements in the computation of correlation coefficients within and across large-scale networks narrowed the differences in FC between the groups, suggesting that this approach may elucidate unique changes in connectivity post-mTBI while accounting for shared variance with CBF0. Altogether, our results provide a strong paradigm supporting the need to account for changes in physiological modulators of BOLD in order to expand our understanding of the effects of brain injury on large-scale FC of cortical networks.

Assessing various sensorimotor and cognitive functions in people with epilepsy is feasible with robotics

BACKGROUND

Epilepsy is a common neurological disorder characterized by recurrent seizures, along with comorbid cognitive and psychosocial impairment. Current gold standards of assessment can quantify cognitive and motor performance, but may not capture all subtleties of behavior. Here, we study the feasibility of assessing various upper limb sensorimotor and cognition functions in people with epilepsy using the Kinarm robotic assessment system. We quantify performance across multiple behavioral domains and additionally consider the possible effects of epilepsy subtype and medication.

METHODS

We recruited individuals with a variety of epilepsy subtypes. Participants performed 8 behavioral tasks that tested motor, cognitive, and sensory domains. We collected data on the same tasks from a group of control participants that had no known neurological impairments. We quantified performance using Task Scores, which provide a composite measure of overall performance on a given task and are adjusted for age, sex, and handedness.

RESULTS

We collected data from 46 individuals with epilepsy and 92 control participants. The assessment was well-tolerated, with no adverse events recorded. Cognitive tasks testing spatial working memory, executive function, and motor response inhibition were the most frequently impaired in the epilepsy cohort, with 33/46 (72%) being outside the normal range on at least one of these tasks. Additionally, 29/46 (63%) were impaired on at least one task testing primarily motor skill, and 14/46 (30%) were impaired on a proprioceptive sensory task. People with either focal epilepsy or generalized epilepsy performed significantly worse on both motor and cognitive tasks than control participants after correcting for multiple comparisons. There were no statistical differences between generalized and focal epilepsy groups on Task Scores. Finally, individuals taking topiramate trended toward having worse performance on a spatial working memory task than other individuals with epilepsy who were not taking topiramate.

CONCLUSIONS

Kinarm robotic assessment is feasible in individuals with epilepsy and is well-tolerated. Our robotic paradigm can detect impairments in various sensorimotor and cognitive functions across the population with epilepsy. Future studies will explore the role of epilepsy subtype and medications.

The feasibility of using robotic technology to quantify sensory, motor, and cognitive impairments associated with ALS

OBJECTIVE

We used the KINARM robot to quantify impairments in cognitive and upper-limb sensorimotor performance in a cohort of people with amyotrophic lateral sclerosis (ALS). We sought to study the feasibility of using this technology for ALS research, to quantify patterns of impairments in individuals living with ALS, and elucidate correlations between robotic and traditional clinical behavioral measures.

METHODS

Participants completed robot-based behavioral tasks testing sensorimotor, cognitive, and proprioceptive performance. Performance on robotic tasks was normalized to a large healthy control cohort (no neurological impairments), adjusted for age. Task impairment was defined as performance outside the 95% range of controls. Traditional clinical tests included: Frontal Assessment Battery (FAB), ALS Functional Rating Scale-Revised (ALSFRS-R), and Montreal Cognitive Assessment (MoCA).

RESULTS

Seventeen people with ALS were assessed. Two participants reported pain or discomfort from the robot's seat and 2 others reported discomfort from arm position during the assessment (both rectified and did not affect exam completion). Participants were able to perform the majority of the robotic tasks, although 9 participants were unable to complete 1 or more tasks. Between 20 and 69% of participants displayed sensorimotor impairments; 19 and 69% displayed cognitive task impairments; 25% displayed proprioceptive impairments. MoCA was impaired in 9/17 participants; 10/17 had impaired performance on FAB. MoCA and FAB correlated well with robot-based measures of cognition.

CONCLUSION

Use of robotic assessment is generally feasible for people with ALS. Individuals with ALS have sensorimotor impairments as expected, and some demonstrate substantial cognitive impairments.

Sensorimotor Robotic Measures of tDCS- and HD-tDCS-Enhanced Motor Learning in Children

Transcranial direct-current stimulation (tDCS) enhances motor learning in adults. We have demonstrated that anodal tDCS and high-definition (HD) tDCS of the motor cortex can enhance motor skill acquisition in children, but behavioral mechanisms remain unknown. Robotics can objectively quantify complex sensorimotor functions to better understand mechanisms of motor learning. We aimed to characterize changes in sensorimotor function induced by tDCS and HD-tDCS paired motor learning in children within an interventional trial. Healthy, right-handed children (12–18 y) were randomized to anodal tDCS, HD-tDCS, or sham targeting the right primary motor cortex during left-hand Purdue pegboard test (PPT) training over five consecutive days. A KINARM robotic protocol quantifying proprioception, kinesthesia, visually guided reaching, and an object hit task was completed at baseline, posttraining, and six weeks later. Effects of the treatment group and training on changes in sensorimotor parameters were explored. Twenty-four children (median 15.5 years, 52% female) completed all measures. Compared to sham, both tDCS and HD-tDCS demonstrated enhanced motor learning with medium effect sizes. At baseline, multiple KINARM measures correlated with PPT performance. Following training, visually guided reaching in all groups was faster and required less corrective movements in the trained arm (H(2) = 9.250, p = 0.010). Aspects of kinesthesia including initial direction error improved across groups with sustained effects at follow-up (H(2) = 9.000, p = 0.011). No changes with training or stimulation were observed for position sense. For the object hit task, the HD-tDCS group moved more quickly with the right hand compared to sham at posttraining (χ²(2) = 6.255, p = 0.044). Robotics can quantify complex sensorimotor function within neuromodulator motor learning trials in children. Correlations with PPT performance suggest that KINARM metrics can assess motor learning effects. Understanding how tDCS and HD-tDCS enhance motor learning may be improved with robotic outcomes though specific mechanisms remain to be defined. Exploring mechanisms of neuromodulation may advance therapeutic approaches in children with cerebral palsy and other disabilities.

Spatial working memory performance following acute sport-related concussion

Introduction

An important problem in the field of sport-related concussion is the lack of a ‘gold-standard’ clinical assessment tool. Currently, the diagnosis relies heavily on self-reporting of symptoms and observation of clinical signs by medical professionals. To address this, our group has been motivated to develop objective measures of neurological impairment following concussion. Spatial working memory is an important aspect of cognitive function that might be impaired following concussion. In the present study, we measured spatial working memory using a robotic spatial span task. We first assessed test–retest reliability in 82 healthy athletes who underwent baseline testing across two athletic seasons using intraclass correlation coefficients. We then assessed spatial span performance relative to baseline in 47 athletes acutely following sport-related concussion using a reliable change index with 80% confidence limits to define impairment on an individual basis.

Results

We found good test–retest reliability for the mean span (a measure of spatial working memory span length; intraclass correlation coefficient = 0.79), and moderate reliability for the response duration (time taken per spatial target; intraclass correlation coefficient = 0.64) in healthy athletes. However, only 19% of acutely concussed athletes showed evidence of impairment relative to baseline in mean span, and even fewer (9%) showed evidence of impairment in response duration. Analysis of serial position curves revealed primacy and recency effects for this task, but no group-level differences between concussed and healthy athletes. Analysis of specific types of errors showed a higher rate of substitution errors in the concussed group at baseline, suggesting possible malingering in a small number of athletes.

Conclusion

Overall, few athletes showed evidence of impaired spatial working memory acutely following concussion, suggesting either that spatial working memory is not commonly impaired acutely post-concussion, or that the present task is not sufficiently demanding.

Test-retest reliability of the KINARM end-point robot for assessment of sensory, motor and neurocognitive function in young adult athletes

Background

Current assessment tools for sport-related concussion are limited by a reliance on subjective interpretation and patient symptom reporting. Robotic assessments may provide more objective and precise measures of neurological function than traditional clinical tests.

Objective

To determine the reliability of assessments of sensory, motor and cognitive function conducted with the KINARM end-point robotic device in young adult elite athletes.

Methods

Sixty-four randomly selected healthy, young adult elite athletes participated. Twenty-five individuals (25 M, mean age±SD, 20.2±2.1 years) participated in a within-season study, where three assessments were conducted within a single season (assessments labeled by session: S1, S2, S3). An additional 39 individuals (28M; 22.8±6.0 years) participated in a year-to-year study, where annual pre-season assessments were conducted for three consecutive seasons (assessments labeled by year: Y1, Y2, Y3). Forty-four parameters from five robotic tasks (Visually Guided Reaching, Position Matching, Object Hit, Object Hit and Avoid, and Trail Making B) and overall Task Scores describing performance on each task were quantified.

Results

Test-retest reliability was determined by intra-class correlation coefficients (ICCs) between the first and second, and second and third assessments. In the within-season study, ICCs were ≥0.50 for 68% of parameters between S1 and S2, 80% of parameters between S2 and S3, and for three of the five Task Scores both between S1 and S2, and S2 and S3. In the year-to-year study, ICCs were ≥0.50 for 64% of parameters between Y1 and Y2, 82% of parameters between Y2 and Y3, and for four of the five Task Scores both between Y1 and Y2, and Y2 and Y3.

Conclusions

Overall, the results suggest moderate-to-good test-retest reliability for the majority of parameters measured by the KINARM robot in healthy young adult elite athletes. Future work will consider the potential use of this information for clinical assessment of concussion-related neurological deficits.

The relationship between cerebral oxygen saturation and quantitative metrics of neurological function after coronary bypass surgery: a feasibility study

BACKGROUND

It is well-known that patients undergoing coronary artery bypass grafting (CABG) surgery may experience neurological dysfunction following their operation. However, the nature of this dysfunction has not been properly quantified. Furthermore, the relationship between postoperative impairment and cerebral oxygen saturation during surgery has remained unclear. This study aims to define the feasibility of using robotic technology to quantify post-CABG neurocognitive function, and to correlate these objective metrics with intraoperative cerebral oxygenation.

METHODS

Neurological function was tested using robotic technology and a standardized questionnaire before and 3 months after surgery. In addition, frontal lobe cerebral oxygenation was recorded using the FORESIGHT near-infrared spectrometer for the duration of the operation. Pre- and postoperative neurological assessment was performed for 24 participants. Of those 24, 20 participants had cerebral oxygenation recorded during their surgery.

RESULTS

The cerebral oximeter captured 97.2% of the data. Majority of patients experienced no significant decline in overall neurocognitive function. Abnormal postoperative scores were most frequent in a sensorimotor task that involved additional cognitive load. In this reverse visually guided reaching task, postoperative scores significantly correlated with mean and minimum intraoperative cerebral oxygenation values, with lower values being associated with worse performance.

CONCLUSIONS

It is feasible to use robotic technology as a quantitative and objective neurocognitive assessment method for patients undergoing CABG. The relationship between quantitative metrics of neurocognitive function and intraoperative cerebral oxygenation warrants further investigation.

Quantification of upper limb position sense using an exoskeleton and a virtual reality display

Background

Proprioceptive sense plays a significant role in the generation and correction of skilled movements and, consequently, in most activities of daily living. We developed a new proprioception assessment protocol that enables the quantification of elbow position sense without using the opposite arm, involving active movement of the evaluated limb or relying on working memory. The aims of this descriptive study were to validate this assessment protocol by quantifying the elbow position sense of healthy adults, before using it in individuals who sustained a stroke, and to investigate its test-retest reliability.

Methods

Elbow joint position sense was quantified using a robotic device and a virtual reality system. Two assessments were performed, by the same evaluator, with a one-week interval. While the participant’s arms and hands were occluded from vision, the exoskeleton passively moved the dominant arm from an initial to a target position. Then, a virtual arm representation was projected on a screen placed over the participant’s arm. This virtual representation and the real arm were not perfectly superimposed, however. Participants had to indicate verbally the relative position of their arm (more flexed or more extended; two-alternative forced choice paradigm) compared to the virtual representation. Each participant completed a total of 136 trials, distributed in three phases. The angular differences between the participant’s arm and the virtual representation ranged from 1° to 27° and changed pseudo-randomly across trials. No feedback about results was provided to the participants during the task. A discrimination threshold was statistically extracted from a sigmoid curve fit representing the relationship between the angular difference and the percentage of successful trials. Test-retest reliability was evaluated with 3 different complementary approaches, i.e. a Bland-Altman analysis, an intraclass correlation coefficient (ICC) and a standard error of measurement (SEm).

Results

Thirty participants (24.6 years old; 17 males, 25 right-handed) completed both assessments. The mean discrimination thresholds were 7.0 ± 2.4 (mean ± standard deviation) and 5.9 ± 2.1 degrees for the first and the second assessment session, respectively. This small difference between assessments was significant (− 1.1 ± 2.2 degrees), however. The assessment protocol was characterized by a fair to good test-retest reliability (ICC = 0.47).

Conclusion

This study demonstrated the potential of this assessment protocol to objectively quantify elbow position sense in healthy individuals. Futures studies will validate this protocol in older adults and in individuals who sustained a stroke.

Corticospinal tract diffusion properties and robotic visually guided reaching in children with hemiparetic cerebral palsy

Perinatal stroke is the leading cause of hemiparetic cerebral palsy (CP), resulting in life-long disability. In this study, we examined the relationship between robotic upper extremity motor impairment and corticospinal tract (CST) diffusion properties. Thirty-three children with unilateral perinatal ischemic stroke (17 arterial, 16 venous) and hemiparesis were recruited from a population-based research cohort. Bilateral CSTs were defined using diffusion tensor imaging (DTI) and four diffusion metrics were quantified: fractional anisotropy (FA), mean (MD), radial (RD), and axial (AD) diffusivities. Participants completed a visually guided reaching task using the KINARM robot to define 10 movement parameters including movement time and maximum speed. Twenty-six typically developing children underwent the same evaluations. Partial correlations assessed the relationship between robotic reaching and CST diffusion parameters. All diffusion properties of the lesioned CST differed from controls in the arterial group, whereas only FA was reduced in the venous group. Non-lesioned CST diffusion measures were similar between stroke groups and controls. Both stroke groups demonstrated impaired reaching performance. Multiple reaching parameters of the affected limb correlated with lesioned CST diffusion properties. Lower FA and higher MD were associated with greater movement time. Few correlations were observed between non-lesioned CST diffusion and unaffected limb function though FA was associated with reaction time (R = -0.39, p < .01). Diffusion properties of the lesioned CST are altered after perinatal stroke, the degree of which correlates with specific elements of visually guided reaching performance, suggesting specific relevance of CST structural connectivity to clinical motor function in hemiparetic children.

Robotic exoskeleton assessment of transient ischemic attack

We used a robotic exoskeleton to quantify specific patterns of abnormal upper limb motor behaviour in people who have had transient ischemic attack (TIA). A cohort of people with TIA was recruited within two weeks of symptom onset. All individuals completed a robotic-based assessment of 8 behavioural tasks related to upper limb motor and proprioceptive function, as well as cognitive function. Robotic task performance was compared to a large cohort of controls without neurological impairments corrected for the influence of age. Impairment in people with TIA was defined as performance below the 5^th percentile of controls. Participants with TIA were also assessed with the National Institutes of Health Stroke Scale (NIHSS) score, Chedoke-McMaster Stroke Assessment (CMSA) of the arm, the Behavioural Inattention Test (BIT), the Purdue pegboard test (PPB), and the Montreal Cognitive Assessment (MoCA). Age-related white matter change (ARWMC), prior infarction and cella-media index (CMI) were assessed from baseline CT scan that was performed within 24 hours of TIA. Acute infarction was assessed from diffusion-weighted imaging in a subset of people with TIA. Twenty-two people with TIA were assessed. Robotic assessment showed impaired upper limb motor function in 7/22 people with TIA patients and upper limb sensory impairment in 4/22 individuals. Cognitive tasks involving robotic assessment of the upper limb were completed in 13 participants, of whom 8 (61.5%) showed significant impairment. Abnormal performance in the CMSA arm inventory was present in 12/22 (54.5%) participants. ARWMC was 11.8 ± 6.4 and CMI was 5.4 ± 1.5. DWI was positive in 0 participants. Quantitative robotic assessment showed that people who have had a TIA display a spectrum of upper limb motor and sensory performance deficits as well as cognitive function deficits despite resolution of symptoms and no evidence of tissue infarction.

Psychometric Properties of a Multidimensional Scale of Sense of Community in the School

Sense of community in the school has been associated with a range of important outcomes for students. However, there are currently no standard definitions of sense of community in the school with corresponding measures with established psychometric properties. To fill this gap, the main aim of the present study was to propose a model of sense of community in the school, its operationalization and to examine its key psychometric properties (factorial structure, reliability, differential item functioning, differential test functioning of the scale and discriminant, convergent, and criterion validity). Participants were 1,076 students from 22 public middle schools and 724 students from 22 public high schools located in the Italian city of Genoa and its province. To test the dimensionality of the scale, we conducted exploratory and confirmatory factor analysis under the Item Response Theory paradigm. Exploratory factor analysis confirmed three dimensions: Membership, Emotional connection, and Opportunities. A confirmatory factor analysis revealed that the bifactor model exhibited the largest improvement in fit. Cronbach’s alpha, omega total, and omega hierarchical indicated a good reliability for the measure. Internal consistency was satisfactory, considering Cronbach’s alpha and omega. Analysis of differential item/test functioning of the scale showed that girls and boys as well as students attending middle school and those attending high school responded in largely similar ways to the measure. Finally, the instrument demonstrated good discriminant, convergent, and criterion validity. Together, these findings indicate that our theory driven model of sense of community in the school is valid and that the instrument is a reliable measure for assessing sense of community in the school.

Do children and adolescent ice hockey players with and without a history of concussion differ in robotic testing of sensory, motor and cognitive function?

Background

KINARM end point robotic testing on a range of tasks evaluating sensory, motor and cognitive function in children/adolescents with no neurologic impairment has been shown to be reliable. The objective of this study was to determine whether differences in baseline performance on multiple robotic tasks could be identified between pediatric/adolescent ice hockey players (age range 10–14) with and without a history of concussion.

Methods

Three hundred and eighty-five pediatric/adolescent ice hockey players (ages 10–14) completed robotic testing (94 with and 292 without a history of concussion). Five robotic tasks characterized sensorimotor and/or cognitive performance with assessment of reaching, position sense, bimanual motor function, visuospatial skills, attention and decision-making. Seventy-six performance parameters are reported across all tasks.

Results

There were no significant differences in performance demonstrated between children with a history of concussion [median number of days since last concussion: 480 (range 8–3330)] and those without across all five tasks. Performance by the children with no history of concussion was used to identify parameter reference ranges that spanned 95 % of the group. All 76 parameter means from the concussion group fell within the normative reference ranges.

Conclusions

There are no differences in sensorimotor and/or cognitive performance across multiple parameters using KINARM end point robotic testing in children/adolescents with or without a history of concussion.

Movement distributions of stroke survivors exhibit distinct patterns that evolve with training

Background

While clinical assessments provide tools for characterizing abilities in motor-impaired individuals, concerns remain over their repeatability and reliability. Typical robot-assisted training studies focus on repetition of prescribed actions, yet such movement data provides an incomplete account of abnormal patterns of coordination. Recent studies have shown positive effects from self-directed movement, yet such a training paradigm leads to challenges in how to quantify and interpret performance.

Methods

With data from chronic stroke survivors (n = 10, practicing for 3 days), we tabulated histograms of the displacement, velocity, and acceleration for planar motion, and examined whether modeling of distributions could reveal changes in available movement patterns. We contrasted these results with scalar measures of the range of motion. We performed linear discriminant analysis (LDA) classification with selected histogram features to compare predictions versus actual subject identifiers. As a basis of comparison, we also present an age-matched control group of healthy individuals (n = 10, practicing for 1 day).

Results

Analysis of range of motion did not show improvement from self-directed movement training for the stroke survivors in this study. However, examination of distributions indicated that increased multivariate normal components were needed to accurately model the patterns of movement after training. Stroke survivors generally exhibited more complex distributions of motor exploration compared to the age-matched control group. Classification using linear discriminant analysis revealed that movement patterns were identifiable by individual. Individuals in the control group were more difficult to identify using classification methods, consistent with the idea that motor deficits contribute significantly to unique movement signatures.

Conclusions

Distribution analysis revealed individual patterns of abnormal coordination in stroke survivors and changes in these patterns with training. These findings were not apparent from scalar metrics that simply summarized properties of motor exploration. Our results suggest new methods for characterizing motor capabilities, and could provide the basis for powerful tools for designing customized therapy.