Normative data, preliminary inter-rater reliability and predictive validity of the Drive Home Maze Test

Methods to evaluate driving competence for people with acquired brain injury (ABI): A systematic review

Driving is essential for independence, community involvement and quality of life. Driving is the primary transportation method in Saudi Arabia. Despite the high rates of brain injuries and disability in Saudi Arabia, currently there are no guidelines regarding driver assessment and rehabilitation to facilitate people with brain injuries to resume driving. Therefore, this systematic review aimed to understand the assessment methods used internationally to evaluate driving competence for people with acquired brain injuries (ABI). A systematic search of six electronic databases was conducted by two authors and twenty-six studies were identified for review. Four main approaches to driver assessment: clinical assessments such as neuropsychological tests, off-road screening tools, simulator testing, and comprehensive driving assessment were identified. However, our findings revealed a lack of consistency in their use to assess driving competence after ABI. On-road driving performance tests were predominantly used to determine driving competence either independently or in combination with another method in over two-thirds of the reviewed studies. While clinical assessments of cognitive impairments showed some capacity to predict driving performance of people with ABI, they should be used with caution since they cannot replace on-road driving performance tests. Driver assessment should be part of rehabilitation following high prevalence conditions such as ABI. This systematic review offers guidance for Saudi clinicians, as well as policymakers, about providing rehabilitation services for people with ABI, and recommendations for further research and collaborations to improve this much-needed area of practice.

Maze test score time adjustments when using nondominant hand in fitness-to-drive assessments

Drivers with medical conditions may need to demonstrate their fitness by participating in clinical and on-road assessments. Scores from the clinic-based occupational therapy-drive home maze test (OT-DHMT) can contribute to fitness-to-drive recommendations. The OT-DHMT is a short, timed test that has previously been shown to be valid and reliable, and norms are available for completion with a driver's dominant hand. Following stroke or trauma, many drivers need to complete assessments and resume driving using their nondominant hand. The validity of a person's OT-DHMT score when completed with a nondominant hand is unknown. This study investigated if a person's OT-DHMT score time requires adjustment when completed with a nondominant hand. The OT-DHMT was administered with a convenience sample of 148 community-dwelling participants, aged 21-81 years (M = 48.6, SD = 19.38) using both their dominant and nondominant hands, in a random order. OT-DHMT score times were significantly faster when using dominant (M = 15.73) compared with nondominant (M = 17.64) hand, d = 1.91 [confidence interval (CI) 1.13, 2.69], t = 4.84, P < 0.01. Employing a generalized weighted least squares regression model indicated that multiplying a driver's nondominant hand time by 0.833 s for drivers aged ≤60, and by 0.929 s for drivers aged 61+ can approximate dominant hand completion times. The OT-DHMT has been validated for use with people using their nondominant hand. Time adjustments are required for people using their nondominant hand when completing the OT-DHMT, and a larger adjustment is required for people aged ≤60 reinforcing previous findings that younger people have faster OT-DHMT completion times.

Development and Evaluation of Maze-Like Puzzle Games to Assess Cognitive and Motor Function in Aging and Neurodegenerative Diseases

There is currently a need for engaging, user-friendly, and repeatable tasks for assessment of cognitive and motor function in aging and neurodegenerative diseases. This study evaluated the feasibility of a maze-like Numberlink puzzle game in assessing differences in game-based measures of cognition and motor function due to age and neurodegenerative diseases. Fifty-five participants, including young (18-31 years, n = 18), older (64-79 years, n = 14), and oldest adults (86-98 years, n = 14), and patients with Parkinson's (59-76 years, n = 4) and Huntington's disease (HD; 35-66 years, n = 5) played different difficulty levels of the Numberlink puzzle game and completed usability questionnaires and tests for psychomotor, attentional, visuospatial, and constructional and executive function. Analyses of Numberlink game-based cognitive (solving time and errors) and motor [mean velocity and movement direction changes (MDC)] performance metrics revealed statistically significant differences between age groups and between patients with HD and older adults. However, patients with Parkinson's disease (PD) did not differ from older adults. Correlational analyses showed significant associations between game-based performance and movement metrics and performance on neuropsychological tests for psychomotor, attentional, visuospatial, and constructional and executive function. Furthermore, varying characteristics of the Numberlink puzzle game succeeded in creating graded difficulty levels. Findings from this study support recent suggestions that data from a maze-like puzzle game provide potential "digital biomarkers" to assess changes in psychomotor, visuoconstructional, and executive function related to aging and neurodegeneration. In particular, game-based movement measures from the maze-like puzzle Numberlink games are promising as a tool to monitor the progression of motor impairment in neurodegenerative diseases. Further studies are needed to more comprehensively establish the cognitive validity and test-retest reliability of using Numberlink puzzles as a valid cognitive assessment tool.

Cognitive prerequisites for fitness to drive: Norm values for the TMT, UFOV and NorSDSA tests

Background: Fitness-to-drive assessment is a growing area for occupational therapists. There are few off-road tests specially developed to assess fitness to drive, and several cognitive tests have no age-specific norms.Aims/objectives: The aim was to identify and describe age-related norm values for the Trail Making Test, Nordic Stroke Driver Screening Assessment and Useful Field of View test, and to study inter-correlation between test results.Materials and methods: The sample included 410 volunteers; 149 men and 261 women, mean age 52 ± 16.8 years. Commonly used off-road tests were used: TMT A and B, UFOV and NorSDSA.Results: Normative data for the specific subtests and total score for NorSDSA and UFOV are provided and presented in four age groups. Age correlated with the results for most of the subtests.Conclusions: Off-road cognitive test scores are necessary and valuable for occupational therapists in their contribution to the final decision on continued driving. In clinical practice, it can be difficult to interpret cognitive test results when working with driving assessments. Age-based norm values are suggested to be a way to provide clinicians with a benchmark against which scores can be compared.Significance: Age-based norms can guide occupational therapists working with fitness to drive.

Effect of Navigation Problems, Assessment Location, and a Practice Test on Driving Assessment Performance for People with Alzheimer's Disease

BACKGROUND

People with Alzheimer's disease may be required to undertake clinical and on-road assessments to determine fitness to drive. The manner in which on-road assessments are conducted with drivers who do and do not have navigational problems may affect the outcome.

OBJECTIVES

Investigate the effect of 1) navigational difficulties, 2) location of assessment (un/familiar area) and assessment order, and 3) undertaking a second assessment (practice), on passing an on-road driving assessment.

METHODS

Forty-three drivers undertook an Occupational Therapy-Driver Assessment Off Road Assessment (OT-DORA) Battery which included the Drive Home Maze Test (DHMT). Participants with/without a history of navigational problems were randomly allocated into three groups: 1) Unfamiliar/then familiar area assessment; 2) Unfamiliar/unfamiliar; 3) familiar/unfamiliar. An on-road assessment protocol was used including over 100 expected behaviors at nominated points along the directed route. For familiar area assessments, the driver self-navigated from their home to shops and services. A pass/fail decision was made for each assessment.

RESULTS

A generalized linear mixed effects model showed neither location, nor practice affected passing the on-road assessment. Participants with navigational problems were six times less likely to pass regardless of route familiarity and direction method, and the DHMT was a significant negative predictor of passing.

CONCLUSION

Drivers with Alzheimer's disease who have navigational problems and are slow to complete the DHMT are unlikely to pass an on-road assessment. However, navigation and maze completion skills may be a proxy for an underlying cognitive skill underpinning driving performance.

Predicting fitness-to-drive following stroke using the Occupational Therapy - Driver Off Road Assessment Battery

Introduction: It is difficult to determine if, or when, individuals with stroke are ready to undergo on-road fitness-to-drive assessment. The Occupational Therapy - Driver Off Road Assessment Battery was developed to determine client suitability to resume driving. The predictive validity of the Battery needs to be verified for people with stroke. Aim: Examine the predictive validity of the Occupational Therapy - Driver Off Road Assessment Battery for on-road performance among people with stroke. Method: Off-road data were collected from 148 people post stroke on the Battery and the outcome of their on-road assessment was recorded as: fit-to-drive or not fit-to-drive. Results: The majority of participants (76%) were able to resume driving. A classification and regression tree (CART) analysis using four subtests (three cognitive and one physical) from the Battery demonstrated an area under the curve (AUC) of 0.8311. Using a threshold of 0.5, the model correctly predicted 98/112 fit-to-drive (87.5%) and 26/36 people not fit-to-drive (72.2%). Conclusion: The three cognitive subtests from the Occupational Therapy - Driver Off Road Assessment Battery and potentially one of the physical tests have good predictive validity for client fitness-to-drive. These tests can be used to screen client suitability for proceeding to an on-road test following stroke. Implications for Rehabilitation: Following stroke, drivers should be counseled (including consideration of local legislation) concerning return to driving. The Occupational Therapy - Driver Off Road Assessment Battery can be used in the clinic to screen people for suitability to undertake on road assessment. Scores on four of the Occupational Therapy - Driver Off Road Assessment Battery subtests are predictive of resumption of driving following stroke.

Effect of Speed of Processing Training on Older Driver Screening Measures

Objective: Computerized training for cognitive enhancement is of great public interest, however, there is inconsistent evidence for the transfer of training gains to every day activity. Several large trials have focused on speed of processing (SOP) training with some promising findings for long-term effects on daily activity, but no immediate transfer to other cognitive tests. Here, we examine the transfer of SOP training gains to cognitive measures that are known predictors of driving safety in older adults. Methods: Fifty-three adults aged 65-87 years who were current drivers participated in a two group non-randomized design with repeated measures and a no-contact matched control group. The Intervention group completed an average of 7.9 (SD = 3.0) hours of self-administered online SOP training at home. Control group was matched on age, gender and test-re-test interval. Measures included the Useful Field of View (UFOV) test, a Hazard Perception test, choice reaction time (Cars RT), Trail Making Test B, a Maze test, visual motion threshold, as well as road craft and road knowledge tests. Results: Speed of processing training resulted in significant improvement in processing speed on the UFOV test relative to controls, with an average change of -45.8 ms (SE = 14.5), and effect size of ω2 = 0.21. Performance on the Maze test also improved, but significant slowing on the Hazard Perception test was observed after SOP training. Training effects on the UFOV task was associated with similar effects on the Cars RT, but not the Hazard Perception and Maze tests, suggesting transfer to some but not all driving related measures. There were no effects of training on any of the other measures examined. Conclusion: Speed of processing training effects on the UFOV task can be achieved with self-administered, online training at home, with some transfer to other cognitive tests. However, differential effects of training may be observed for tasks requiring goal-directed search strategies rather than diffuse attention.

Determining fitness to drive among drivers with Alzheimer’s disease or cognitive decline

Introduction

Fitness to drive skills progressively deteriorate following a diagnosis of Alzheimer’s disease/cognitive decline. Occupational therapists require standardised assessments to help them make recommendations to clients and licensing authorities regarding client fitness to drive. This research aimed to determine whether drivers in the early stages of Alzheimer’s disease/cognitive decline can drive safely, and if this could be predicted using the occupational therapy – driver off-road assessment battery (OT-DORA Battery).

Method

Drivers with Alzheimer’s disease/cognitive decline were assessed by one of nine driver assessors over 18 months. Client data were collected on the OT-DORA Battery and following on-road assessment; the outcome was recorded as pass, pass with conditions, or fail.

Results

A total of 63 clients were assessed, and n  =  40 (63.5%) were passed as fit to drive, of whom 33(83%) had at least one condition placed on their licence. Client age and scores on four subtests of the OT-DORA Battery were predictive of outcome.

Conclusion

A diagnosis of Alzheimer’s disease/cognitive decline should not automatically preclude driving. Scores on four of the subtests from the OT-DORA Battery may be used to help determine whether a client is fit to drive or not fit to drive, or whether a client should be referred for specialist occupational therapy driver assessment.

Screening and assessment tools for determining fitness to drive: a review of the literature for the pathways project

With a brief introduction, 10 tables summarize the findings from the literature describing screening and assessment tools used with older adults to identify risk or determine fitness to drive. With a focus on occupational therapy's duty to address driving as a valued activity, this paper offers information about tools used by occupational therapy practitioners across practice settings and specialists in driver rehabilitation. The tables are organized into groups of key research studies of assessment tools, screening batteries, tools used in combination (i.e., as a battery), driving simulation as an assessment tool, and screening/assessment for individuals with stroke, vision impairment, Parkinson's disease, dementia, and aging. Each table has a summary of important concepts to consider as occupational therapists choose the methods and tools to evaluate fitness to drive.

Fitness-to-drive after mild traumatic brain injury: mapping the time trajectory of recovery in the acute stages post injury

INTRODUCTION

Little is known about the trajectory of recovery in fitness-to-drive after mild traumatic brain injury (mTBI). This means that health-care professionals have limited evidence on which to base recommendations to this cohort about driving.

OBJECTIVE

To determine fitness-to-drive status of patients with a mTBI at 24h and two weeks post injury, and to summarise issues reported by this cohort about return to driving.

METHOD

Quasi-experimental case-control design. Two groups of participants were recruited: patients with a mTBI (n=60) and a control group with orthopaedic injuries (n=60). Both groups were assessed at 24h post injury on assessments of fitness-to-drive. Follow-up occurred at two weeks post injury to establish driver status.

MAIN MEASURES

Mini mental state examination, occupational therapy-drive home maze test (OT-DHMT), Road Law Road Craft Test, University of Queensland-Hazard Perception Test, and demographic/interview form collected at 24h and at two weeks.

RESULTS

At the 24h assessment, only the OT-DHMT showed a difference in scores between the two groups, with mTBI participants being significantly slower to complete the test (p=0.01). At the two week follow-up, only 26 of the 60 mTBI participants had returned to driving. Injury severity combined with scores from the 24h assessment predicted 31% of the variance in time taken to return to driving. Delayed return to driving was reported due to: "not feeling 100% right" (n=14, 23%), headaches and pain (n=12, 20%), and dizziness (n=5, 8%).

CONCLUSION

This research supports existing guidelines which suggest that patients with a mTBI should not to drive for 24h; however, further research is required to map factors which facilitate timely return to driving.

Car drivers with dementia: Different complications due to different etiologies?

OBJECTIVE

Older drivers with dementia are an at-risk group for unsafe driving. However, dementia refers to various etiologies and the question is whether dementias of different etiology have similar effects on driving ability.

METHODS

The literature on the effects of dementia of various etiologies on driving ability is reviewed. Studies addressing dementia etiologies and driving were identified through PubMed, PsychINFO, and Google Scholar.

RESULTS AND CONCLUSIONS

Early symptoms and prognoses differ between dementias of different etiology. Therefore, different etiologies may represent different likelihoods with regard to fitness to drive. Moreover, dementia etiologies could indicate the type of driving problems that can be expected to occur. However, there is a great lack of data and knowledge about the effects of almost all etiologies of dementia on driving. One could hypothesize that patients with Alzheimer's disease may well suffer from strategic difficulties such as finding a route, whereas patients with frontotemporal dementia are more inclined to make tactical-level errors because of impaired hazard perception. Patients with other dementia etiologies involving motor symptoms may suffer from problems on the operational level. Still, the effects of various etiologies of dementias on driving have thus far not been studied thoroughly. For the detection of driving difficulties in patients with dementia, structured interviews with patients but also their family members appear crucial. Neuropsychological assessment could support the identification of cognitive impairments. The impact of such impairments on driving could also be investigated in a driving simulator. In a driving simulator, strengths and weaknesses in driving behavior can be observed. With this knowledge, patients can be advised appropriately about their fitness to drive and options for support in driving (e.g., compensation techniques, car adaptations). However, as long as no valid, reliable, and widely accepted test battery is available for the assessment of fitness to drive, costly on-road test rides are inevitable. The development of a fitness-to-drive test battery for patients with dementia could provide an alternative for these on-road test rides, on condition that differences between dementia etiologies are taken into consideration.

Determining fitness to drive: A systematic review of the methods and assessments used after mild traumatic brain injury

Introduction

Limited evidence is available to support knowledge of the time-frame and capacity for fitness to drive after mild traumatic brain injury. The aim of this systematic review was to identify what methods and assessments are, or could be used to determine fitness to drive for this population.

Method

We undertook a systematic search of six electronic databases. Two authors rated all studies for methodological content and quality, and standardised data were extracted. Narrative analysis was conducted to understand the content of eligible studies.

Findings

A total of 2022 articles were retrieved; seven articles met the inclusion criteria. Self-reported questionnaires, non-standardised assessments, questionnaires completed by next-of-kin, and simulator tests were the primary methods used to determine fitness to drive. Only one assessment has been used to aid recommendations about fitness to drive in the acute hospital setting. Six additional standardised assessments were identified that have the potential to predict fitness to drive in this population group; however, these assessments require further psychometric testing prior to use.

Conclusion

While a variety of methods and assessments are currently used, there is little research evidence to suggest when individuals are able to return to driving after mild traumatic brain injury. Research is urgently required to determine a consistent and standardised approach to assessing fitness to drive following mild traumatic brain injury.

Cognitive and visual predictors of UFOV performance in older adults

Eighty two community dwelling older adults (52 females) aged 62-92 years (mean=75) completed a battery of cognitive and visual tests selected to assess functions relevant to driving performance. These were visual acuity, contrast sensitivity, general mental competence (Mini Mental State Examination, MMSE), processing speed (Inspection Time, IT), crowding across the visual field (Proficiency of Peripheral Vision Processing, ProPerVis) and change detection (DriverScan). These six tasks provided predictor variables for performance on the Useful Field of View test (UFOV), a well validated test of fitness to drive that includes subtests for (i) processing speed; (ii) divided attention; and (iii) selective attention. Relative importance regression analyses confirmed that UFOV is sensitive to attentional and speed processes but suggested that subtest (i) primarily reflects visual acuity and contrast sensitivity; subtest (ii) is better explained by change detection and processing speed; and subtest (iii) predominantly reflects crowding and contrast sensitivity. Unexpectedly, given no evidence of substantial cognitive decline, MMSE contributed significantly to performance on the more complex subtests (ii) and (iii).

Validity of the Occupational Therapy-Drive Home Maze Test for right and left handed test takers

The Occupational Therapy-Drive Home Maze Test (OT-DHMT) is part of the OT-DORA Battery used in licensing recommendations for older and/or functionally impaired drivers. Previously published research has been conducted to investigate the predictive validity, inter-rater reliability and establish norms for this timed test with normal and cognitively impaired drivers. Anecdotal evidence from this research indicated there could be a bias against right-handers (dextrals) who may need to lift their hand to view the maze, thus increasing the time taken. Therefore this study investigated the validity of the OT-DHMT when administered to left and right handed individuals. The OT-DHMT was individually administered to a new sample of 144 healthy drivers aged 18-69 years. From this, 34 participant pairs were matched for age and gender, according to their dexterity. The results show that there were no significant differences in time taken when completing the maze test, for participants who complete the test with either writing hand t(33)=1.59, p=0.12 (95%CI: -0.63 to 5.08). While further testing is required with samples from different cultures and with more participants aged 30-69 and 70 years and over to extend generalizability of these findings, the results suggest the OT-DHMT is suitable to be administered and scored using the methods published as part of the OT-DORA Battery.

Development of a standardised Occupational Therapy--Driver Off-Road Assessment Battery to assess older and/or functionally impaired drivers

INTRODUCTION

Research has been conducted over several years to develop a new off-road assessment battery referred to as the Occupational Therapy - Driver Off-Road Assessment Battery. This article documents the development of the Battery, and provides preliminary research evidence to support its content and predictive validity.

METHODS

Literature reviews and a focus group with nine driver assessor occupational therapists were undertaken, as well as data collection using the Occupational Therapy - Driver Off-Road Assessment Battery with 246 clients. A Classification and Regression Tree model was constructed to ascertain the predictive validity of the Battery, with fitness-to-drive as the outcome.

RESULTS

Twenty-one physical, 13 sensory and seven assessments of cognition/perception were identified as being reflective of the skills required for driving. Following rating of their psychometric properties, the best assessments were presented to focus group members. The driver assessors supported the inclusion of several assessments and encouraged the development of new assessments. A draft version of the Occupational Therapy - Driver Off-Road Assessment Battery was tested and found to have excellent predictive validity for client on-road performance of 82.6%. The Classification and Regression Tree model showed that client performance on tests included in the Battery should be used together, rather than in isolation, to support fitness-to-drive recommendations.

CONCLUSION

This research identified the most suitable physical, sensory and cognitive assessments to include in the Occupational Therapy - Driver Off-Road Assessment Battery, and provided support for its validity. The development of this standardised battery assists driver assessors to accurately and consistently assess and report the off-road driving capacity of clients.

Assessing executive function in relation to fitness to drive: a review of tools and their ability to predict safe driving

BACKGROUND/AIM

The assessment of executive functions is an integral component in determining fitness to drive. A structured review was conducted to identify assessment tools used to measure executive function in relation to driving and to describe these tools according to: (i) specific executive function components assessed; (ii) the tool's validity in predicting safe driving; and (iii) clinical utility.

METHODS

Sixty-nine articles were reviewed, identifying 53 executive function tools/assessments used in driving research. Each tool was critically appraised and the findings were compiled in a Driving Executive Function Tool Guide.

RESULTS

Among the 53 tools, there were 27 general assessments of cognition, 19 driving-specific and seven activities of daily living/instrumental activities of daily living assessments. No single tool measured all executive function components: working memory was the most common (n = 20/53). Several tools demonstrated strong predictive validity and clinical utility. For example, tools, such as the Trail Making Test and the Maze Task, have the shortest administration time (i.e. often less than 10 minutes) and the most easily accessible method of administration (i.e. pen and paper or verbal). Driving-specific tools range from short questionnaires, such as the 10-minute Manchester Driving Behaviour Questionnaire, to more complex tools requiring about 45 minutes to administer. CONCLUSIONS AND SIGNIFICANCE OF THE STUDY: The appropriateness of a tool depends on the individual being assessed and on practical constraints of the clinical context. The Driving Executive Function Tool Guide provides useful information that should facilitate decision-making and selection of appropriate executive function tools in relation to driving.

Interrater Reliability of the Road Law and Road Craft Test as Part of the OT-DORA Battery for Off-Road Driver Assessment

Background:

The Occupational Therapy Driver Off Road Assessment (OT-DORA) Battery is in development as a comprehensive off-road evaluation of fitness to drive. Although several psychometric properties of the Road Law and Road Craft Test (RLRCT) have been previously studied, interrater reliability must also be established to include this test in the battery.

Aim:

The aim of the study was to determine the interrater reliability of the RLRCT.

Method:

Three occupational therapy driver assessors independently scored 20 client responses on the 14-item RLRCT.

Results:

The interrater reliability for all items, except item 6, was found to be between 0.57 and 1.00. The scoring instructions for item 6 were revised and the interrater reliability rose from 0.42 to 0.77.

Conclusion:

The RLRCT has been found to be reliable when administered by different raters and is thus suitable for inclusion in the OT-DORA Battery. Ongoing research to confirm the psychometric properties of the RLRCT is required.