Reliability and validity of on-road driving tests in vulnerable adults: a systematic review

Parkinson's Disease and Driving Fitness: A Systematic Review of the Existing Guidelines

BACKGROUND

Motor/nonmotor symptomatology and antiparkinsonian drugs deteriorate the driving ability of Parkinson's disease (PD) patients.

OBJECTIVES

Treating neurologists are frequently asked to evaluate driving fitness of their patients and provide evidence-based consultation. Although several guidelines have been published, the exact procedure along with the neurologist's role in this procedure remains obscure.

METHODS

We systematically reviewed the existing guidelines, regarding driving fitness evaluation of PD patients. We searched MEDLINE and Google Scholar and identified 109 articles. After specified inclusion criteria were applied, 15 articles were included (nine national guidelines, five recommendation papers, and one consensus statement).

RESULTS

The treating physician is proposed as the initial evaluator in 8 of 15 articles (neurologist in 2 articles) and may refer patients for a second-line evaluation. The evaluation should include motor, cognitive, and visual assessment (proposed in 15, 13, and 8 articles, respectively). Specific motor tests are proposed in eight articles (cutoff values in four), whereas specific neuropsychological and visual tests are proposed in seven articles each (cutoff values in four and three articles, respectively). Conditional licenses are proposed in 11 of 15 articles, to facilitate driving for PD patients. We summarized our findings on a graphic of the procedure for driving fitness evaluation of PD patients.

CONCLUSIONS

Neurological aspects of driving fitness evaluation of PD patients are recognized in most of the guidelines. Motor, neuropsychological, visual, and sleep assessment and medication review are key components. Clear-cut instructions regarding motor, neuropsychological, and visual tests and relative cutoff values are lacking. Conditional licenses and periodical reevaluation of driving fitness are important safety measures.

Performance Analysis of Driving Ability (P-Drive): Investigating Construct Validity and Concordance of Australasian Data

On-road assessment is optimal for determining medical fitness-to-drive but unreliable if determined by global pass/fail decisions alone. Occupational therapists need standardized, psychometrically sound on-road scoring procedures. Performance Analysis of Driving Ability (P-Drive) is a promising on-road test developed in Sweden, but it has not been standardized for Australasia. We investigated the psychometric properties and concordance with an on-road decision of data gathered with the Australasian version of P-Drive. P-Drive was administered to older and cognitively impaired drivers (N = 134) aged 18 to 91 years (mean age 68) who were referred to 10 driving clinics in Australia and New Zealand to determine driving performance. Rasch analysis provided evidence for construct validity and concordance of the data gathered. An optimal cut-off score of 85 was set, yielding evidence of good sensitivity at 88% and specificity at 88%. The Australasian version of P-Drive produces valid and reliable data regarding on-road driving performance.

Using Serial Trichotomization to Determine Fitness to Drive in Medically At-Risk Drivers

IMPORTANCE

Clinical tests that identify fit and unfit drivers with 100% sensitivity and specificity would reduce uncertainty and improve efficiency of occupational therapists performing comprehensive driving evaluations (CDEs).

OBJECTIVE

To examine whether serial trichotomization of clinical tests predicts pass-fail outcomes with 100% sensitivity and specificity in a sample of medically at-risk drivers and in drivers with and without cognitive impairment (CI) referred for a CDE.

DESIGN

Retrospective data collection and analysis of scores on the Montreal Cognitive Assessment; Trail Making Test, Part A and Part B; and the Useful Field of View® Subtests 1 to 3 and outcomes on the CDE (pass-fail or indeterminate requiring lessons and retesting). Receiver operating characteristic curves of clinical tests were performed to determine 100% sensitivity and specificity cut points in predicting CDE outcomes. Clinical tests were arranged in order from most to least predictive to identify pass-fail and indeterminate outcomes.

SETTING

A driving assessment clinic.

PARTICIPANTS

Among 142 medically at-risk drivers (M age = 69.2 yr, SD = 14.1), 66 with CI, 46 passed and 39 failed the CDE; 57 were indeterminate.

OUTCOMES AND MEASURES

On-road pass-fail outcomes.

RESULTS

Together, the six clinical tests predicted 62 pass and 49 fail outcomes in the total sample; 21 pass and 34 fail outcomes in participants with CI; and 58 pass and 14 fail outcomes in participants without CI.

CONCLUSIONS AND RELEVANCE

Serial trichotomization of clinical tests increases the accuracy of making informed decisions and reduces the number of drivers undergoing unnecessary on-road assessments. Plain-Language Summary: Clinical tests and their cut points that identify fit and unfit drivers vary substantially across settings and research studies. Serial trichotomization is one method that could help control for this variation by combining clinical test scores showing 100% sensitivity and specificity to identify pass (fit drivers) and fail outcomes (unfit drivers) and to reduce the number of drivers undergoing unnecessary on-road assessments.

Neuropsychological domains and fitness to drive in mild cognitive impairment or Alzheimer's disease

Cognitive deficits associated with mild cognitive impairment (MCI) or Alzheimer's disease (AD) can impact driving. This integrative review investigated which cognitive domains were associated with poor driving performance or unfitness to drive in studies with outcomes measured in simulator or on-road driving in patients with MCI or AD. The review was conducted by searching for articles published between 2001 and 2020 in the MEDLINE (via PubMed), EMBASE, and SCOPUS databases. Studies addressing patients with other dementias (e.g., vascular or mixed dementia, Lewy body dementia, Parkinson's disease) were excluded. Of 404 articles initially selected, 17 met the eligibility criteria for this review. Based on the findings of this integrative review, attentional capacity, processing speed, executive functions and visuospatial skills were the functions whose declines were most frequently reported in a context of unsafe driving by older adults with MCI or AD. Reports were remarkably heterogeneous in methodological aspects whereas quite limited in cross-cultural coverage and in sample recruited, what prompts for further trials in the field.

Evaluation of Psychophysical Fitness in Drivers over 65 Years of Age

BACKGROUND

The deterioration of cognitive and psychophysical ability associated with aging has an effect on road safety, especially in the driving of vehicles. The current study's main objective is to evaluate the psychophysical aptitudes in drivers over 65 years of age in a sample of drivers in Spain.

METHODS

The sample was formed of a total of 1663 drivers who attended a Driver Recognition Center. The evaluation of their psychophysical aptitudes was carried out following the Medical-Psychological Exploration Protocol for Driver Recognition Centers, edited by the Ministry of Health and the General Directorate of Traffic.

RESULTS

The results show increased restrictions in the evaluation of driving ability with age, which are especially significant after 75 years of age. Regarding sex, 70.1% of women have an approved evaluation, compared to men aged between 65-69, although from 69 onwards, the percentage of approved women decreases significantly. The loss of visual capabilities and poor performance in psycho-technical tests are the main causes associated with an evaluation with restrictions, with the number of restrictive conditions increasing with age.

CONCLUSIONS

There is an increase in the number of cases with age-related restrictions, especially in the case of women and ophthalmologic-related problems, although the majority of drivers over 65 years old continue driving, thus continuing with a practice that has been related to the well-being and quality of life of older adults.

Self-awareness predicts fitness to drive among adults referred to occupational therapy evaluation

Background

Driving is associated with independence, well-being, quality of life, and an active lifestyle. Driving requires cognitive, motor, and visual skills, including self-awareness and processing speed. This study examines whether driver self-awareness, motor processing speed, and cognitive processing speed can predict fitness to drive among individuals referred to occupational therapy evaluation due to concerns about their driving ability.

Method

In this cross-sectional study, 39 participants were referred to off- and on-road driving evaluation to determine their fitness to drive due to changes in health status, advanced age, license renewal requirement, or prior automobile accidents. A registered occupational therapist (OT) classified 23 of the participants as fit to drive and 16 as unfit to drive. Motor and cognitive processing speed were assessed by the Stationary Perception-Reaction Timer and the Color Trails Test, respectively. Driving self-awareness was assessed by comparing the DI and OT evaluations to the participants' estimation of their own on-road driving performance.

Results

The fit-to-drive participants had a better motor and cognitive processing speed than those unfit-to-drive. The unfit-to-drive group overestimated their driving ability, whereas the fit-to-drive group accurately or almost accurately estimated their driving ability. Driving self-awareness was a significant predictor of participants' fitness to drive.

Conclusions

This study demonstrates the importance of self-awareness for predicting fitness to drive among people at risk for compromised driving skills. Thus, driving self-awareness should be addressed as part of fitness-to-drive evaluations and interventions.

Validation of Vehicle Driving Simulator from Perspective of Velocity and Trajectory Based Driving Behavior under Curve Conditions

With their advantages of high experimental safety, convenient setting of scenes, and easy extraction of control parameters, driving simulators play an increasingly important role in scientific research, such as in road traffic environment safety evaluation and driving behavior characteristics research. Meanwhile, the demand for the validation of driving simulators is increasing as its applications are promoted. In order to validate a driving simulator in a complex environment, curve road conditions with different radii are considered as experimental evaluation scenarios. To attain this, this paper analyzes the reliability and accuracy of the experimental vehicle speed of a driving simulator. Then, qualitative and quantitative analysis of the lateral deviation of the vehicle trajectory is carried out, applying the cosine similarity method. Furthermore, a data-driven method was adopted which takes the longitudinal displacement, lateral displacement, vehicle speed and steering wheel angle of the vehicle as inputs and the lateral offset as the output. Thus, a curve trajectory planning model, a more comprehensive and human-like operation, is established. Based on directional long short-term memory (Bi–LSTM) and a recurrent neural network (RNN), a multiple Bi–LSTM (Mul–Bi–LSTM) is proposed. The prediction performance of LSTM, MLP model and Mul–Bi–LSTM are compared in detail on the validation set and testing set. The results show that the Mul–Bi–LSTM model can generate a trajectory which is very similar to the driver’s curve driving and have a preferable generalization performance. Therefore, this method can solve problems which cannot be realized in real complex scenes in the simulator validation. Selecting the trajectory as the validation parameter can more comprehensively and intuitively reflect the simulator’s curve driving state. Using a speed model and trajectory model instead of a real car experiment can improve the efficiency of simulator validation and lay a foundation for the standardization of simulator validation.

On-Road Driving Assessment in a Driving School Course and the Results of a Cognitive Function Test After Stroke in a Depopulated Rural Area in Japan: Case Series of Eight Patients

Introduction

Returning to driving after a stroke is a step toward independence and improving quality of life. Cognitive function after stroke is one of the essential factors that affect driving ability, and on-road driving assessment in driving school courses is beginning to spread in Japan. We started on-road driving assessment in 2018, and we herein report eight patients who underwent on-road driving assessment in the last three years, presenting both off-road cognitive function tests and on-road driving assessment results.

Methods

Of the 320 consecutive stroke patients from 2018 to 2020, we retrospectively investigated the eight patients’ characteristics who underwent on-road driving assessment. We performed cognitive function tests, including behavioral inattention test (BIT), trail-making test, Wechsler Adult Intelligence Scale-III, and behavioral assessment of the dysexecutive syndrome. Patients who meet BIT > 35, at least three other subitem criteria, and no unevaluable subitems can undergo on-road driving assessment by a driving instructor. With the recommendation of the driving instructors, we comprehensively decided the permission to drive.

Results

All eight patients could return to driving after on-road driving assessment. Two patients could return to driving after nearly a year.

Conclusion

The patients did not meet all the cut-offs of the cognitive function test, but they were judged to return to driving by driving instructors. We finally permitted all eight patients to drive. On-road driving assessment in the driving school course might be helpful for determining the permission to return to driving.

Standardized on-road tests assessing fitness-to-drive in people with cognitive impairments: A systematic review

Objective

The on-road assessment is the gold standard because of its ecological validity. Yet existing instruments are heterogeneous and little is known about their psychometric properties. This study identified existing on-road assessment instruments and extracted data on psychometric properties and usability in clinical settings.

Method

A systematic review identified studies evaluating standardized on-road evaluation instruments adapted for people with cognitive impairment. Published articles were searched on PubMed, CINHAL, PsycINFO, Web of Science, and ScienceDirect. Study quality and the level of evidence were assessed using the COSMIN checklist. The collected data were synthetized using a narrative approach. Usability was subjectively assessed for each instrument by extracting information on acceptability, access, cost, and training.

Results

The review identified 18 published studies between 1994 and 2016 that investigated 12 different on-road evaluation instruments: the Performance-Based Driving Evaluation, the Washington University Road Test, the New Haven, the Test Ride for Practical Fitness to Drive, the Rhode Island Road Test, the Sum of Manoeuvres Score, the Performance Analysis of Driving Ability, the Composite Driving Assessment Scale, the Nottingham Neurological Driving Assessment, the Driving Observation Schedule, the Record of Driving Errors, and the Western University’s On-road Assessment. Participants were mainly male (64%), between 48 and 80 years old, and had a broad variety of cognitive disorders. Most instruments showed reasonable psychometric values for internal consistency, criterion validity, and reliability. However, the level of evidence was poor to support any of the instruments given the low number of studies for each.

Conclusion

Despite the social and health consequences of decisions taken using these instruments, little is known about the value of a single evaluation and the ability of instruments to identify expected changes. None of the identified on-road evaluation instruments seem currently adapted for clinical settings targeting rehabilitation and occupational priorities rather than road security alone.

Study registration

PROSPERO registration number CRD42018103276.