Neuropsychological Evaluation in Traumatic Brain Injury

Disentangling subjective symptom complaints and objective cognitive performance in veterans: Impact of posttraumatic stress disorder and lifetime traumatic brain injury burden

Self-reported histories of mild traumatic brain injury (mTBI) and posttraumatic stress disorder (PTSD) symptoms are prevalent among post-9/11 veterans. Both are associated with subjective and often overlapping symptom complaints, but variably with objective neuropsychological test performances. These outcomes are seldom explored in relation to lifetime mTBI burden. This cross-sectional study examined associations of PTSD and lifetime mTBI with subjective (persistent symptoms after concussion and cognitive complaints) and objective (performances across five cognitive domains) measures among 46 veterans. Within this sample, 20 veterans had Clinician-Administered PTSD Scale for DSM-5 (CAPS-5) confirmed PTSD (PTSD+), whereas 26 demographically-similar participants did not meet criteria (PTSD-). The Boston Assessment of Traumatic Brain Injury-Lifetime (BAT-L) yielded total mTBI scores ranging from 0 to 8. Regressions showed PTSD was associated with increased subjective symptoms/cognitive complaints, along with reduced verbal fluency, visuospatial memory, and processing speed performances. Lifetime mTBI burden was associated with subjective symptoms, but not with objective cognitive test performance, after controlling for PTSD. No significant interactions were observed. Exploratory correlations suggested that all PTSD symptom clusters were generally associated with the subjective and objective measures. However, fewer significant associations emerged within the PTSD+/- groups separately, with each group yielding somewhat different patterns of relationships. PTSD and increasing mTBI burden are consistently associated with negative subjective symptoms, including cognitive complaints. Each condition likely explains some degree of unique variance in symptom reporting. PTSD is associated with poorer objective cognition on some tasks, including processing speed, executive functioning, and learning/memory. Implications are explored.

Neuropsychological Assessment in Patients with Traumatic Brain Injury: A Comprehensive Review with Clinical Recommendations

Traumatic brain injury is damage to the brain occurring after birth, often resulting in the deterioration of cognitive, behavioural, and emotional functions. Neuropsychological evaluation can assist clinicians to better assess the patient's clinical condition, reach differential diagnoses, and develop interventional strategies. However, considering the multiple rating scales available, it is not easy to establish which tool is most suitable for the different brain injury conditions. The aim of this review is to investigate and describe the most used neurocognitive assessment tools in patients with traumatic brain injury to provide clinicians with clear indications on their use in clinical practice. Indeed, during the acute phase, after the head trauma, alertness and wakefulness of the patients affected by a disorder of consciousness can be assessed using different scales, such as the Coma Recovery Scale-Revised. In both postacute and chronic phases after traumatic brain injury, general cognitive assessment tools (such as the Mini Mental State Examination) or more specific cognitive tests (e.g., Wisconsin Card Sorting Test and Trail Making Test) could be administered according to the patient's functional status. In this way, clinicians may be aware of the patient's neuropsychological and cognitive level, so they can guarantee a personalized and tailored rehabilitation approach in this frail patient population.

Comprehensive Analysis of MMPI-2-RF Symptom Validity Scales and Performance Validity Test Relationships in a Diverse Mixed Neuropsychiatric Setting

The utility of symptom (SVT) and performance (PVT) validity tests has been independently established in neuropsychological evaluations, yet research on the relationship between these two types of validity indices is limited to circumscribed populations and measures. This study examined the relationship between SVTs on the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) and PVTs in a mixed neuropsychiatric setting. This cross-sectional study included data from 181 diagnostically and demographically diverse patients with neuropsychiatric conditions referred for outpatient clinical neuropsychological evaluation at an academic medical center. All patients were administered a uniform neuropsychological battery, including the MMPI-2-RF and five PVTs (i.e., Dot Counting Test; Medical Symptom Validity Test; Reliable Digit Span; Test of Memory Malingering-Trial 1; Word Choice Test). Nonsignificant associations emerged between SVT and PVT performance. Although the Response Bias Scale was most predictive of PVT performance, MMPI-2-RF SVTs generally had low classification accuracy for predicting PVT performance. Neuropsychological test performance was related to MMPI-2-RF SVT status only when overreporting elevations were at extreme scores. The current study further supports that SVTs and PVTs measure unique and dissociable constructs among diverse patients with neuropsychiatric conditions, consistent with literature from other clinical contexts. Therefore, objective evidence of symptom overreporting on MMPI-2-RF SVTs cannot be interpreted as definitively indicating invalid performance on tests of neurocognitive abilities. As such, clinicians should include both SVTs and PVTs as part of a comprehensive neuropsychological evaluation as they provide unique information regarding performance and symptom validity.

A Direct Comparison of 10 WAIS-IV Digit Span Embedded Validity Indicators among a Mixed Neuropsychiatric Sample with Varying Degrees of Cognitive Impairment

Objective

Reliable Digit Span (RDS), RDS-Revised (RDS-R), and age-corrected scaled score (ACSS) have been previously validated as embedded performance validity tests (PVTs) from the Wechsler Adult Intelligence Scale-IV Digit Span subtest (WAIS-IV DS). However, few studies have directly compared the relative utility of these and other proposed WAIS-IV DS validity indicators within a single sample.

Method

This study compared classification accuracies of 10 WAIS-IV DS indices in a mixed neuropsychiatric sample of 227 outpatients who completed a standardized neuropsychological battery. Participants with ≤1 PVT failures of the four, freestanding criterion PVTs constituted the valid group (n = 181), whereas those with ≥2 PVT failures formed the invalid group (n = 46). Among the valid group, 113 met criteria for mild cognitive impairment (MCI).

Results

Classification accuracies for all DS indicators were statistically significant across the overall sample and subsamples with and without MCI, apart from indices derived from the Forward trial in the MCI sample. DS Sequencing ACSS, working memory RDS (wmRDS), and DS ACSS emerged as the most effective predictors of validity status, with acceptable to excellent classification accuracy for the overall sample (AUCs = 0.792–0.816; 35%–50% sensitivity/88%–96% specificity).

Conclusions

Although most DS indices demonstrated clinical utility as embedded PVTs, DS Sequencing ACSS, wmRDS, and DS ACSS may be particularly robust to cognitive impairment, minimizing risk of false positive errors while identifying noncredible performance. Moreover, DS indices incorporating data from multiple trials (i.e., wmRDS, DS ACSS) also generally yielded greater classification accuracy than those derived from a single trial.

Assessment of differential neurocognitive performance based on the number of performance validity tests failures: A cross-validation study across multiple mixed clinical samples

Objective: This cross-sectional study examined the effect of number of Performance Validity Test (PVT) failures on neuropsychological test performance among a demographically diverse Veteran (VA) sample (n = 76) and academic medical sample (AMC; n = 128). A secondary goal was to investigate the psychometric implications of including versus excluding those with one PVT failure when cross-validating a series of embedded PVTs. Method: All patients completed the same six criterion PVTs, with the AMC sample completing three additional embedded PVTs. Neurocognitive test performance differences were examined based on number of PVT failures (0, 1, 2+) for both samples, and effect of number of criterion failures on embedded PVT performance was analyzed among the AMC sample. Results: Both groups with 0 or 1 PVT failures performed better than those with ≥2 PVT failures across most cognitive tests. There were nonsignificant differences between those with 0 or 1 PVT failures except for one test in the AMC sample. Receiver operator characteristic curve analyses found no differences in optimal cut score based on number of PVT failures when retaining/excluding one PVT failure. Conclusion: Findings support the use of ≥2 PVT failures as indicative of performance invalidity. These findings strongly support including those with one PVT failure with those with zero PVT failures in diagnostic accuracy studies, given that their inclusion reflects actual clinical practice, does not reduce sample sizes, and does not artificially deflate neurocognitive test results or inflate PVT classification accuracy statistics.

Assessing performance validity during attention-deficit/hyperactivity disorder evaluations: Cross-validation of non-memory embedded validity indicators

Embedded performance validity tests (PVTs) are key components of neuropsychological evaluations. However, most are memory-based and may be less useful in the assessment of attention-deficit/hyperactivity disorder (ADHD). Four non-memory-based validity indices derived from processing speed and executive functioning measures commonly included in ADHD evaluations, namely Verbal Fluency (VF) and the Trail Making Test (TMT), were cross-validated using the Rey 15-Item Test (RFIT) Recall and Recall/Recognition as memory-based comparison measures. This consecutive case series included data from 416 demographically-diverse adults who underwent outpatient neuropsychological evaluation for ADHD. Validity classifications were established, with ≤1 PVT failure of five independent criterion PVTs as indicative of valid performance (374 valid performers/42 invalid performers). Among the statistically significant validity indicators, TMT-A and TMT-B T-scores (AUCs = .707-.723) had acceptable classification accuracy ranges and sensitivities ranging from 29%-36% (≥89% specificity). RFIT Recall/Recognition produced similar results as TMT-B T-score with 42% sensitivity/90% specificity, but with lower classification accuracy. In evaluating adult ADHD, VF and TMT embedded PVTs demonstrated comparable sensitivity and specificity values to those found in other clinical populations but necessitated alternate cut-scores. Results also support use of RFIT Recall/Recognition over the standard RFIT Recall as a PVT for adult ADHD evaluations.

Evaluation of the classification accuracy of multiple performance validity tests in a mixed clinical sample

The Test of Memory Malingering (TOMM) and Word Memory Test (WMT) are among the most well-known performance validity tests (PVTs) and regarded as gold standard measures. Due to the many factors that impact PVT selection, it is imperative that clinicians make informed clinical decisions with respect to additional or alternative PVTs that demonstrate similar classification accuracy as these well-validated measures. The present archival study evaluated the agreement/classification accuracy of a large battery consisting of multiple other freestanding/embedded PVTs in a mixed clinical sample of 126 veterans. We examined failure rates for all standalone/embedded PVTs using established cut-scores and calculated pass/fail agreement rates and diagnostic odds ratios for various combinations of PVTs using the TOMM and WMT as criterion measures. TOMM and WMT demonstrated the best agreement, followed by Word Choice Test (WCT). The Rey Fifteen Item Test had an excessive number of false-negative errors and reduced classification accuracy. The Digit Span age-corrected scaled score (DS-ACSS) had highest agreement. Findings lend further support to the use of a combination of embedded and standalone PVTs in identifying suboptimal performance. Results provide data to enhance clinical decision making for neuropsychologists who implement combinations of PVTs in a larger clinical battery.

The Experience of Key Stakeholders During the Implementation and Use of Trauma Therapy via Digital Health for Military, Veteran, and Public Safety Personnel: Qualitative Thematic Analysis

Background

Exposure to occupational stressors and potentially psychologically traumatic events experienced by public safety personnel (eg, paramedics, police, fire, and correctional officers), military members, and veterans can lead to the development of posttraumatic stress injuries and other mental health disorders. Providing emergency services during COVID-19 has intensified the challenges. Owing to COVID-19 restrictions, mental health service providers offering support to these populations have had to rapidly pivot to use digital versus in-person methods of service delivery.

Objective

This paper aims to explore the experience of mental health service providers regarding digital health service delivery, including the current state of digital mental health service delivery, barriers to and facilitators of the use of digital health for mental health service delivery experienced during the pandemic, and recommendations for implementing and integrating digital health into regular mental health service delivery.

Methods

This embedded mixed-methods study included questionnaires and focus groups with key stakeholders (N=31) with knowledge and experience in providing mental health services. Data analysis included descriptive, quantitative, and qualitative thematic analyses.

Results

The following three themes emerged: being forced into change, daring to deliver mental health services using digital health, and future possibilities offered by digital health. In each theme, participants’ responses reflected their perceptions of service providers, organizations, and clients. The findings offer considerations regarding for whom and at what point in treatment digital health delivery is appropriate; recommendations for training, support, resources, and guidelines for digitally delivering trauma therapy; and a better understanding of factors influencing mental health service providers’ perceptions and acceptance of digital health for mental health service delivery.

Conclusions

The results indicate the implementation of digital health for mental health service delivery to military members, public safety personnel, and veterans. As the COVID-19 pandemic continues, remote service delivery methods for trauma therapy are urgently needed to support the well-being of those who have served and continue to serve.

The pros and cons of motor, memory, and emotion-related behavioral tests in the mouse traumatic brain injury model

Traumatic brain injury (TBI) is a medical emergency with high morbidity and mortality. Motor, memory, and emotion-related deficits are common symptoms following TBI, yet treatment is very limited. To develop new drugs and find new therapeutic avenues, a wide variety of TBI models have been established to mimic the heterogeneity of TBI. In this regard, along with histologic measures, behavioral functional outcomes provide valuable insight into the underlying neuropathology and guide neurorehabilitation efforts for neuropsychiatric impairment after TBI. Development, characterization, and application of behavioral tests that can assess functional neurologic deficits are essential to the development of translational therapies. This comprehensive review aims to summarize 19 common behavioral tests from three aspects (motor, memory, and emotion-related) that are associated with TBI pathology. Discussion covers the apparatus, the test steps, the evaluation indexes, data collection and analysis, animal performance and applications, advantages and disadvantages as well as precautions to eliminate bias wherever possible. We discussed recent studies on TBI-related preconditioning, biomarkers, and optimized behavioral protocols. The neuropsychologic tests employed in clinics were correlated with those used in mouse TBI models. In summary, this review provides a comprehensive, up-to-date reference for TBI researchers to choose the right neurobehavioral protocol according to the research objectives of their translational investigation.

Examining Conners Continuous Performance Test-3 (CPT-3) Embedded Performance Validity Indicators in an Adult Clinical Sample Referred for ADHD Evaluation

This study evaluated multiple previously-identified Continuous Performance Test-Third Edition (CPT-3) scores as embedded validity indicators (EVIs) among 201 adults undergoing neuropsychological evaluation for Attention-Deficit/Hyperactivity Disorder (ADHD) divided into valid (n = 169) and invalid (n = 32) groups based on seven criterion measures. Although 6/10 CPT-3 scores accurately detected invalidity, only two reached minimally acceptable classification accuracy of ≥0.70. The remaining four had unacceptably low accuracy (AUCs = 0.62-0.69) with 0.19-0.41 sensitivity at ≥0.90 specificity. Composite scores did not provide better classification accuracy than individual CPT-3 scores. In sum, CPT-3 individual and composite scores generally are not accurate PVTs among adults undergoing clinical evaluation for ADHD.

Examining Traditional and Novel Validity Indicators from the Medical Symptom Validity Test Across Levels of Verbal and Visual Memory Impairment

OBJECTIVE

This cross-sectional study examined accuracy of traditional Medical Symptom Validity Test (MSVT) validity indicators, including immediate recognition (IR), delayed recognition (DR), and consistency (CNS), as well as a novel indicator derived from the mean performance on IR, DR, and CNS across verbal, visual, and combined learning and memory impairment bands.

METHOD

A sample of 180 adult outpatients was divided into valid (n = 150) and invalid (n = 30) groups based on results of four independent criterion performance validity tests. Verbal and visual learning and recall were classified as indicative of no impairment, mild impairment, or severe impairment based on performance on the Rey Auditory Verbal Learning Test and Brief Visuospatial Memory Test-Revised, respectively.

RESULTS

In general, individual MSVT subtests were able to accurately classify performance as valid or invalid, even in the context of severe learning and memory deficits. However, as verbal and visual memory impairment increased, optimal MSVT cut-scores diverged from manual-specified cutoffs such that DR and CNS required cut-scores to be lowered to maintain adequate specificity. By contrast, the newly proposed scoring algorithm generally showed more robust psychometric properties across the memory impairment bands.

CONCLUSIONS

The mean performance index, a novel scoring algorithm using the mean of the three primary MSVT subtests, may be a more robust validity indicator than the individual MSVT subtests in the context of bona fide memory impairment.

Technology Acceptance and Usability of the BrainFx SCREEN in Canadian Military Members and Veterans With Posttraumatic Stress Disorder and Mild Traumatic Brain Injury: Mixed Methods UTAUT Study

BACKGROUND

Canadian Armed Forces service members (CAF-SMs) and veterans exhibit higher rates of injuries and illnesses, such as posttraumatic stress disorder (PTSD) and traumatic brain injury, which can cause and exacerbate cognitive dysfunction. Computerized neurocognitive assessment tools have demonstrated increased reliability and efficiency compared with traditional cognitive assessment tools. Without assessing the degree of technology acceptance and perceptions of usability to end users, it is difficult to determine whether a technology-based assessment will be used successfully in wider clinical practice. The Unified Theory of Acceptance and Use of Technology model is commonly used to address the technology acceptance and usability of applications in five domains.

OBJECTIVE

This study aims to determine the technology acceptance and usability of a neurocognitive assessment tool, which was titled BrainFx SCREEN, among CAF-SMs and veterans with PTSD by using the Unified Theory of Acceptance and Use of Technology model.

METHODS

This mixed methods embedded pilot study included CAF-SMs and veterans (N=21) aged 18-60 years with a diagnosis of PTSD who completed pre- and postquestionnaires on the same day the BrainFx SCREEN was used. A partial least squares structural equation model was used to analyze the questionnaire results. Qualitative data were assessed using thematic analysis.

RESULTS

Facilitating conditions, which were the most notable predictors of behavioral intention, increased after using the BrainFx SCREEN, whereas effort expectancy decreased. Performance expectancy, effort expectancy, and social interaction were not factors that could predict behavioral intention. Participants who reported a previous mild traumatic brain injury were significantly more likely to report current symptoms of cognitive impairment. The BrainFx SCREEN is a feasible, usable, and accepted assessment tool for CAF-SMs and veterans who experience PTSD.

CONCLUSIONS

As military health care systems integrate technological innovations to improve the services and care provided, research must continue to address the acceptability and use of these novel assessments and interventions.

Validity of early-onset dementia diagnoses in VA electronic medical record administrative data

OBJECTIVE

To determine the validity of diagnoses indicative of early-onset dementia (EOD) obtained from an algorithm using administrative data, we examined Veterans Health Administration (VHA) electronic medical records (EMRs).

METHOD

A previously used method of identifying cases of dementia using administrative data was applied to a random sample of 176 cases of Post-9/11 deployed veterans under 65 years of age. Retrospective, cross-sectional examination of EMRs was conducted, using a combination of administrative data, chart abstraction, and review/consensus by board-certified neuropsychologists.

RESULTS

Approximately 73% of EOD diagnoses identified using existing algorithms were identified as false positives in the overall sample. This increased to approximately 76% among those with mental health conditions and approximately 85% among those with mild traumatic brain injury (TBI; i.e. concussion). Factors related to improved diagnostic accuracy included more severe TBI, diagnosing clinician type, presence of neuroimaging data, absence of a comorbid mental health condition diagnosis, and older age at time of diagnosis.

CONCLUSIONS

A previously used algorithm for detecting dementia using VHA administrative data was not supported for use in the younger adult samples and resulted in an unacceptably high number of false positives. Based on these findings, there is concern for possible misclassification in population studies using similar algorithms to identify rates of EOD among veterans. Further, we provide suggestions to develop an enhanced algorithm for more accurate dementia surveillance among younger populations.

Traumatic Brain Injury, Chronic Traumatic Encephalopathy, and Alzheimer Disease

Traumatic brain injury (TBI) is a major health and economic burden. With increasing aging population, this issue is expected to continue to rise. Neurodegenerative disorders are more common with aging population in general regardless of history of TBI. Recent evidence continues to support a relation between a TBI and neurocognitive decline later in life (such as in athletes and military). This article summarizes the pathologic and clinical effects of TBI (regardless of severity) on the later development of dementia in individuals 65 years or older.

Neuropsychological testing

Neuropsychological testing is a key diagnostic tool for assessing people with dementia and mild cognitive impairment, but can also help in other neurological conditions such as Parkinson’s disease, stroke, multiple sclerosis, traumatic brain injury and epilepsy. While cognitive screening tests offer gross information, detailed neuropsychological evaluation can provide data on different cognitive domains (visuospatial function, memory, attention, executive function, language and praxis) as well as neuropsychiatric and behavioural features. We should regard neuropsychological testing as an extension of the neurological examination applied to higher order cortical function, since each cognitive domain has an anatomical substrate. Ideally, neurologists should discuss the indications and results of neuropsychological assessment with a clinical neuropsychologist. This paper summarises the rationale, indications, main features, most common tests and pitfalls in neuropsychological evaluation.