SENSITIVITY AND SPECIFICITY OF FINGER TAPPING TEST SCORES FOR THE DETECTION OF SUSPECT EFFORT

Temporal and spatial progression of microstructural cerebral degeneration in ALS: A multicentre longitudinal diffusion tensor imaging study

OBJECTIVE

The corticospinal tract (CST) reveals progressive microstructural alterations in ALS measurable by DTI. The aim of this study was to evaluate fractional anisotropy (FA) along the CST as a longitudinal marker of disease progression in ALS.

METHODS

The study cohort consisted of 114 patients with ALS and 110 healthy controls from the second prospective, longitudinal, multicentre study of the Canadian ALS Neuroimaging Consortium (CALSNIC-2). DTI and clinical data from a harmonized protocol across 7 centres were collected. Thirty-nine ALS patients and 61 controls completed baseline and two follow-up visits and were included for longitudinal analyses. Whole brain-based spatial statistics and hypothesis-guided tract-of-interest analyses were performed for cross-sectional and longitudinal analyses.

RESULTS

FA was reduced at baseline and longitudinally in the CST, mid-corpus callosum (CC), frontal lobe, and other ALS-related tracts, with alterations most evident in the CST and mid-CC. CST and pontine FA correlated with functional impairment (ALSFRS-R), upper motor neuron function, and clinical disease progression rate. Reduction in FA was largely located in the upper CST; however, the longitudinal decline was greatest in the lower CST. Effect sizes were dependent on region, resulting in study group sizes between 17 and 31 per group over a 9-month interval. Cross-sectional effect sizes were maximal in the upper CST; whereas, longitudinal effect sizes were maximal in mid-callosal tracts.

CONCLUSIONS

Progressive microstructural alterations in ALS are most prominent in the CST and CC. DTI can provide a biomarker of cerebral degeneration in ALS, with longitudinal changes in white matter demonstrable over a reasonable observation period, with a feasible number of participants, and within a multicentre framework.

From "below chance" to "a single error is one too many": Evaluating various thresholds for invalid performance on two forced choice recognition tests

This study was designed to empirically evaluate the classification accuracy of various definitions of invalid performance in two forced-choice recognition performance validity tests (PVTs; FCRCVLT-II and Test of Memory Malingering [TOMM-2]). The proportion of at and below chance level responding defined by the binomial theory and making any errors was computed across two mixed clinical samples from the United States and Canada (N = 470) and two sets of criterion PVTs. There was virtually no overlap between the binomial and empirical distributions. Over 95% of patients who passed all PVTs obtained a perfect score. At chance level responding was limited to patients who failed ≥2 PVTs (91% of them failed 3 PVTs). No one scored below chance level on FCRCVLT-II or TOMM-2. All 40 patients with dementia scored above chance. Although at or below chance level performance provides very strong evidence of non-credible responding, scores above chance level have no negative predictive value. Even at chance level scores on PVTs provide compelling evidence for non-credible presentation. A single error on the FCRCVLT-II or TOMM-2 is highly specific (0.95) to psychometrically defined invalid performance. Defining non-credible responding as below chance level scores is an unnecessarily restrictive threshold that gives most examinees with invalid profiles a Pass.

Grooved Pegboard adds incremental value over memory-apparent performance validity tests in predicting psychiatric symptom report

The present study evaluated whether Grooved Pegboard (GPB), when used as a performance validity test (PVT), can incrementally predict psychiatric symptom report elevations beyond memory-apparent PVTs. Participants (N = 111) were military personnel and were predominantly White (84%), male (76%), with a mean age of 43 (SD = 12) and having on average 16 years of education (SD = 2). Individuals with disorders potentially compromising motor dexterity were excluded. Participants were administered GPB, three memory-apparent PVTs (Medical Symptom Validity Test, Non-Verbal Medical Symptom Validity Test, Reliable Digit Span), and a symptom validity test (Personality Assessment Inventory Negative Impression Management [NIM]). Results from the three memory-apparent PVTs were entered into a model for predicting NIM, where failure of two or more PVTs was categorized as evidence of non-credible responding. Hierarchical regression revealed that non-dominant hand GPB T-score incrementally predicted NIM beyond memory-apparent PVTs (F(2,108) = 16.30, p < .001; R² change = .05, β = -0.24, p < .01). In a second hierarchical regression, GPB performance was dichotomized into pass or fail, using T-score cutoffs (≤29 for either hand, ≤31 for both). Non-dominant hand GPB again predicted NIM beyond memory-apparent PVTs (F(2,108) = 18.75, p <.001; R² change = .08, β = -0.28, p < .001). Results indicated that noncredible/failing GPB performance adds incremental value over memory-apparent PVTs in predicting psychiatric symptom report.

Multivariate models provide an effective psychometric solution to the variability in classification accuracy of D-KEFS Stroop performance validity cutoffs

ObjectiveThe study was designed to expand on the results of previous investigations on the D-KEFS Stroop as a performance validity test (PVT), which produced diverging conclusions. Method The classification accuracy of previously proposed validity cutoffs on the D-KEFS Stroop was computed against four different criterion PVTs in two independent samples: patients with uncomplicated mild TBI (n = 68) and disability benefit applicants (n = 49). Results Age-corrected scaled scores (ACSSs) ≤6 on individual subtests often fell short of specificity standards. Making the cutoffs more conservative improved specificity, but at a significant cost to sensitivity. In contrast, multivariate models (≥3 failures at ACSS ≤6 or ≥2 failures at ACSS ≤5 on the four subtests) produced good combinations of sensitivity (.39-.79) and specificity (.85-1.00), correctly classifying 74.6-90.6% of the sample. A novel validity scale, the D-KEFS Stroop Index correctly classified between 78.7% and 93.3% of the sample. Conclusions A multivariate approach to performance validity assessment provides a methodological safeguard against sample- and instrument-specific fluctuations in classification accuracy, strikes a reasonable balance between sensitivity and specificity, and mitigates the invalid before impaired paradox.

What do functional neuroimaging studies tell us about the association between falls and cognition in older adults? A systematic review

Impaired cognition is a known risk factor for falls in older adults. To enhance prevention strategies and treatment of falls among an aging global population, an understanding of the neural processes and networks involved is required. We present a systematic review investigating how functional neuroimaging techniques have been used to examine the association between falls and cognition in seniors. Peer-reviewed articles were identified through searching five electronic databases: 1) Medline, 2) PsycINFO, 3) CINAHL, 4) EMBASE, and 5) Pubmed. Key author, key paper, and reference searching was also conducted. Nine studies were included in this review. A questionnaire composed of seven questions was used to assess the quality of each study. EEG, fMRI, and PET were utilized across studies to examine brain function in older adults. Consistent evidence demonstrates that cognition is associated with measures of falls/falls risk, specifically visual attention and executive function. Our results show that falls/falls risk may be implicated with specific brain regions and networks. Future studies should be prospective and long-term in nature, with standardized outcome measures. Mobile neuroimaging techniques may also provide insight into brain activity as it pertains to cognition and falls in older adults in real-world settings.

Using the Grooved Pegboard Test as an Embedded Validity Indicator in a Mixed Neuropsychiatric Sample with Varying Cognitive Impairment: Cross-Validation Problems

Embedded validity indicators (EVIs) derived from motor tests have received less empirical attention than those derived from tests of other neuropsychological abilities, particularly memory. Preliminary evidence suggests that the Grooved Pegboard Test (GPB) may function as an EVI, but existing studies were largely conducted using simulators and population samples without cognitive impairment. In this study we aimed to evaluate the GPB's classification accuracy as an EVI among a mixed clinical neuropsychiatric sample with and without cognitive impairment. This cross-sectional study comprised 223 patients clinically referred for neuropsychological testing. GPB raw and T-scores for both dominant and nondominant hands were examined as EVIs. A known-groups design, based on ≤1 failure on a battery of validated, independent criterion PVTs, showed that GPB performance differed significantly by validity group. Within the valid group, receiver operating characteristic curve analyses revealed that only the dominant hand raw score displayed acceptable classification accuracy for detecting invalid performance (area under curve [AUC] = .72), with an optimal cut-score of ≥106 seconds (33% sensitivity/88% specificity). All other scores had marginally lower classification accuracy (AUCs = .65-.68) for differentiating valid from invalid performers. Therefore, the GPB demonstrated limited utility as an EVI in a clinical sample containing patients with bona fide cognitive impairment.

Cross-validation and initial investigation of two abbreviated methods of the finger tapping test

The Finger Tapping Test (FTT) is a widely utilized measure to assess lateralized motor speed and dexterity. The current study sought to cross-validate an abbreviated version of the FTT (i.e., M of Trials 3-5) and to evaluate a novel abbreviated method (i.e., M of three trials within five taps of each other; "3 within 5") to examine their respective effectiveness as a predictor of full-score performance based on a traditional administration procedure. The results showed that the abbreviated methods accurately predicted the full-test score, and any statistically significant differences that emerged were small based on effect size analysis and unlikely to be clinically meaningful. These findings were consistent across genders, among older adults, and among individuals displaying significant inter-trial tapping variability and thus requiring lengthier administration time. Classification accuracy statistics for the detection of impairment and performance validity status were high for both abbreviated methods. The results support two valid options for shortening the duration of the FTT. Both methods, used independently or in combination, are compatible with traditional administration procedures.

Cross-validation of RAVLT performance validity indicators and the RAVLT/RO discriminant function in a large known groups sample

OBJECTIVE

To cross-validate RAVLT performance validity cut-offs and the RAVLT/RO discriminant function in a large neuropsychological sample.

METHOD

RAVLT scores and the RAVLT/RO discriminant function were compared in credible (n = 100) and noncredible (n = 353) neuropsychology referrals.

RESULTS

Noncredible patients scored lower than credible patients on RAVLT scores and the RAVLT/RO discriminant function. With cut-offs set to ≥90% specificity, highest sensitivities were observed for the discriminant function (cut-off ≤.064; 55.8%), recognition total (cut-off ≤9; 53.1%), the recognition combination score (≤10; 47.7%), and total learning across trials (cut-off ≤31; 45.3%). Individuals with histories of learning difficulties were over-represented in the 10% of credible patients exceeding cut-offs. When these individuals were removed, cut-offs could be tightened while still maintaining at least 90% specificity, and thereby increasing sensitivity (e.g., recognition total cut-off ≤10, 65% sensitivity; RAVLT/RO discriminant function cut-off ≤.176, 58% sensitivity). When three of the most sensitive, non-overlapping scores were considered in combination, 17% of credible patients failed ≥1 of the three cut-offs, while 3% failed two, and only 1% failed all three. In contrast, in the noncredible sample, more than two-thirds failed one or more of the three cut-offs, nearly half failed ≥2, and nearly a quarter failed all three.

CONCLUSIONS

RAVLT PVT cut-offs and the RAVLT/RO discriminant function achieve approximately 50% sensitivity, and approach 65% sensitivity when cut-offs specific to samples without histories of learning problems are employed, confirming that RAVLT cut-offs and the RAVLT/RO discriminant function continue to be valuable techniques in the identification of performance invalidity.

Validation of grooved pegboard cutoffs as an additional embedded measure of performance validity

OBJECTIVE

Using embedded performance validity (PVT) comparisons, Erdodi et al. suggested that Grooved Pegboard (GPB) T-score cutoffs for either hand (≤ 29) or both hands (≤ 31) could be used as additional embedded PVTs. The current study evaluated the relationship between these proposed cutoff scores and established PVTs (Medical Symptom Validity Test [MSVT]; Non-Verbal Medical Symptom Validity Test [NV-MSVT], and Reliable Digit Span [RDS]).

METHOD

Participants (N = 178) were predominately Caucasian (84%) males (79%) with a mean age and education of 41 (SD = 11.7) and 15.8 years (SD = 2.3), respectively. Participants were stratified as "passing" or "failing" the GPBviaErdodi's proposed criteria. "Failures" on the MSVT, NV-MSVT, and RDS were based on conventional recommendations.

RESULTS

Moderate correlations between GPB classification and a condition of interest (COI; i.e. at least two failures on reference PVTs) were observed for dominant (χ² (1, n = 178) = 34.72, ϕ = .44, p < .001), non-dominant (χ² (1, n = 178) = 16.46, ϕ = .30, p = .001), and both hand conditions (χ² (1, n = 178) = 32.48, ϕ = .43, p < .001). Sensitivity, specificity, and predictive power were generally higher than Erdodi et al.'s initial findings.

CONCLUSION

These findingsprovide supportfor the clinical utility of the GPB as an additional embedded PVT. More specifically, dominant and both hand cutoffs were found to be more robust measures ofnon-genuine performance in those without motor deficits. While promising, sensitivity continues to be low; therefore, it is ill-advised to use the GPB as a sole measure of -performance validity.

EEG-based vibrotactile evoked brain-computer interfaces system: A systematic review

Recently, a novel electroencephalogram-based brain-computer interface (EVE-BCI) using the vibrotactile stimulus shows great potential for an alternative to other typical motor imagery and visual-based ones. (i) Objective: in this review, crucial aspects of EVE-BCI are extracted from the literature to summarize its key factors, investigate the synthetic evidence of feasibility, and generate recommendations for further studies. (ii) Method: five major databases were searched for relevant publications. Multiple key concepts of EVE-BCI, including data collection, stimulation paradigm, vibrotactile control, EEG signal processing, and reported performance, were derived from each eligible article. We then analyzed these concepts to reach our objective. (iii) Results: (a) seventy-nine studies are eligible for inclusion; (b) EEG data are mostly collected among healthy people with an embodiment of EEG cap in EVE-BCI development; (c) P300 and Steady-State Somatosensory Evoked Potential are the two most popular paradigms; (d) only locations of vibration are heavily explored by previous researchers, while other vibrating factors draw little interest. (e) temporal features of EEG signal are usually extracted and used as the input to linear predictive models for EVE-BCI setup; (f) subject-dependent and offline evaluations remain popular assessments of EVE-BCI performance; (g) accuracies of EVE-BCI are significantly higher than chance levels among different populations. (iv) Significance: we summarize trends and gaps in the current EVE-BCI by identifying influential factors. A comprehensive overview of EVE-BCI can be quickly gained by reading this review. We also provide recommendations for the EVE-BCI design and formulate a checklist for a clear presentation of the research work. They are useful references for researchers to develop a more sophisticated and practical EVE-BCI in future studies.

Failing Performance Validity Cutoffs on the Boston Naming Test (BNT) Is Specific, but Insensitive to Non-Credible Responding

This study was designed to examine alternative validity cutoffs on the Boston Naming Test (BNT).Archival data were collected from 206 adults assessed in a medicolegal setting following a motor vehicle collision. Classification accuracy was evaluated against three criterion PVTs.The first cutoff to achieve minimum specificity (.87-.88) was T ≤ 35, at .33-.45 sensitivity. T ≤ 33 improved specificity (.92-.93) at .24-.34 sensitivity. BNT validity cutoffs correctly classified 67-85% of the sample. Failing the BNT was unrelated to self-reported emotional distress. Although constrained by its low sensitivity, the BNT remains a useful embedded PVT.

Combining subjective and objective appraisals of cognitive dysfunction in patients with cancer: a deeper understanding of meaning and impact on suffering?

PURPOSE

Patients with advanced cancer often experience cognitive dysfunction, which may influence decision making, self-perception, and existential well-being. However, there is little evidence regarding this issue. This study analysed associations between objective neuropsychological measures and patients' self-report of cognitive dysfunction interfering with everyday life, general well-being, and sense of existential value.

METHODS

A mixed method study assessed 13 adult patients with advanced cancer with validated neuropsychological tests, which assessed sustained attention, psychomotor speed, memory/attention, mental flexibility, and a measure of global cognitive function. These were followed by semi-structured interviews focusing on subjective experiences of cognitive dysfunction. Agreement between subjective and objective measures were analysed by Cohen's Kappa (k). Thematic analysis explored associations with cognitive deficits.

RESULTS

Poor cognitive performance on the neuropsychological tests was observed regarding sustained attention (n = 8), psychomotor speed (n = 1), memory/attention (n = 2), mental flexibility (n = 9), and global cognitive function (n = 3). Almost all patients (n = 12) had complaints of cognitive dysfunction. However, the agreement between the two assessments was weak (k ≤ 0.264). Cognitive dysfunction challenged the patients with regard to practice everyday life including their existential values related to meaning of life and well-being. Adjustment of the sense of living according to one's existential values and changes of self-perception were also related positively and negatively to existential well-being.

CONCLUSION

Despite the weak agreement between objective and subjective measures of cognitive function, many of the patients reported experiences of cognitive dysfunction that had an impact on their daily life and existential well-being, adding to the suffering experienced.

Fronto-striatal dopamine D2 receptor availability is associated with cognitive variability in older individuals with low dopamine integrity

Within-person, moment-to-moment, variability in behavior increases with advancing adult age, potentially reflecting the influence of reduced structural and neurochemical brain integrity, especially that of the dopaminergic system. We examined the role of dopamine D2 receptor (D2DR) availability, grey-, and white-matter integrity, for between-person differences in cognitive variability in a large sample of healthy older adults (n = 181; 64-68 years) from the Cognition, Brain, and Aging (COBRA) study. Intra-individual variability (IIV) in cognition was measured as across-trial variability in participants' response times for tasks assessing perceptual speed and working memory, as well as for a control task of motor speed. Across the whole sample, no associations of D2DR availability, or grey- and white-matter integrity, to IIV were observed. However, within-person variability in cognition was increased in two subgroups of individuals displaying low mean-level cognitive performance, one of which was characterized by low subcortical and cortical D2DR availability. In this latter group, fronto-striatal D2DR availability correlated negatively with within-person variability in cognition. This finding suggests that the influence of D2DR availability on cognitive variability may be more easily disclosed among individuals with low dopamine-system integrity, highlighting the benefits of large-scale studies for delineating heterogeneity in brain-behavior associations in older age.

Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity

OBJECTIVE

This study was designed to empirically investigate the signal detection profile of various multivariate models of performance validity tests (MV-PVTs) and explore several contested assumptions underlying validity assessment in general and MV-PVTs specifically.

METHOD

Archival data were collected from 167 patients (52.4%male; MAge = 39.7) clinicially evaluated subsequent to a TBI. Performance validity was psychometrically defined using two free-standing PVTs and five composite measures, each based on five embedded PVTs.

RESULTS

MV-PVTs had superior classification accuracy compared to univariate cutoffs. The similarity between predictor and criterion PVTs influenced signal detection profiles. False positive rates (FPR) in MV-PVTs can be effectively controlled using more stringent multivariate cutoffs. In addition to Pass and Fail, Borderline is a legitimate third outcome of performance validity assessment. Failing memory-based PVTs was associated with elevated self-reported psychiatric symptoms.

CONCLUSIONS

Concerns about elevated FPR in MV-PVTs are unsubstantiated. In fact, MV-PVTs are psychometrically superior to individual components. Instrumentation artifacts are endemic to PVTs, and represent both a threat and an opportunity during the interpretation of a given neurocognitive profile. There is no such thing as too much information in performance validity assessment. Psychometric issues should be evaluated based on empirical, not theoretical models. As the number/severity of embedded PVT failures accumulates, assessors must consider the possibility of non-credible presentation and its clinical implications to neurorehabilitation.

Stronger Together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in Patients with Traumatic Brain Injury

OBJECTIVE

This study was designed to evaluate the classification accuracy of a multivariate model of performance validity assessment using embedded validity indicators (EVIs) within the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV).

METHOD

Archival data were collected from 100 adults with traumatic brain injury (TBI) consecutively referred for neuropsychological assessment in a clinical setting. The classification accuracy of previously published individual EVIs nested within the WAIS-IV and a composite measure based on six independent EVIs were evaluated against psychometrically defined non-credible performance.

RESULTS

Univariate validity cutoffs based on age-corrected scaled scores on Coding, Symbol Search, Digit Span, Letter-Number-Sequencing, Vocabulary minus Digit Span, and Coding minus Symbol Search were strong predictors of psychometrically defined non-credible responding. Failing ≥3 of these six EVIs at the liberal cutoff improved specificity (.91-.95) over univariate cutoffs (.78-.93). Conversely, failing ≥2 EVIs at the more conservative cutoff increased and stabilized sensitivity (.43-.67) compared to univariate cutoffs (.11-.63) while maintaining consistently high specificity (.93-.95).

CONCLUSIONS

In addition to being a widely used test of cognitive functioning, the WAIS-IV can also function as a measure of performance validity. Consistent with previous research, combining information from multiple EVIs enhanced the classification accuracy of individual cutoffs and provided more stable parameter estimates. If the current findings are replicated in larger, diagnostically and demographically heterogeneous samples, the WAIS-IV has the potential to become a powerful multivariate model of performance validity assessment.

BRIEF SUMMARY

Using a combination of multiple performance validity indicators embedded within the subtests of theWechsler Adult Intelligence Scale, the credibility of the response set can be establishedwith a high level of confidence. Multivariatemodels improve classification accuracy over individual tests. Relying on existing test data is a cost-effective approach to performance validity assessment.

A Meta-Analysis of Neuropsychological Effort Test Performance in Psychotic Disorders

Psychotic disorders are characterized by a generalized neurocognitive deficit (i.e., performance 1.5 SD below controls across neuropsychological domains with no specific profile of differential deficits). A motivational account of the generalized neurocognitive deficit has been proposed, which attributes poor neuropsychological testing performance to low effort. However, findings are inconsistent regarding effort test failure rate in individuals with psychotic disorders across studies (0-72%), and moderators are unclear, making it difficult to know whether the motivational explanation is viable. To address these issues, a meta-analysis was performed on data from 2205 individuals with psychotic disorders across 19 studies with 24 independent effects. Effort failure rate was examined along with moderators of effort test type, forensic status, IQ, positive symptoms, negative symptoms, diagnosis, age, gender, education, and antipsychotic use. The pooled weighted effort test failure rate was 18% across studies and there was a moderate pooled association between effort failure rate and global neurocognitive performance (r = .57). IQ and education significantly moderated failure rate. Collectively, these findings suggest that a nontrivial proportion of individuals with a psychotic disorder fail effort testing, and failure rate is associated with global neuropsychological impairment. However, given that effort tests are not immune to the effects of IQ in psychotic disorders, these results cannot attest to the viability of the motivational account of the generalized neurocognitive deficit. Furthermore, the significant moderating effect of IQ and education on effort test performance suggests that effort tests have questionable validity in this population and should be interpreted with caution.

A prospective harmonized multicenter DTI study of cerebral white matter degeneration in ALS

OBJECTIVE

To evaluate progressive white matter (WM) degeneration in amyotrophic lateral sclerosis (ALS).

METHODS

Sixty-six patients with ALS and 43 healthy controls were enrolled in a prospective, longitudinal, multicenter study in the Canadian ALS Neuroimaging Consortium (CALSNIC). Participants underwent a harmonized neuroimaging protocol across 4 centers that included diffusion tensor imaging (DTI) for assessment of WM integrity. Three visits were accompanied by clinical assessments of disability (ALS Functional Rating Scale-Revised [ALSFRS-R]) and upper motor neuron (UMN) function. Voxel-wise whole-brain and quantitative tract-wise DTI assessments were done at baseline and longitudinally. Correction for site variance incorporated data from healthy controls and from healthy volunteers who underwent the DTI protocol at each center.

RESULTS

Patients with ALS had a mean progressive decline in fractional anisotropy (FA) of the corticospinal tract (CST) and frontal lobes. Tract-wise analysis revealed reduced FA in the CST, corticopontine/corticorubral tract, and corticostriatal tract. CST FA correlated with UMN function, and frontal lobe FA correlated with the ALSFRS-R score. A progressive decline in CST FA correlated with a decline in the ALSFRS-R score and worsening UMN signs. Patients with fast vs slow progression had a greater reduction in FA of the CST and upper frontal lobe.

CONCLUSIONS

Progressive WM degeneration in ALS is most prominent in the CST and frontal lobes and, to a lesser degree, in the corticopontine/corticorubral tracts and corticostriatal pathways. With the use of a harmonized imaging protocol and incorporation of analytic methods to address site-related variances, this study is an important milestone toward developing DTI biomarkers for cerebral degeneration in ALS.

CLINICALTRIALSGOV IDENTIFIER

NCT02405182.

The Behavior Rating Inventory of Executive Function®-Adult Version is Related to Emotional Distress, Not Executive Dysfunction, in a Veteran Sample

Objective

In three studies, we explore the impact of response bias, symptom validity, and psychological factors on the self-report form of the Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A) and the relationship between self-reported executive functioning (EF) and objective performance.

Method

Each study pulled from a sample of 123 veterans who were administered a BRIEF-A and Minnesota Multiphasic Personality Inventory-2 (MMPI-2) during a neuropsychological evaluation. Participants were primarily middle-aged, and half carried a mood disorder diagnosis. Study 1 examined group differences in BRIEF-A ratings among valid, invalid, and indeterminate MMPI-2 responders. Analyses were conducted to determine the optimal cut-score for the BRIEF-A Negativity Validity scale. In Study 2, relationships were explored among MMPI-2-RF (restructured form) Restructured Clinical (RC) scales, somatic/cognitive scales, and the BRIEF-A Metacognition Index (MI); hierarchical analyses were performed to predict MI using MMPI-2-RF Demoralization (RCd) and specific RC scales. Study 3 correlated BRIEF-A clinical scales and indices with RCd and an EF composite score from neuropsychological testing. Hierarchical analyses were conducted to predict BRIEF-A clinical scales.

Results

Invalid performance on the MMPI-2 resulted in significantly elevated scores on the BRIEF-A compared to those with valid responding. A more stringent cut-score of ≥4 for the BRIEF-A Negativity scale is more effective at identifying invalid symptom reporting. The BRIEF-A MI is most strongly correlated with demoralization. BRIEF-A indices and scales are largely unrelated to objective EF performance.

Conclusions

In a veteran sample, responses on the BRIEF-A are most representative of generalized emotional distress and response bias, not actual EF abilities.

Effort Testing in Dementia Assessment: A Systematic Review

Objective

Interpretation of neuropsychological test data is only valid when appropriate effort has been exerted. Research, however, suggests that neuropsychologists do not always formally test for effort and that this may especially be the case in the context of dementia assessment. This review systematically examined the literature that has investigated the use of both purpose-built and embedded effort-sensitive indices in dementia, mild cognitive impairment (MCI), and healthy control samples. The aim was to determine which tests of effort are most sensitive to suboptimal effort and least sensitive to the type of cognitive impairment seen in dementia.

Methods

A systematic search of databases was conducted to October 2017. There was no start date.

Results

Twenty-five studies were included for review. The studies were divided into two categories according to methodology. One category of studies (n = 5) was reviewed using a tailored methodological quality rating checklist whilst the remaining studies (n = 20) were reviewed using the Crowe Critical Appraisal Tool (CCAT).

Conclusions

The results of this review suggest that PVTs which take a hierarchical approach to effort testing such as the WMT, MSVT, and NV-MSVT are preferable for use with older adults who are under investigation for possible dementia. These tests go above and beyond the traditional pass/fail approach of more traditional tests of effort because they allow the examiner to analyze the examinee's profile of scores. The methodological limitations and challenges involved in this field of research are discussed.

Preliminary investigation of the Denver Attention Test (DAT) in a mixed clinical sample

In this pilot study, the clinical utility of a new computerized performance validity test (PVT) called the Denver Attention Test (DAT) was evaluated in a known-groups experimental design. Subjects consisted of 130 adults with mixed neurological conditions evaluated in an outpatient setting. Using the Word Memory Test (WMT) to categorize subjects into valid and invalid groups, the DAT was found to have adequate discrimination. Classification statistics for the DAT demonstrated low to moderate sensitivity and excellent specificity relative to the WMT. ROC analyses demonstrated AUCs of at least .78 for select DAT subtests. Overall, data from this pilot study suggest that the DAT has potential to serve as a useful PVT. Future research directions are discussed.

Wait, There’s a Baby in this Bath Water! Update on Quantitative and Qualitative Cut-Offs for Rey 15-Item Recall and Recognition

Objective

Evaluate the effectiveness of Rey 15-item plus recognition data in a large neuropsychological sample.

Method

Rey 15-item plus recognition scores were compared in credible (n = 138) and noncredible (n = 353) neuropsychology referrals.

Results

Noncredible patients scored significantly worse than credible patients on all Rey 15-item plus recognition scores. When cut-offs were selected to maintain at least 89.9% specificity, cut-offs could be made more stringent, with the highest sensitivity found for recognition correct (cut-off ≤11; 62.6% sensitivity) and the combination score (recall + recognition – false positives; cut-off ≤22; 60.6% sensitivity), followed by recall correct (cut-off ≤11; 49.3% sensitivity), and recognition false positive errors (≥3; 17.9% sensitivity). A cut-off of ≥4 applied to a summed qualitative error score for the recall trial resulted in 19.4% sensitivity. Approximately 10% of credible subjects failed either recall correct or recognition correct, whereas two-thirds of noncredible patients (67.7%) showed this pattern. Thirteen percent of credible patients failed either recall correct, recognition correct, or the recall qualitative error score, whereas nearly 70% of noncredible patients failed at least one of the three. Some individual qualitative recognition errors had low false positive rates (&lt;2%) indicating that their presence was virtually pathognomonic for noncredible performance. Older age (&gt;50) and IQ &lt; 80 were associated with increased false positive rates in credible patients.

Conclusions

Data on a larger sample than that available in the 2002 validation study show that Rey 15-item plus recognition cut-offs can be made more stringent, and thereby detect up to 70% of noncredible test takers, but the test should be used cautiously in older individuals and in individuals with lowered IQ.

Aggregating validity indicators: The salience of domain specificity and the indeterminate range in multivariate models of performance validity assessment

This study was designed to examine the "domain specificity" hypothesis in performance validity tests (PVTs) and the epistemological status of an "indeterminate range" when evaluating the credibility of a neuropsychological profile using a multivariate model of performance validity assessment. While previous research suggests that aggregating PVTs produces superior classification accuracy compared to individual instruments, the effect of the congruence between the criterion and predictor variable on signal detection and the issue of classifying borderline cases remain understudied. Data from a mixed clinical sample of 234 adults referred for cognitive evaluation (M_Age = 46.6; M_Education = 13.5) were collected. Two validity composites were created: one based on five verbal PVTs (EI-5_VER) and one based on five nonverbal PVTs (EI-5_NV) and compared against several other PVTs. Overall, language-based tests of cognitive ability were more sensitive to elevations on the EI-5_VER compared to visual-perceptual tests; whereas, the opposite was observed with the EI-5_NV. However, the match between predictor and criterion variable had a more complex relationship with classification accuracy, suggesting the confluence of multiple factors (sensory modality, cognitive domain, testing paradigm). An "indeterminate range" of performance validity emerged that was distinctly different from both the Pass and the Fail group. Trichotomized criterion PVTs (Pass-Borderline-Fail) had a negative linear relationship with performance on tests of cognitive ability, providing further support for an "in-between" category separating the unequivocal Pass and unequivocal Fail classification range. The choice of criterion variable can influence classification accuracy in PVT research. Establishing a Borderline range between Pass and Fail more accurately reflected the distribution of scores on multiple PVTs. The traditional binary classification system imposes an artificial dichotomy on PVTs that was not fully supported by the data. Accepting "indeterminate" as a legitimate third outcome of performance validity assessment has the potential to improve the clinical utility of PVTs and defuse debates regarding "near-Passes" and "soft Fails."

Exploring the sensitivity of the Personality Assessment Inventory symptom validity tests in detecting response bias in a mixed neuropsychological outpatient sample

OBJECTIVE

Few studies have evaluated the symptom validity tests (SVTs) within the Personality Assessment Inventory (PAI) in a neuropsychological assessment context. Accordingly, the present study explored the accuracy of PAI SVTs in identifying exaggerated cognitive dysfunction in a mixed sample of outpatients referred for neuropsychological assessment.

METHOD

Participants who failed two or more Performance Validity Tests (PVTs) were classified as having exaggerated cognitive dysfunction (n = 49). Their responses on PAI SVTs were compared to examinees who did not fail PVTs (n = 257).

RESULTS

Multivariate analysis of variance indicated the Negative Impression Management (NIM) scale most strongly discriminated between those with exaggerated cognitive dysfunction from honest responders (Cohen's d = .58). Nonetheless, its classification accuracy was low (area under the curve [AUC] = .65). A k-means cluster analysis and a subsequent multinomial logistic regression indicated evidence for two distinct groups of exaggerators. In particular, one group seemed to exaggerate symptoms, whereas another presented in a defensive manner, implying that individuals with positive and NIM biases on the PAI were apt to display invalid performance on PVTs.

CONCLUSIONS

Findings indicated that exaggerated cognitive dysfunction tends to be present when NIM is very high and that evidence exists for a defensive response style on the PAI in the context of PVT failure.

Rates of Abnormally Low TOPF Word Reading Scores in Individuals Failing Versus Passing Performance Validity Testing

The present study examined the impact of performance validity test (PVT) failure on the Test of Premorbid Functioning (TOPF) in a sample of 252 neuropsychological patients. Word reading performance differed significantly according to PVT failure status, and number of PVTs failed accounted for 7.4% of the variance in word reading performance, even after controlling for education. Furthermore, individuals failing ≥2 PVTs were twice as likely as individuals passing all PVTs (33% vs. 16%) to have abnormally low obtained word reading scores relative to demographically predicted scores when using a normative base rate of 10% to define abnormality. When compared with standardization study clinical groups, those failing ≥2 PVTs were twice as likely as patients with moderate to severe traumatic brain injury and as likely as patients with Alzheimer’s dementia to obtain abnormally low TOPF word reading scores. Findings indicate that TOPF word reading based estimates of premorbid functioning should not be interpreted in individuals invalidating cognitive testing.

Foreign Accent Syndrome As a Psychogenic Disorder: A Review

In the majority of cases published between 1907 and 2014, FAS is due to a neurogenic etiology. Only a few reports about FAS with an assumed psychogenic origin have been published. The present article discusses the findings of a careful database search on psychogenic FAS. This review may be particularly relevant as it is the first to analyze the salient features of psychogenic FAS cases to date. This article hopes to pave the way for the view that psychogenic FAS is a cognate of neurogenic FAS. It is felt that this variant of FAS may have been underreported, as most of the psychogenic cases have been published after the turn of the century. This review may improve the diagnosis of the syndrome in clinical practice and highlights the importance of recognizing psychogenic FAS as an independent taxonomic entity.