Detecting suboptimal cognitive effort: classification accuracy of the Conner's Continuous Performance Test-II, Brief Test Of Attention, and Trail Making Test

Features of attention network impairment in patients with temporal lobe epilepsy: Evidence from eye-tracking and electroencephalogram

AIM

To explore multiple features of attention impairments in patients with temporal lobe epilepsy (TLE).

METHODS

A total of 93 patients diagnosed with TLE at Xiangya Hospital during May 2022 and December 2022 and 85 healthy controls were included in this study. Participants were asked to complete neuropsychological scales and attention network test (ANT) with recording of eye-tracking and electroencephalogram.

RESULTS

All means of evaluation showed impaired attention functions in TLE patients. ANT results showed impaired orienting (p < 0.001) and executive control (p = 0.041) networks. Longer mean first saccade time (p = 0.046) and more total saccadic counts (p = 0.035) were found in eye-tracking results, indicating abnormal alerting and orienting networks. Both alerting, orienting and executive control networks were abnormal, manifesting as decreased amplitudes (N1 & P3, p < 0.001) and extended latency (P3, p = 0.002). The energy of theta, alpha and beta were all sensitive to the changes of alerting and executive control network with time, but only beta power was sensitive to the changes of orienting network.

CONCLUSION

Our findings are helpful for early identification of patients with TLE combined with attention impairments, which have strong clinical guiding significance for long-term monitoring and intervention.

Within-Person Test Score Distributions: How Typical Is "Normal"?

We evaluated within-person variability across a cognitive test battery by analyzing the shape of the distribution of each individual's scores within a battery of tests. We hypothesized that most healthy adults would produce test scores that are normally distributed around their own personal battery-wide, within-person (wp) mean. Using cross-sectional data from 327 neurologically healthy adults, we computed each person's mean, standard deviation, skew, and kurtosis for 30 neuropsychological measures. Raw scores were converted to T-scores using three degrees of calibration: (a) none, (b) age, and (c) age, sex, race, education, and estimated premorbid IQ. Regardless of calibration, no participant showed abnormal within-person skew (wpskew) and only 10 (3.1%) to 16 (4.9%) showed wpkurtosis greater than 2. If replicated in other samples and measures, these findings could illuminate how healthy individuals are endowed with different cognitive abilities and provide the foundation for a new method of inference in clinical neuropsychology.

The classification accuracy of Warrington's recognition memory test (words) as a performance validity Test in a neurorehabilitation setting

This study was designed to evaluate the classification accuracy of the Warrington's Recognition Memory Test (RMT) in 167 patients (97 or 58.1% men; MAge = 40.4; MEducation= 13.8) medically referred for neuropsychological evaluation against five psychometrically defined criterion groups. At the optimal cutoff (≤42), the RMT produced an acceptable combination of sensitivity (.36-.60) and specificity (.85-.95), correctly classifying 68.4-83.3% of the sample. Making the cutoff more conservative (≤41) improved specificity (.88-.95) at the expense of sensitivity (.30-.60). Lowering the cutoff to ≤40 achieved uniformly high specificity (.91-.95) but diminished sensitivity (.27-.48). RMT scores were unrelated to lateral dominance, education, or gender. The RMT was sensitive to a three-way classification of performance validity (Pass/Borderline/Fail), further demonstrating its discriminant power. Despite a notable decline in research studies focused on its classification accuracy within the last decade, the RMT remains an effective free-standing PVT that is robust to demographic variables. Relatively low sensitivity is its main liability. Further research is needed on its cross-cultural validity (sensitivity to limited English proficiency).

Cross-validation of the Trail Making Test as a non-memory-based embedded performance validity test among veterans with and without cognitive impairment

OBJECTIVE

This study cross-validated multiple Trail Making Test (TMT) Parts A and B scores as non-memory-based embedded performance validity tests (PVTs) for detecting invalid neuropsychological performance among veterans with and without cognitive impairment.

METHOD

Data were collected from a demographically and diagnostically diverse mixed clinical sample of 100 veterans undergoing outpatient neuropsychological evaluation at a Southwestern VA Medical Center. As part of a larger battery of neuropsychological tests, all veterans completed TMT A and B and four independent criterion PVTs, which were used to classify veterans into valid (n = 75) and invalid (n = 25) groups. Among the valid group 47% (n = 35) were cognitively impaired.

RESULTS

Among the overall sample, all embedded PVTs derived from TMT A and B raw and demographically corrected T-scores significantly differed between validity groups (ηp2 = .21-.31) with significant areas under the curve (AUCs) of .72-.78 and 32-48% sensitivity (≥91% specificity) at optimal cut-scores. When subdivided by cognitive impairment status (i.e., valid-unimpaired vs. invalid; valid-impaired vs. invalid), all TMT scores yielded significant AUCs of .80-.88 and 56%-72% sensitivity (≥90% specificity) at optimal cut-scores. Among veterans with cognitive impairment, neither TMT A or B raw scores were able to significantly differentiate the invalid from the valid-cognitively impaired group; however, demographically corrected T-scores were able to significantly differentiate groups but had poor classification accuracy (AUCs = .66-.68) and reduced sensitivity of 28%-44% (≥91% specificity).

CONCLUSIONS

Embedded PVTs derived from TMT Parts A and B raw and T-scores were able to accurately differentiate valid from invalid neuropsychological performance among veterans without cognitive impairment; however, the demographically corrected T-scores generally were more robust and consistent with prior studies compared to raw scores. By contrast, TMT embedded PVTs had poor accuracy and low sensitivity among veterans with cognitive impairment, suggesting limited utility as PVTs among populations with cognitive dysfunction.

Feigning Adult ADHD on a Comprehensive Neuropsychological Test Battery: An Analogue Study

The evaluation of performance validity is an essential part of any neuropsychological evaluation. Validity indicators embedded in routine neuropsychological tests offer a time-efficient option for sampling performance validity throughout the assessment while reducing vulnerability to coaching. By administering a comprehensive neuropsychological test battery to 57 adults with ADHD, 60 neurotypical controls, and 151 instructed simulators, we examined each test's utility in detecting noncredible performance. Cut-off scores were derived for all available outcome variables. Although all ensured at least 90% specificity in the ADHD Group, sensitivity differed significantly between tests, ranging from 0% to 64.9%. Tests of selective attention, vigilance, and inhibition were most useful in detecting the instructed simulation of adult ADHD, whereas figural fluency and task switching lacked sensitivity. Five or more test variables demonstrating results in the second to fourth percentile were rare among cases of genuine adult ADHD but identified approximately 58% of instructed simulators.

Conner's Continuous Performance Test and Adult ADHD: A Systematic Literature Review

OBJECTIVE

ADHD is a neurodevelopmental disorder affecting millions of adults worldwide. Continuous performance tests (CPTs) are widely used as assessment and diagnostic tools; however, their use in diagnosing undiagnosed ADHD in adults has been questioned due to their lack of specificity and sensitivity. This review sought to outline relevant findings concerning the diagnostic utility of the Conner's Continuous Performance Test (CCPT) in adults.

METHOD

This systematic review followed the a priori guide outlined by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement. Articles were gathered from PsycINFO, PsycArticles, Cochrane, Scopus, Google Scholar, and PubMed.

RESULTS

Thirty-five articles were reviewed and analyzed. Most articles reviewed used outpatient and university populations. Moderate reliability, subpar discriminant and ecological validity, and mixed sensitivity and specificity were noted.

CONCLUSION

The results of this review lend support to previous critiques of the CCPT's diagnostic and utility as a treatment measure.

Settling the Score: Can CPT-3 Embedded Validity Indicators Distinguish Between Credible and Non-Credible Responders Referred for ADHD and/or SLD?

OBJECTIVE

The purpose of the present study was to further investigate the clinical utility of individual and composite indicators within the CPT-3 as embedded validity indicators (EVIs) given the discrepant findings of previous investigations.

METHODS

A total of 201 adults undergoing psychoeducational evaluation for ADHD and/or Specific Learning Disorder (SLD) were divided into credible (n = 159) and non-credible (n = 42) groups based on five criterion measures.

RESULTS

Receiver operating characteristic curves (ROC) revealed that 5/9 individual indicators and 2/4 composite indicators met minimally acceptable classification accuracy of ≥0.70 (AUC = 0.43-0.78). Individual (0.16-0.45) and composite indicators (0.23-0.35) demonstrated low sensitivity when using cutoffs that maintained specificity ≥90%.

CONCLUSION

Given the lack of stability across studies, further research is needed before recommending any specific cutoff be used in clinical practice with individuals seeking psychoeducational assessment.

Replication and cross-validation of the personality assessment inventory (PAI) cognitive bias scale (CBS) in a mixed clinical sample

Objective: This study is a cross-validation of the Cognitive Bias Scale (CBS) from the Personality Assessment Inventory (PAI), a ten-item scale designed to assess symptom endorsement associated with performance validity test failure in neuropsychological samples. The study utilized a mixed neuropsychological sample of consecutively referred patients at a large academic medical center in the Midwest. Participants and Methods: Participants were 332 patients who completed embedded and free-standing performance validity tests (PVTs) and the PAI. Pass and fail groups were created based on PVT performance to evaluate classification accuracy of the CBS. Results: The results were generally consistent with the initial study for overall classification accuracy, sensitivity, and cut-off score. Consistent with the validation study, CBS had better classification accuracy than the original PAI validity scales and a comparable effect size to that obtained in the original validation publication; however, the Somatic Complaints scale (SOM) and the Conversion subscale (SOM-C) also demonstrated good classification accuracy. The CBS had incremental predictive ability compared to existing PAI scales. Conclusions: The results supported the CBS, but further research is needed on specific populations. Findings from this present study also suggest the relationship between conversion tendencies and PVT failure may be stronger in some geographic locations or population types (forensic versus clinical patients).

Validation of the Personality Assessment Inventory (PAI) scale of scales in a mixed clinical sample

Objective: This exploratory study examined the classification accuracy of three derived scales aimed at detecting cognitive response bias in neuropsychological samples. The derived scales are composed of existing scales from the Personality Assessment Inventory (PAI). A mixed clinical sample of consecutive outpatients referred for neuropsychological assessment at a large Midwestern academic medical center was utilized. Participants and Methods: Participants included 332 patients who completed study's embedded and free-standing performance validity tests (PVTs) and the PAI. PASS and FAIL groups were created based on PVT performance to evaluate the classification accuracy of the derived scales. Three new scales, Cognitive Bias Scale of Scales 1-3, (CB-SOS1-3) were derived by combining existing scales by either summing the scales together and dividing by the total number of scales summed, or by logistically deriving a variable from the contributions of several scales. Results: All of the newly derived scales significantly differentiated between PASS and FAIL groups. All of the derived SOS scales demonstrated acceptable classification accuracy (i.e. CB-SOS1 AUC = 0.72; CB-SOS2 AUC = 0.73; CB-SOS3 AUC = 0.75). Conclusions: This exploratory study demonstrates that attending to scale-level PAI data may be a promising area of research in improving prediction of PVT failure.

Assessing performance validity during attention-deficit/hyperactivity disorder evaluations: Cross-validation of non-memory embedded validity indicators

Embedded performance validity tests (PVTs) are key components of neuropsychological evaluations. However, most are memory-based and may be less useful in the assessment of attention-deficit/hyperactivity disorder (ADHD). Four non-memory-based validity indices derived from processing speed and executive functioning measures commonly included in ADHD evaluations, namely Verbal Fluency (VF) and the Trail Making Test (TMT), were cross-validated using the Rey 15-Item Test (RFIT) Recall and Recall/Recognition as memory-based comparison measures. This consecutive case series included data from 416 demographically-diverse adults who underwent outpatient neuropsychological evaluation for ADHD. Validity classifications were established, with ≤1 PVT failure of five independent criterion PVTs as indicative of valid performance (374 valid performers/42 invalid performers). Among the statistically significant validity indicators, TMT-A and TMT-B T-scores (AUCs = .707-.723) had acceptable classification accuracy ranges and sensitivities ranging from 29%-36% (≥89% specificity). RFIT Recall/Recognition produced similar results as TMT-B T-score with 42% sensitivity/90% specificity, but with lower classification accuracy. In evaluating adult ADHD, VF and TMT embedded PVTs demonstrated comparable sensitivity and specificity values to those found in other clinical populations but necessitated alternate cut-scores. Results also support use of RFIT Recall/Recognition over the standard RFIT Recall as a PVT for adult ADHD evaluations.

Examining Conners Continuous Performance Test-3 (CPT-3) Embedded Performance Validity Indicators in an Adult Clinical Sample Referred for ADHD Evaluation

This study evaluated multiple previously-identified Continuous Performance Test-Third Edition (CPT-3) scores as embedded validity indicators (EVIs) among 201 adults undergoing neuropsychological evaluation for Attention-Deficit/Hyperactivity Disorder (ADHD) divided into valid (n = 169) and invalid (n = 32) groups based on seven criterion measures. Although 6/10 CPT-3 scores accurately detected invalidity, only two reached minimally acceptable classification accuracy of ≥0.70. The remaining four had unacceptably low accuracy (AUCs = 0.62-0.69) with 0.19-0.41 sensitivity at ≥0.90 specificity. Composite scores did not provide better classification accuracy than individual CPT-3 scores. In sum, CPT-3 individual and composite scores generally are not accurate PVTs among adults undergoing clinical evaluation for ADHD.

Differential effects of deployment and nondeployment mild TBI on neuropsychological outcomes

Objective: Mild traumatic brain injury (TBI) that occurs in a deployment environment is characteristically different from mild TBI that occurs outside of deployment. This study evaluated differential and interaction effects of deployment and nondeployment mild TBI on cognitive and behavioral health outcomes. Research Method: Combat veterans (N = 293) who passed performance-validity measures completed the Mid-Atlantic MIRECC Assessment of TBI (MMA-TBI), Clinician-Administered Posttraumatic Stress Disorder (PTSD) Scale (CAPS-5), a neuropsychological assessment battery, and self-report questionnaires. A 2 × 2 × 2 analysis of variance (ANOVA) was conducted to evaluate the main and interaction effects across mild TBI groups and PTSD diagnosis. Results: Deployment TBI was associated with poorer outcomes on several cognitive tests: Wechsler Adult Intelligence Scale, 4th edition (WAIS-IV); Working Memory Index (WMI; p = .018); Trail Making Test A (TMT-A; p < .001); and Trail Making Test B (TMT-B; p = .002). Deployment TBI and PTSD were also associated with increased PTSD, depressive, and neurobehavioral symptoms; pain interference; and poorer sleep quality. Nondeployment TBI had no effect on cognitive performance and was associated only with poorer sleep quality. PTSD had the strongest associations with symptom measures and deployment TBI with cognitive outcomes. There were no significant interaction effects after adjusting for multiple comparisons. Conclusions: Remote outcomes associated with mild deployment TBI are different from those associated with nondeployment mild TBI and are robust beyond PTSD. This suggests that the environment surrounding a TBI event influences cognitive and symptom sequelae. Veterans who experience mild TBI during deployment may report changes in cognition, but most will continue to function within the expected range. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Influence of blast exposure on cognitive functioning in combat veterans

OBJECTIVE

We evaluated the contribution of blast-pressure severity to cognitive functioning beyond posttraumatic stress disorder (PTSD) severity and traumatic brain injury (TBI).

METHOD

Post-9/11 veterans (N = 254, 86.22% male) completed the Wechsler Adult Intelligence Scale (WAIS-IV) and Trail Making Test (TMT). The Clinician-Administered PTSD Scale (CAPS-5), Mid-Atlantic MIRECC Assessment of TBI, and the Salisbury Blast Interview evaluated PTSD diagnosis/severity, deployment TBI history/severity, and blast-exposure history/severity, respectively.

RESULTS

Veterans with mild deployment TBI had overall significantly lower T scores on the WAIS-IV Verbal Comprehension Index (d = .13), Working Memory Index (d = .30), and Processing Speed Index (d = .25); the Trail Making Test A (TMT-A; d = .50); and the Trail Making Test B (TMT-B; d = .37). Mild deployment TBI was significantly associated with TMT-A (ΔR² = .05, p < .001) and TMT-B (ΔR² = .03, p = .001) performance. Blast-pressure severity moderated the association between mild deployment TBI and TMT-A (ΔR² = .02, p = .039, B = -2.01).

CONCLUSION

Blast-pressure severity exacerbated the effects of mild TBI on a simple attention task, such that participants with TBI had gradual decrements in attention as blast severity increased. Veterans who incur a TBI and are exposed to blasts during deployment may experience persisting difficulties with cognitive functioning as a result of alterations in basic attention abilities. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Dementia-Related Neuropsychological Testing Considerations in Non-Hispanic White and Latino/Hispanic Populations

Hispanic individuals are at greater risk for health disparities, less than optimal health care, and are diagnosed at later stages of cognitive impairment than white non-Hispanics. Acculturation and different attitudes toward test-taking may result in decrements in performance, especially on unfamiliar measures that emphasize speed and accuracy. Non-Hispanic individuals often outperform Hispanic individuals on cognitive and neuropsychological measures in community and clinical populations. Current neuropsychological testing may not provide accurate data related to monolingual and bilingual individuals of Hispanic descent. Testing instruments were identified by searching academic databases using combinations of relevant search terms. Neuropsychological instruments were included if they were designed to detect cognitive impairment, had an administration time of less than 45 minutes, and were available in English. Validity studies were required to employ gold standard comparison diagnostic criteria. Twenty-nine instruments were evaluated in dementia staging, global cognition, memory, memory and visual abilities, working memory and attention, verbal learning and memory, recall, language, premorbid intelligence, literacy/cognitive reserve, visuospatial, attention, problem-solving, problem solving and perception, functional assessment, and mood/daily functioning domains. Spanish-language neuropsychological instruments need to be made widely available and existing instruments to be normed in Spanish to best serve and assess diverse populations. Psychometric data were reported for neuropsychological instruments, which may be administered to Hispanic older adults presenting for evaluation related to dementia-spectrum disorders. This is one of the few reviews to provide an overview of the sensitivity and specificity of available Spanish translated neuropsychological instruments.

A Psychometric Examination of the Anagram Persistence Task: More Than Two Unsolvable Anagrams May Not Be Better

The purpose of this investigation was to examine a single-anagram, a double-anagram, and multi-anagram versions of the Anagram Persistence Task (APT) for factorial validity, reliability, and convergent validity. Additionally, a battery of intelligence tests was administered to examine convergent validity. Based on an unrestricted factor analysis, two factors were uncovered from the 14 anagram (seven very difficult and seven very easy) response times: test-taking persistence and verbal processing speed. The internal consistency reliabilities for the single-anagram, double-anagram, and multi-anagram (seven difficult anagrams) measures were .42, .85, and .86, respectively. Furthermore, all three versions of the APT correlated positively with intelligence test performance (r ≈ .22). However, the double-anagram and multi-anagram versions also evidenced negative, nonlinear effects with intelligence test performance (r ≈ -.15), which suggested the possibility of testee adaptation. Taking psychometrics and administration time into consideration, simultaneously, the double-anagram version of the APT may be regarded as preferred.

Can threat detection be enhanced using processing strategies by police trainees and officers?

The ability to detect threatening stimuli is an important skill for police officers. No research has yet examined whether implementing different information processing strategies can improve threat detection in police officers and police trainees. The first aim of our study was to compare the effect of strategies accentuating the processing of the emotional or the semantic dimension of stimuli on attention towards threatening and neutral information. The second aim was to consider the impact of PTSD symptoms on threat detection, as a function of processing strategies, in police officers and trainees. In a cueing paradigm, participants had to respond to a target that was presented following a threatening or neutral cue. Participants then answered a question, known beforehand, concerning the cue. The question was used to induce a more emotional or semantic processing strategy. Results showed that when the processing strategy was emotional, police trainees and officers were faster to detect the target when it followed a threatening cue, compared to a neutral cue, independently of its spatial location. This was not the case when the processing strategy was semantic. This study shows that induced processing strategies can influence attentional mechanisms related to threat detection in police trainees and police officers.

Aggregating validity indicators: The salience of domain specificity and the indeterminate range in multivariate models of performance validity assessment

This study was designed to examine the "domain specificity" hypothesis in performance validity tests (PVTs) and the epistemological status of an "indeterminate range" when evaluating the credibility of a neuropsychological profile using a multivariate model of performance validity assessment. While previous research suggests that aggregating PVTs produces superior classification accuracy compared to individual instruments, the effect of the congruence between the criterion and predictor variable on signal detection and the issue of classifying borderline cases remain understudied. Data from a mixed clinical sample of 234 adults referred for cognitive evaluation (M_Age = 46.6; M_Education = 13.5) were collected. Two validity composites were created: one based on five verbal PVTs (EI-5_VER) and one based on five nonverbal PVTs (EI-5_NV) and compared against several other PVTs. Overall, language-based tests of cognitive ability were more sensitive to elevations on the EI-5_VER compared to visual-perceptual tests; whereas, the opposite was observed with the EI-5_NV. However, the match between predictor and criterion variable had a more complex relationship with classification accuracy, suggesting the confluence of multiple factors (sensory modality, cognitive domain, testing paradigm). An "indeterminate range" of performance validity emerged that was distinctly different from both the Pass and the Fail group. Trichotomized criterion PVTs (Pass-Borderline-Fail) had a negative linear relationship with performance on tests of cognitive ability, providing further support for an "in-between" category separating the unequivocal Pass and unequivocal Fail classification range. The choice of criterion variable can influence classification accuracy in PVT research. Establishing a Borderline range between Pass and Fail more accurately reflected the distribution of scores on multiple PVTs. The traditional binary classification system imposes an artificial dichotomy on PVTs that was not fully supported by the data. Accepting "indeterminate" as a legitimate third outcome of performance validity assessment has the potential to improve the clinical utility of PVTs and defuse debates regarding "near-Passes" and "soft Fails."

Adolescent maturation of the relationship between cortical gyrification and cognitive ability

There are changes to the degree of cortical folding from gestation through adolescence into young adulthood. Recent evidence suggests that degree of cortical folding is linked to individual differences in general cognitive ability in healthy adults. However, it is not yet known whether age-related cortical folding changes are related to maturation of specific cognitive abilities in adolescence. To address this, we examined the relationship between frontoparietal cortical folding as measured by a Freesurfer-derived local gyrification index (lGI) and performance on subtests from the Wechsler Abbreviated Scale of Intelligence and scores from Conner's Continuous Performance Test-II in 241 healthy adolescents (ages 12-25 years). We hypothesized that age-related lGI changes in the frontoparietal cortex would contribute to cognitive development. A secondary goal was to explore if any gyrification-cognition relationships were either test-specific or sex-specific. Consistent with previous studies, our results showed a reduction of frontoparietal local gyrification with age. Also, as predicted, all cognitive test scores (i.e., Vocabulary, Matrix Reasoning, the CPT-II Commission, Omission, Variabiltiy, d') showed age × cognitive ability interaction effects in frontoparietal and temporoparietal brain regions. Mediation analyses confirmed a causal role of age-related cortical folding changes only for CPT-II Commission errors. Taken together, the results support the functional significance of cortical folding, as well as provide the first evidence that cortical folding maturational changes play a role in cognitive development.

Cognitive persistence: Development and validation of a novel measure from the Wisconsin Card Sorting Test

The Wisconsin Card Sorting Test (WCST) has long been used as a neuropsychological assessment of executive function abilities, in particular, cognitive flexibility or "set-shifting". Recent advances in scoring the task have helped to isolate specific WCST performance metrics that index set-shifting abilities and have improved our understanding of how prefrontal and parietal cortex contribute to set-shifting. We present evidence that the ability to overcome task difficulty to achieve a goal, or "cognitive persistence", is another important prefrontal function that is characterized by the WCST and that can be differentiated from efficient set-shifting. This novel measure of cognitive persistence was developed using the WCST-64 in an adult lifespan sample of 230 participants. The measure was validated using individual variation in cingulo-opercular cortex function in a sub-sample of older adults who had completed a challenging speech recognition in noise fMRI task. Specifically, older adults with higher cognitive persistence were more likely to demonstrate word recognition benefit from cingulo-opercular activity. The WCST-derived cognitive persistence measure can be used to disentangle neural processes involved in set-shifting from those involved in persistence.

Exploring the sensitivity of the Personality Assessment Inventory symptom validity tests in detecting response bias in a mixed neuropsychological outpatient sample

OBJECTIVE

Few studies have evaluated the symptom validity tests (SVTs) within the Personality Assessment Inventory (PAI) in a neuropsychological assessment context. Accordingly, the present study explored the accuracy of PAI SVTs in identifying exaggerated cognitive dysfunction in a mixed sample of outpatients referred for neuropsychological assessment.

METHOD

Participants who failed two or more Performance Validity Tests (PVTs) were classified as having exaggerated cognitive dysfunction (n = 49). Their responses on PAI SVTs were compared to examinees who did not fail PVTs (n = 257).

RESULTS

Multivariate analysis of variance indicated the Negative Impression Management (NIM) scale most strongly discriminated between those with exaggerated cognitive dysfunction from honest responders (Cohen's d = .58). Nonetheless, its classification accuracy was low (area under the curve [AUC] = .65). A k-means cluster analysis and a subsequent multinomial logistic regression indicated evidence for two distinct groups of exaggerators. In particular, one group seemed to exaggerate symptoms, whereas another presented in a defensive manner, implying that individuals with positive and NIM biases on the PAI were apt to display invalid performance on PVTs.

CONCLUSIONS

Findings indicated that exaggerated cognitive dysfunction tends to be present when NIM is very high and that evidence exists for a defensive response style on the PAI in the context of PVT failure.

Assessment of Performance Validity Using Embedded Saccadic and Manual Indices on a Continuous Performance Test

OBJECTIVE

In addition to manual (i.e., "button press") metrics, oculomotor metrics demonstrate considerable promise as tools for detecting invalid responding in neurocognitive assessment. This study was conducted to evaluate saccadic and manual metrics from a computerized continuous performance test as embedded indices of performance validity.

METHOD

Receiver operating characteristic analyses, logistic regressions, and ANOVAs were performed to evaluate saccadic and manual metrics in classification of healthy adults instructed to feign deficits ("Fake Bad" group; n = 24), healthy adults instructed to perform their best ("Best Effort" group; n = 26), and adults with a history of mild traumatic brain injury (TBI) who passed a series of validity indices ("mTBI-Pass" group; n = 19).

RESULTS

Several saccadic and manual metrics achieved outstanding classification accuracy between Fake Bad versus Best Effort and mTBI-Pass groups, including variability (consistency) of saccadic and manual response time (RT), saccadic commission errors, and manual omission errors. Very large effect sizes were obtained between Fake Bad and Best Effort groups (Cohen's d range: 1.89-2.90; r range: .75-.78) as well as between Fake Bad and mTBI-Pass groups (Cohen's d range: 1.32-2.21; r range: .69-.71). The Fake Bad group consistently had higher saccadic and manual RT variability, more saccadic commission errors, and more manual omission errors than the Best Effort and mTBI-Pass groups.

CONCLUSIONS

These findings are the first to demonstrate that eye movements can be used to detect invalid responding in neurocognitive assessment. These results also provide compelling evidence that concurrently measured saccadic and manual metrics can detect invalid responding with high levels of sensitivity and specificity.

Efficacy of repetitive transcranial magnetic stimulation with quetiapine in treating bipolar II depression: a randomized, double-blinded, control study

The clinical and cognitive responses to repetitive transcranial magnetic stimulation (rTMS) in bipolar II depressed patients remain unclear. In this study, thirty-eight bipolar II depressed patients were randomly assigned into three groups: (i) left high-frequency (n = 12), (ii) right low-frequency (n = 13), (iii) sham stimulation (n = 13), and underwent four-week rTMS with quetiapine concomitantly. Clinical efficacy was evaluated at baseline and weekly intervals using the 17-item Hamilton Depression Rating Scale (HDRS-17) and Montgomery-Asberg Depression Rating Scale (MADRS). Cognitive functioning was assessed before and after the study with the Wisconsin Card Sorting Test (WCST), Stroop Word-Color Interference Test (Stroop), and Trail Making Test (TMT). Thirty-five patients were included in the final analysis. Overall, the mean scores of both the HDRS-17 and the MADRS significantly decreased over the 4-week trial, which did not differ among the three groups. Exploratory analyses revealed no differences in factor scores of HDRS-17s, or in response or remission rates. Scores of WCST, Stroop, or TMT did not differ across the three groups. These findings indicated active rTMS combined with quetiapine was not superior to quetiapine monotherapy in improving depressive symptoms or cognitive performance in patients with bipolar II depression.

The Effects of Repeated Testing, Simulated Malingering, and Traumatic Brain Injury on Visual Choice Reaction Time

Choice reaction time (CRT), the time required to discriminate and respond appropriately to different stimuli, is a basic measure of attention and processing speed. Here, we describe the reliability and clinical sensitivity of a new CRT test that presents lateralized visual stimuli and adaptively adjusts stimulus onset asynchronies using a staircase procedure. Experiment 1 investigated the test–retest reliability in three test sessions performed at weekly intervals. Performance in the first test session was accurately predicted from age and computer-use regression functions obtained in a previously studied normative cohort. Central processing time (CentPT), the difference between the CRTs and simple reaction time latencies measured in a separate experiment, accounted for 55% of CRT latency and more than 85% of CRT latency variance. Performance improved significantly across the three test sessions. High intraclass correlation coefficients were seen for CRTs (0.90), CentPTs (0.87), and an omnibus performance measure (0.81) that combined CRT and minimal SOA z-scores. Experiment 2 investigated performance in the same participants when instructed to feign symptoms of traumatic brain injury (TBI): 87% produced abnormal omnibus z-scores. Simulated malingerers showed greater elevations in simple reaction times than CRTs, and hence reduced CentPTs. Latency-consistency z-scores, based on the difference between the CRTs obtained and those predicted based on CentPT latencies, discriminated malingering participants from controls with high sensitivity and specificity. Experiment 3 investigated CRT test performance in military veterans who had suffered combat-related TBI and symptoms of post-traumatic stress disorder, and revealed small but significant deficits in performance in the TBI population. The results indicate that the new CRT test shows high test–retest reliability, can assist in detecting participants performing with suboptimal effort, and is sensitive to the effects of TBI on the speed and accuracy of visual processing.

The Effects of Aging, Malingering, and Traumatic Brain Injury on Computerized Trail-Making Test Performance

The trail making test (TMT) is widely used to assess speed of processing and executive function. However, normative data sets gathered at different sites show significant inconsistencies. Here, we describe a computerized version of the TMT (C-TMT) that increases the precision and replicability of the TMT by permitting a segment-by-segment analysis of performance and separate analyses of dwell-time, move-time, and error time. Experiment 1 examined 165 subjects of various ages and found that completion times on both the C-TMT-A (where subjects connect successively numbered circles) and the C-TMT-B (where subjects connect circles containing alternating letters and numbers) were strongly influenced by age. Experiment 2 examined 50 subjects who underwent three test sessions. The results of the first test session were well fit by the normative data gathered in Experiment 1. Sessions 2 and 3 demonstrated significant learning effects, particularly on the C-TMT-B, and showed good test-retest reliability. Experiment 3 examined performance in subjects instructed to feign symptoms of traumatic brain injury: 44% of subjects produced abnormal completion times on the C-TMT-A, and 18% on the C-TMT-B. Malingering subjects could be distinguished from abnormally slow controls based on (1) disproportionate increases in dwell-time on the C-TMT-A, and (2) greater deficits on the C-TMT-A than on the C-TMT-B. Experiment 4 examined the performance of 28 patients with traumatic brain injury: C-TMT-B completion times were slowed, and TBI patients showed reduced movement velocities on both tests. The C-TMT improves the reliability and sensitivity of the trail making test of processing speed and executive function.

Systemically treated breast cancer patients and controls: an evaluation of the presence of noncredible performance

This study sought to define the frequency of noncredible performance in breast cancer patients before, during and after completion of systemic treatment, as well as predictors of noncredible performance. We examined six datasets investigating the cognitive effects of chemotherapy and/or endocrine therapy. Embedded performance validity test (PVT) measures were identified and used to evaluate the datasets. One dataset included a standalone PVT. Possible noncredible performance was operationally defined as performance below criterion on three or more PVT indices. This was undertaken as cancer patients have been observed clinically to fail PVTs both in the context of external gain and independent of such motivators. A total of 534 breast cancer patients and 214 healthy controls were included in the analysis. Percentages of patients performing below cutoff on one or more PVT varied from 0% to 21.2%. Only 1 patient met the criterion of noncredible performance. Calculation of post-test probabilities indicated a more than 90% chance to detect noncredible performance. There is no evidence to suggest noncredible performance in breast cancer patients and healthy controls who choose to participate in research studies examining cognitive function. Thus, the observational data showing that non-central nervous system (CNS) cancer and therapies not targeting the CNS can have untoward effects on cognitive function are unlikely to be due to noncredible performance.