Introducing Alternative Validity Cutoffs to Improve the Detection of Non-credible Symptom Report on the BRIEF

Persistence and emergence of new neuropsychological deficits following SARS-CoV-2 infection: A follow-up assessment of the Geneva COVID-COG cohort

Background

Despite numerous observations of neuropsychological deficits immediately following severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, little is known about what happens to these deficits over time and whether they are affected by changes in fatigue and any psychiatric symptoms. We aimed to assess the prevalence of neuropsychological deficits at 6-9 months and again at 12-15 months after coronavirus disease 2019 (COVID-19) and to explore whether it was associated with changes in fatigue and psychiatric symptoms.

Methods

We administered a series of neuropsychological tests and psychiatric questionnaires to 95 patients (mean age = 57.12 years, standard deviation (SD) = 10.68; 35.79% women) 222 (time point 1 (T1)) and 441 (time point 2 (T2)) days on average after infection. Patients were categorised according to the severity of their respiratory COVID-19 symptoms in the acute phase: mild (no hospitalisation), moderate (conventional hospitalisation), and severe (hospitalisation in intensive care unit (ICU) plus mechanical ventilation). We ran Monte-Carlo simulation methods at each time point to generate a simulated population and then compared the cumulative percentages of cognitive disorders displayed by the three patient subgroups with the estimated normative data. We calculated generalised estimating equations for the whole sample to assess the longitudinal associations between cumulative neuropsychological deficits, fatigue, and psychiatric data (anxiety, depressive symptoms, posttraumatic stress disorder, and apathy).

Results

Most participants (>50%) exhibited a decrease in their neuropsychological impairments, while approximately 25% showed an escalation in these cognitive deficits. At T2, patients in the mild subgroup remained free of accumulated neuropsychological impairments. Patients with moderate severity of symptoms displayed a decrease in the magnitude of cumulative deficits in perceptual and attentional functions, a persistence of executive, memory and logical reasoning deficits, and the emergence of language deficits. In patients with severe symptoms, perceptual deficits emerged and executive deficits increased, while attentional and memory deficits remained unchanged. Changes in executive functions were significantly associated with changes in depressive symptoms, but the generalised estimating equations failed to reveal any other significant effect.

Conclusion

While most cumulative neuropsychological deficits observed at T1 persisted and even worsened over time in the subgroups of patients with moderate and severe symptoms, a significant proportion of patients, mainly in the mild subgroup, exhibited improved performances. However, we identified heterogeneous neuropsychological profiles both cross-sectionally and over time, suggesting that there may be distinct patient phenotypes. Predictors of these detrimental dynamics have yet to be identified.

Replicating a Meta-Analysis: The Search for the Optimal Word Choice Test Cutoff Continues

This study was designed to expand on a recent meta-analysis that identified ≤42 as the optimal cutoff on the Word Choice Test (WCT). We examined the base rate of failure and the classification accuracy of various WCT cutoffs in four independent clinical samples (N = 252) against various psychometrically defined criterion groups. WCT ≤ 47 achieved acceptable combinations of specificity (.86-.89) at .49 to .54 sensitivity. Lowering the cutoff to ≤45 improved specificity (.91-.98) at a reasonable cost to sensitivity (.39-.50). Making the cutoff even more conservative (≤42) disproportionately sacrificed sensitivity (.30-.38) for specificity (.98-1.00), while still classifying 26.7% of patients with genuine and severe deficits as non-credible. Critical item (.23-.45 sensitivity at .89-1.00 specificity) and time-to-completion cutoffs (.48-.71 sensitivity at .87-.96 specificity) were effective alternative/complementary detection methods. Although WCT ≤ 45 produced the best overall classification accuracy, scores in the 43 to 47 range provide comparable objective psychometric evidence of non-credible responding. Results question the need for designating a single cutoff as "optimal," given the heterogeneity of signal detection environments in which individual assessors operate. As meta-analyses often fail to replicate, ongoing research is needed on the classification accuracy of various WCT cutoffs.

The combined value of executive functions and self-regulated learning to predict differences in study success among higher education students

Introduction

Self-regulated learning (SRL) has traditionally been associated with study success in higher education. In contrast, study success is still rarely associated with executive functions (EF), while it is known from neuropsychological practice that EF can influence overall functioning and performance. However some studies have shown relationships between EF and study success, but this has mainly been investigated in school children and adolescents. EF refer to higher-order cognitive processes to regulate cognition, behavior, and emotion in service of adaptive and goal-directed behaviors. SRL is a dynamic process in which learners activate and maintain cognitions, affects, and behaviors to achieve personal learning goals. This study explores the added value of including EF and SRL to predict study success (i.e., the obtained credits).

Methods

In this study, we collected data from 315 first-year psychology students of a University of Applied Sciences in the Netherlands who completed questionnaires related to both EF (BRIEF) and SRL (MSLQ) two months after the start of the academic year. Credit points were obtained at the end of that first academic year. We used Structural Equation Modeling to test whether EF and SRL together explain more variance in study success than either concept alone.

Results

EF explains 19.8% of the variance, SRL 22.9%, and in line with our hypothesis, EF and SRL combined explain 39.8% of the variance in obtained credits.

Discussion

These results indicate that focusing on EF and SRL could lead to a better understanding of how higher education students learn successfully. This might be the objective of further investigation.

Acute TNFα levels predict cognitive impairment 6-9 months after COVID-19 infection

BACKGROUND

A neurocognitive phenotype of post-COVID-19 infection has recently been described that is characterized by a lack of awareness of memory impairment (i.e., anosognosia), altered functional connectivity in the brain's default mode and limbic networks, and an elevated monocyte count. However, the relationship between these cognitive and brain functional connectivity alterations in the chronic phase with the level of cytokines during the acute phase has yet to be identified.

AIM

Determine whether acute cytokine type and levels is associated with anosognosia and functional patterns of brain connectivity 6-9 months after infection.

METHODS

We analyzed the predictive value of the concentration of acute cytokines (IL-1RA, IL-1β, IL-6, IL-8, IFNγ, G-CSF, GM-CSF) (cytokine panel by multiplex immunoassay) in the plasma of 39 patients (mean age 59 yrs, 38-78) in relation to their anosognosia scores for memory deficits via stepwise linear regression. Then, associations between the different cytokines and brain functional connectivity patterns were analyzed by MRI and multivariate partial least squares correlations for the whole group.

RESULTS

Stepwise regression modeling allowed us to show that acute TNFα levels predicted (R² = 0.145; β = -0.38; p = .017) and were associated (r = -0.587; p < .001) with scores of anosognosia for memory deficits observed 6-9 months post-infection. Finally, high TNFα levels were associated with hippocampal, temporal pole, accumbens nucleus, amygdala, and cerebellum connectivity.

CONCLUSION

Increased plasma TNFα levels in the acute phase of COVID-19 predict the presence of long-term anosognosia scores and changes in limbic system functional connectivity.

Brain functional connectivity alterations associated with neuropsychological performance 6-9 months following SARS-CoV-2 infection

Neuropsychological deficits and brain damage following SARS-CoV-2 infection are not well understood. Then, 116 patients, with either severe, moderate, or mild disease in the acute phase underwent neuropsychological and olfactory tests, as well as completed psychiatric and respiratory questionnaires at 223 ± 42 days postinfection. Additionally, a subgroup of 50 patients underwent functional magnetic resonance imaging. Patients in the severe group displayed poorer verbal episodic memory performances, and moderate patients had reduced mental flexibility. Neuroimaging revealed patterns of hypofunctional and hyperfunctional connectivities in severe patients, while only hyperconnectivity patterns were observed for moderate. The default mode, somatosensory, dorsal attention, subcortical, and cerebellar networks were implicated. Partial least squares correlations analysis confirmed specific association between memory, executive functions performances and brain functional connectivity. The severity of the infection in the acute phase is a predictor of neuropsychological performance 6-9 months following SARS-CoV-2 infection. SARS-CoV-2 infection causes long-term memory and executive dysfunctions, related to large-scale functional brain connectivity alterations.

Embedded cognitive and emotional/affective self-reported symptom validity indices on the patient competency rating scale

OBJECTIVE

Although there is an abundance of research on stand-alone and embedded performance validity tests and stand-alone symptom validity tests (SVTs), less emphasis has been placed on embedded SVTs. The goal of the current study was to examine the ability of embedded indicators within the Patient Competency Rating Scale (PCRS) to separately detect invalid cognitive and/or emotional/affective symptom responding.

METHOD

Participants included 299 veterans assessed in a VA medical center epilepsy monitoring unit from 2013-2017 (mean age = 48.8 years, SD = 13.5 years). Two SVT composites were created; self-reported cognitive symptom validity (SVT-C) and self-reported emotional/affective symptom validity (SVT-E). Groups were compared on PCRS total and index scores (i.e., cognitive, activities of daily living, emotional, and interpersonal competencies) using ANOVAs. Receiver operating characteristic (ROC) curve analyses assessed the classification accuracy of the PCRS total and index scores for SVT-C and SVT-E.

RESULTS

In ANOVAs, SVT-C was significantly associated with all PCRS indices, while SVT-E was only significantly associated with the PCRS total, emotional, and interpersonal competency indices. Although the PCRS-T ≤ 90 had the strongest classification of SVT-C and SVT-E (specificities: .90, sensitivities: .44 to .50), PCRS index scores showed suggestive evidence of domain specificity, with PCRS-ADL ≤22, PCRS-C ≤ 20, and PCRS-CADL ≤45 best classifying SVT-C (specificities: .92, sensitivities: .33) and the PCRS-E ≤ 18 best classifying the SVT-E group (specificity: .93, sensitivity: .40).

CONCLUSION

Results suggest the PCRS may be used to obtain clinically useful information while including embedded indicators that can assess cognitive and/or emotional/affective symptom invalidity.

Take Their Word for It: The Inventory of Problems Provides Valuable Information on Both Symptom and Performance Validity

This study was designed to compare the validity of the Inventory of Problems (IOP-29) and its newly developed memory module (IOP-M) in 150 patients clinically referred for neuropsychological assessment. Criterion groups were psychometrically derived based on established performance and symptom validity tests (PVTs and SVTs). The criterion-related validity of the IOP-29 was compared to that of the Negative Impression Management scale of the Personality Assessment Inventory (NIM_PAI) and the criterion-related validity of the IOP-M was compared to that of Trial-1 on the Test of Memory Malingering (TOMM-1). The IOP-29 correlated significantly more strongly (z = 2.50, p = .01) with criterion PVTs than the NIM_PAI (r_IOP-29 = .34; r_NIM-PAI = .06), generating similar overall correct classification values (OCC_IOP-29: 79-81%; OCC_NIM-PAI: 71-79%). Similarly, the IOP-M correlated significantly more strongly (z = 2.26, p = .02) with criterion PVTs than the TOMM-1 (r_IOP-M = .79; r_TOMM-1 = .59), generating similar overall correct classification values (OCC_IOP-M: 89-91%; OCC_TOMM-1: 84-86%). Findings converge with the cumulative evidence that the IOP-29 and IOP-M are valuable additions to comprehensive neuropsychological batteries. Results also confirm that symptom and performance validity are distinct clinical constructs, and domain specificity should be considered while calibrating instruments.

The sensitivity of the IOP-29 and IOP-M to coached feigning of depression and mTBI: An online simulation study in a community sample from the United Kingdom

Assessing the credibility of symptoms is critical to neuropsychological assessment in both clinical and forensic settings. To this end, the Inventory of Problems-29 (IOP-29) and its recently added memory module (Inventory of Problems-Memory; IOP-M) appear to be particularly useful, as they provide a rapid and cost-effective measure of both symptom and performance validity. While numerous studies have already supported the effectiveness of the IOP-29, research on its newly developed module, the IOP-M, is much sparser. To address this gap, we conducted a simulation study with a community sample (N = 307) from the United Kingdom. Participants were asked to either (a) respond honestly or (b) pretend to suffer from mTBI or (c) pretend to suffer from depression. Within each feigning group, half of the participants received a description of the symptoms of the disorder to be feigned, and the other half received both a description of the symptoms of the disorder to be feigned and a warning not to over-exaggerate their responses or their presentation would not be credible. Overall, the results confirmed the effectiveness of the two IOP components, both individually and in combination.

Frequency of Abnormally Low Neuropsychological Scores in Post-COVID-19 Syndrome: the Geneva COVID-COG Cohort

OBJECTIVE

Several studies have reported poor long-term neuropsychological performances in patients following severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, but none has yet considered the effect of administering multiple intercorrelated neuropsychological tests and assessed the frequency of cognitive deficits in a normative population. Our aim was therefore to assess the presence of cumulative neuropsychological deficits in an actual post-coronavirus disease of 2019 (COVID-19) comparison group versus one simulated using Monte-Carlo methods.

METHOD

Validated neuropsychological Monte-Carlo simulation methods were applied to scores from a battery of neuropsychological tests (memory, executive, attentional, perceptual, logical reasoning, language, and ideomotor praxis) administered to 121 patients who had had mild, moderate, or severe COVID-19 (mean age: 56.70 years; 32% women), 222 ± 43 days post-infection. The cumulative percentages of the three severity subgroups were compared with the results of a false discovery rate-corrected probability analysis based on normative data.

RESULTS

The cumulative percentages of deficits in memory and executive functions among the severe and moderate patients were significantly higher than those estimated for the normative population. Moderate patients also had significantly more deficits in perception and logical reasoning. In contrast, the mild group did not have significantly more cumulative deficits.

CONCLUSIONS

Moderate and severe forms of COVID-19 cause greater long-term neuropsychological deficits than those that would be found in a normative population, reinforcing the hypothesis of long-term effects of SARS-CoV-2 on cognitive function, independent of the severity of the initial infection.

Long COVID Neuropsychological Deficits after Severe, Moderate, or Mild Infection

There is growing awareness that severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, even in its mild or moderate respiratory forms, can include long-term neuropsychological deficits. Standardized neuropsychological, psychiatric, neurological, and olfactory tests were administered to 45 patients 236.51 ± 22.54 days after hospital discharge following severe, moderate, or mild respiratory severity from SARS-CoV-2 infection (severe = intensive care unit hospitalization, moderate = conventional hospitalization, mild = no hospitalization). Deficits were found in all domains of cognition, and the prevalence of psychiatric symptoms was relatively high in the three groups. The severe infection group performed more poorly on long-term episodic memory tests and exhibited greater anosognosia than did the other two groups. Those with moderate infection had poorer emotion recognition, which was positively correlated with persistent olfactory dysfunction. Individuals with mild infection were more stressed, anxious, and depressed. The data support the hypothesis that the virus targets the central nervous system (notably the limbic system) and the notion that there are different neuropsychological phenotypes.

OUP accepted manuscript

Lack of awareness of cognitive impairment (i.e. anosognosia) could be a key factor for distinguishing between neuropsychological post-COVID-19 condition phenotypes. In this context, the 2-fold aim of the present study was to (i) establish the prevalence of anosognosia for memory impairment, according to the severity of the infection in the acute phase and (ii) determine whether anosognosic patients with post-COVID syndrome have a different cognitive and psychiatric profile from nosognosic patients, with associated differences in brain functional connectivity. A battery of neuropsychological, psychiatric, olfactory, dyspnoea, fatigue and quality-of-life tests was administered 227.07 ± 42.69 days post-SARS-CoV-2 infection to 102 patients (mean age: 56.35 years, 65 men, no history of neurological, psychiatric, neuro-oncological or neurodevelopmental disorder prior to infection) who had experienced either a mild (not hospitalized; n = 45), moderate (conventional hospitalization; n = 34) or severe (hospitalization with intensive care unit stay and mechanical ventilation; n = 23) presentation in the acute phase. Patients were first divided into two groups according to the presence or absence of anosognosia for memory deficits (26 anosognosic patients and 76 nosognosic patients). Of these, 49 patients underwent an MRI. Structural images were visually analysed, and statistical intergroup analyses were then performed on behavioural and functional connectivity measures. Only 15.6% of patients who presented mild disease displayed anosognosia for memory dysfunction, compared with 32.4% of patients with moderate presentation and 34.8% of patients with severe disease. Compared with nosognosic patients, those with anosognosia for memory dysfunction performed significantly more poorly on objective cognitive and olfactory measures. By contrast, they gave significantly more positive subjective assessments of their quality of life, psychiatric status and fatigue. Interestingly, the proportion of patients exhibiting a lack of consciousness of olfactory deficits was significantly higher in the anosognosic group. Functional connectivity analyses revealed a significant decrease in connectivity, in the anosognosic group as compared with the nosognosic group, within and between the following networks: the left default mode, the bilateral somatosensory motor, the right executive control, the right salient ventral attention and the bilateral dorsal attention networks, as well as the right Lobules IV and V of the cerebellum. Lack of awareness of cognitive disorders and, to a broader extent, impairment of the self-monitoring brain system, may be a key factor for distinguishing between the clinical phenotypes of post-COVID syndrome with neuropsychological deficits.