WAIS-R test-retest reliability in a normal elderly sample

Validation of a Mobile, Sensor-based Neurobehavioral Assessment With Digital Signal Processing and Machine-learning Analytics

BACKGROUND

The Miro Health Mobile Assessment Platform consists of self-administered neurobehavioral and cognitive assessments that measure behaviors typically measured by specialized clinicians.

OBJECTIVE

To evaluate the Miro Health Mobile Assessment Platform's concurrent validity, test-retest reliability, and mild cognitive impairment (MCI) classification performance.

METHOD

Sixty study participants were evaluated with Miro Health version V.2. Healthy controls (HC), amnestic MCI (aMCI), and nonamnestic MCI (naMCI) ages 64-85 were evaluated with version V.3. Additional participants were recruited at Johns Hopkins Hospital to represent clinic patients, with wider ranges of age and diagnosis. In all, 90 HC, 21 aMCI, 17 naMCI, and 15 other cases were evaluated with V.3. Concurrent validity of the Miro Health variables and legacy neuropsychological test scores was assessed with Spearman correlations. Reliability was quantified with the scores' intraclass correlations. A machine-learning algorithm combined Miro Health variable scores into a Risk score to differentiate HC from MCI or MCI subtypes.

RESULTS

In HC, correlations of Miro Health variables with legacy test scores ranged 0.27-0.68. Test-retest reliabilities ranged 0.25-0.79, with minimal learning effects. The Risk score differentiated individuals with aMCI from HC with an area under the receiver operator curve (AUROC) of 0.97; naMCI from HC with an AUROC of 0.80; combined MCI from HC with an AUROC of 0.89; and aMCI from naMCI with an AUROC of 0.83.

CONCLUSION

The Miro Health Mobile Assessment Platform provides valid and reliable assessment of neurobehavioral and cognitive status, effectively distinguishes between HC and MCI, and differentiates aMCI from naMCI.

An expanding manifold in transmodal regions characterizes adolescent reconfiguration of structural connectome organization

Adolescence is a critical time for the continued maturation of brain networks. Here, we assessed structural connectome development in a large longitudinal sample ranging from childhood to young adulthood. By projecting high-dimensional connectomes into compact manifold spaces, we identified a marked expansion of structural connectomes, with strongest effects in transmodal regions during adolescence. Findings reflected increased within-module connectivity together with increased segregation, indicating increasing differentiation of higher-order association networks from the rest of the brain. Projection of subcortico-cortical connectivity patterns into these manifolds showed parallel alterations in pathways centered on the caudate and thalamus. Connectome findings were contextualized via spatial transcriptome association analysis, highlighting genes enriched in cortex, thalamus, and striatum. Statistical learning of cortical and subcortical manifold features at baseline and their maturational change predicted measures of intelligence at follow-up. Our findings demonstrate that connectome manifold learning can bridge the conceptual and empirical gaps between macroscale network reconfigurations, microscale processes, and cognitive outcomes in adolescent development.

Cognitive performance along the migraine cycle: A negative exploratory study

Migraine patients frequently report cognitive difficulties in the proximity and during migraine attacks. We performed an exploratory comparison of executive functioning across the four stages of the migraine cycle. Consecutive patients with episodic migraine undertook cognitive tests for attention, processing speed, set-shifting, and inhibitory control. Performance was compared between patients in different migraine stages, controlling for attack frequency and prophylactic medication. One hundred forty-three patients (142 women, average age 36.2 ± 9.9 years) were included, 28 preictal (≤48 h before the attack), 21 ictal (during the attack), 18 postictal (≤24 h after attack), and 76 interictal. Test performance (age and literacy adjusted z-scores) was not significantly different across migraine phases, despite a tendency for a decline before the attack. This negative study shows that cognitive performance fluctuates as patients approach the attack. To control for individual variability, this comparison needs to be better characterized longitudinally with a within-patient design.

One Year of Continuous Positive Airway Pressure Adherence Improves Cognition in Older Adults With Mild Apnea and Mild Cognitive Impairment

BACKGROUND

Mild cognitive impairment frequently represents a predementia stage of Alzheimer's disease. Although obstructive sleep apnea is increasingly recognized as a common comorbidity of mild cognitive impairment, most apnea research has focused on middle-aged adults with moderate-to-severe obstructive sleep apnea. Mild obstructive sleep apnea, defined as 5-14 apneas or hypopneas per hour slept, is common in older adults. Little is known about the effect on cognition of adherence to continuous positive airway pressure (CPAP) treatment of obstructive sleep apnea in older adults with mild obstructive sleep apnea and mild cognitive impairment.

OBJECTIVE

The objective of this study was to explore the effect of CPAP adherence on cognition in older adults with mild obstructive sleep apnea and mild cognitive impairment.

METHODS

We conducted a secondary analysis of data from Memories 1, a 1-year quasiexperimental clinical trial on the effect of CPAP adherence in older adults with mild cognitive impairment and obstructive sleep apnea. Those with mild obstructive sleep apnea were divided into two groups based on their CPAP adherence over 1 year: (a) CPAP adherent group (mild cognitive impairment + CPAP) with an average CPAP use of ≥4 hours per night and (b) CPAP nonadherent group (mild cognitive impairment - CPAP) with an average CPAP use of <4 hours per night. Individuals currently using CPAP were not eligible. A CPAP adherence intervention was provided for all participants, and an attention control intervention was provided for participants who chose to discontinue CPAP use during the 1-year follow-up. Descriptive baseline analyses, paired t tests for within-group changes, and general linear and logistic regression models for between-group changes were conducted.

RESULTS

Those in the mild cognitive impairment + CPAP group compared to the mild cognitive impairment - CPAP group demonstrated a significant improvement in psychomotor/cognitive processing speed, measured by the Digit Symbol Coding Test. Eight participants improved on the Clinical Dementia Rating Scale, whereas six worsened or were unchanged. Twelve participants rated themselves as improved on the Alzheimer's Disease Cooperative Study-Clinical Global Impression of Change Scale, whereas three reported their status as worsened or unchanged. The mild cognitive impairment + CPAP group had greater than an eightfold increased odds of improving on the Clinical Dementia Rating and greater than a ninefold increased odds of improving on the Alzheimer's Disease Cooperative Study-Clinical Global Impression of Change Scale, compared to the mild cognitive impairment - CPAP group.

DISCUSSION

CPAP adherence may be a promising intervention for slowing cognitive decline in older adults with mild obstructive sleep apnea and mild cognitive impairment. A larger, adequately powered study is needed.

Visual Object Discrimination Impairment as an Early Predictor of Mild Cognitive Impairment and Alzheimer's Disease

OBJECTIVE

Detection of cognitive impairment suggestive of risk for Alzheimer's disease (AD) progression is crucial to the prevention of incipient dementia. This study was performed to determine if performance on a novel object discrimination task improved identification of earlier deficits in older adults at risk for AD.

METHOD

In total, 135 participants from the 1Florida Alzheimer's Disease Research Center [cognitively normal (CN), Pre-mild cognitive impairment (PreMCI), amnestic mild cognitive impairment (aMCI), and dementia] completed a test of object discrimination and traditional memory measures in the context of a larger neuropsychological and clinical evaluation.

RESULTS

The Object Recognition and Discrimination Task (ORDT) revealed significant differences between the PreMCI, aMCI, and dementia groups versus CN individuals. Moreover, relative risk of being classified as PreMCI rather than CN increased as an inverse function of ORDT score.

DISCUSSION

Overall, the obtained results suggest that a novel object discrimination task improves the detection of very early AD-related cognitive impairment, increasing the window for therapeutic intervention. (JINS, 2019, 25, 688-698).

The Cattell–Horn–Carroll Model of Cognition for Clinical Assessment

The Cattell–Horn–Carroll (CHC) model is a comprehensive model of the major dimensions of individual differences that underlie performance on cognitive tests. Studies evaluating the generality of the CHC model across test batteries, age, gender, and culture were reviewed and found to be overwhelmingly supportive. However, less research is available to evaluate the CHC model for clinical assessment. The CHC model was shown to provide good to excellent fit in nine high-quality data sets involving popular neuropsychological tests, across a range of clinically relevant populations. Executive function tests were found to be well represented by the CHC constructs, and a discrete executive function factor was found not to be necessary. The CHC model could not be simplified without significant loss of fit. The CHC model was supported as a paradigm for cognitive assessment, across both healthy and clinical populations and across both nonclinical and neuropsychological tests. The results have important implications for theoretical modeling of cognitive abilities, providing further evidence for the value of the CHC model as a basis for a common taxonomy across test batteries and across areas of assessment.

A possible correlation between performance IQ, visuomotor adaptation ability and mu suppression

BACKGROUND

Psychometric, anatomical and functional brain studies suggest that individuals differ in the way that they perceive and analyze information and strategically control and execute movements. Inter-individual differences are also observed in neural correlates of specific and general cognitive ability. As a result, some individuals perceive and adapt to environmental conditions and perform motor activities better than others. The aim of this study was to identify a common factor that predicts adaptation of a reaching movement to a visual perturbation and suppression of movement-related brain activity (mu rhythms).

RESULTS

Twenty-eight participants participated in two different experiments designed to evaluate visuomotor adaptation and mu suppression ability. Performance intelligence quotient (IQ) was assessed using the revised Wechsler Adult Intelligence Scale. Performance IQ predicted adaptation index of visuomotor performance (r=0.43, p=0.02) and suppression of mu rhythms (r=-0.59; p<0.001). Participants with high performance IQ were faster at adapting to a visuomotor perturbation and better at suppressing mu activity than participants with low performance IQ.

CONCLUSIONS

We found a possible link between performance IQ and mu suppression, and performance IQ and the initial rate of adaptation. Individuals with high performance IQ were better in suppressing mu rhythms and were quicker at associating motor command and required movement than individuals with low performance IQ.

The Experience of Cognitive Impairment in People with Psychosis

Cognitive impairment has been widely studied in people with psychosis. However, research is lacking into the subjective experience of cognitive impairment, its impact and ways in which individuals cope. This study aimed to provide an account of the experience of cognitive impairment in people with a diagnosis of schizophrenia, including what difficulties people experience, how these difficulties are understood, how people respond to these difficulties and how they perceive others' views of these difficulties. A semi-structured interview was carried out with eight participants with a diagnosis of schizophrenia focusing on participants' experiences of difficulties with cognitive functioning. Interpretative phenomenological analysis was used to analyse interview transcripts. Experience of cognitive impairment was understood in terms of six master themes: impaired controlled thinking, physical sensations and impaired movement, explanations for the impairment and comparisons to the past, managing the impairment, how others see the impairment and anticipating the future. This study is the first rigorous qualitative study of the subjective experience of cognitive impairment in people with psychosis, and it provides greater context for empirical findings. The results have significant implications for clinical psychology, including education about cognitive difficulties and the importance of cognitive functioning to formulation. New areas for research include coping strategies in relation to functioning and future perspectives, ascertaining staff understanding of cognitive impairment, and reflective conversation style as an intervention for metacognitive difficulties. Key Practitioner Message Difficulties with cognitive functioning should be considered in clinical practitioners' formulations of clients' difficulties in the context of psychosis. Services should consider providing service user and carer education about cognitive impairment in psychosis. Staff may need further training in order to support people with psychosis who have difficulties with cognitive functioning.

The robust reliability of neuropsychological measures: meta-analyses of test-retest correlations

Test-retest reliability is an important psychometric property relevant to assessment instruments typically used in neuropsychological assessment. This review presents a quantitative summary of test-retest reliability coefficients for a variety of widely used neuropsychological measures. In general, the meta-analytic test-retest reliabilities of the test scores ranged from adequate to high (i.e., r=.7 and higher). Furthermore, the reliability values were largely robust across factors such as age, clinical diagnosis, and the use of alternate forms. The values for some of the memory and executive functioning scores were lower (i.e., less than r=.7). Some of the possible reasons for these lower values include ceiling effects, practice effects, and across time variability in cognitive abilities measured by those tests. In general, neuropsychologists who use these measures in their assessments can be encouraged by the magnitude of the majority of the meta-analytic test-retest correlations obtained.

Executive functioning in children with intractable frontal lobe or temporal lobe epilepsy

The aim of the present study was to shed light on the executive functioning deficits that might differentiate children with frontal lobe epilepsy (FLE) from children with temporal lobe epilepsy (TLE). Participants included 19 youth with intractable FLE and 47 youth with intractable TLE. Participants completed the Wisconsin Card Sorting Test (WCST), verbal fluency, Trail Making Test (Trails A and B), Digit Span Forward (DSF), and Digit Span Backward (DSB). When compared to the normative sample, the FLE group performed significantly worse on DSF, DSB, Trails B, and the WCST. Similarly, the TLE group performed significantly worse on DSF and DSB compared to the normative sample. Youth with FLE had significantly greater difficulty on the WCST compared to the TLE group. Overall, the results indicated that youth with FLE had significantly greater difficulty with concept formation compared to children with TLE. No differences between groups emerged on tasks assessing attention, working memory, mental flexibility, or rapid word retrieval. Both groups performed significantly below the normative sample levels on attention and working memory tasks. As a whole, it appears that some, although not all, executive dysfunction is specific to FLE.

Entorhinal cortex volume measured with 3T MRI is positively correlated with the Wechsler Memory Scale-Revised logical/verbal memory score for healthy subjects

INTRODUCTION

Previous studies revealed a correlation between local brain volume and cognitive function. The aim of the present study was to investigate the correlation between local gray matter volume and the Wechsler Memory Scale-Revised (WMS-R) logical/verbal memory (WMS-R-verbal) score in healthy adults using a 3 Tesla magnetic resonance scanner and voxel-based morphometry (VBM).

METHODS

T1-weighted magnetic resonance images were obtained in 1,169 healthy adults. The T1-weighted images in native space were bias-corrected, spatially normalized, and segmented into gray matter, white matter, and cerebrospinal fluid images with Statistical Parametric Mapping 5. To investigate regionally the specific effects of the WMS-R-verbal score on the gray matter images, simple regression analysis was performed by VBM treating age, total intracranial volume, and gender as confounding covariates. A P value of less than 0.05 corrected with false discovery rate in voxel difference was considered to be statistically significant.

RESULTS

Our study showed a significant positive correlation between the WMS-R-verbal score and the bilateral entorhinal cortex volume. In the right entorhinal, T value is 4.75, and the size of the clusters is 155 voxels. In the left entorhinal, T value is 4.08, and the size of the clusters is 23 voxels. A significant negative correlation was not found.

CONCLUSION

To our knowledge, this is the first VBM study showing that entorhinal cortex volume is positively correlated with the WMS-R-verbal score for healthy subjects. Therefore, in our structural neuroimaging study, we add evidence to the hypothesis that the entorhinal cortex is involved in verbal memory processing.

Estimating retest effects in longitudinal assessments of cognitive functioning in adults between 18 and 60 years of age

Several analyses were conducted on data from samples of adults between 18 and 58 years of age who completed the same cognitive tests after an interval ranging from less than 1 week to 35 years. Because the retest interval varied across individuals, it was possible to determine the length of time needed before the gains associated with a retest decreased to 0 and to obtain simultaneous estimates of the magnitude of effects associated with increased age and a prior assessment. The results indicated that for adults within this age range, 7 or more years were needed before positive retest effects were no longer detectable. Age effects in longitudinal comparisons could be interpreted in terms of large positive effects associated with a prior assessment and negative effects associated with age that were comparable in magnitude to those observed in cross-sectional comparisons.

Attention and the Stages of Pain Processing

OBJECTIVE

Explore the relationships between the four stages of pain processing and attention in chronic pain sufferers.

DESIGN

A cross-sectional, retrospective study of 736 subjects participating in an outpatient university-based tertiary care pain treatment program.

METHODS

Self-report measures of pain, pain-related unpleasantness, and suffering (Pain Experience Visual Analog Scales) in conjunction with a structured interview assessing illness behavior (adaptation of the Psychosocial Pain Inventory) and attention (Digit Span subtest of the Wechsler Adult Intelligence Scale-Revised) were employed.

OUTCOME MEASURES

Separate step-wise multiple regression analyses were conducted using variables that measure each of the four stages of pain processing as predictors, with Digit Span being the criterion variable.

RESULTS

Multiple regression analyses showed that, of the four pain stages, only suffering and pain behavior were related to attentional performance. Specifically, an individual's perception of lifestyle interference due to pain, level of depression, and the degree of solicitous responses from others each uniquely contributed to Digit Span performance.

CONCLUSIONS

Treatment interventions specifically targeting suffering and pain behavior may prove efficacious in addressing the attentional problems in chronic pain.

Changes in directed attention and short-term memory in depression

This study examined changes in directed attention and short-term memory in depression using a newly constructed battery of computerized measures. A repeated measures design was used with two sample groups; 25 individuals meeting DSM-IV criteria for Major Depression and a group-matched comparison sample of 27. Both groups were tested at three points in time over a 10-week period. Test-retest reliability of the measures was examined. Profile analysis demonstrated that there were differences between the depressed and comparison groups in both directed attention and short-term memory. Recommendations for specific improvements in the testing battery are discussed. The ability to detect changes in directed attention and short-term memory may have clinical utility in early detection of impending onset of depression or subtle residual symptoms of an acute episode that may impair functioning or signal a relapse.

Postdicting verbal IQ of elderly individuals

We undertook a longitudinal crossvalidation of the Ryan and Paolo (1992) equation's ability to postdict Wechsler Adult Intelligence Scale-Revised (WAIS-R) Verbal IQ (VIQ) from National Adult Reading Test (NART) performance measured 5 years after VIQ scores were obtained, for a sample of 49 elderly normal individuals (mean age 71 years). Five-year interval postdiction accuracy agreed very well with the results of the original, concurrent study. Clinical utility is still limited, however, as VIQ must decline by 16.3 points for 95%-detection sensitivity. A new regression equation that utilizes a combination of NART errors and WAIS-R Vocabulary age-scaled scores (measured 3 years earlier) provided slightly better expected clinical sensitivity and accounted for 49% of the variance in VIQ scores.

Effects of major depression on estimates of intelligence

This study examined whether patients with major depressive disorder manifest deficits in intelligence during affective episodes and following clinical improvement. WAIS-R scores were contrasted in 100 patients in an episode of major depression with 50 normal controls, matched to the patient sample in terms of demographic variables and estimates of premorbid IQ. The groups were equivalent in verbal IQ, but, in line with previous studies, the depressed patients had a pronounced deficit in performance IQ. A patient subsample was administered the WAIS-R under unlimited time conditions to determine whether the time constraints of performance IQ subtests contributed to the magnitude of the verbal-performance IQ discrepancy. This discrepancy was only slightly reduced with untimed scoring. Subgroups of depressed patients were retested with the WAIS-R within one week (n = 26) or two months (n = 33) following treatment with electroconvulsive therapy. In both subsamples, IQ scores were improved at posttreatment testing relative to pretreatment, but with little change in the verbal-performance IQ discrepancy. These and related findings suggested that a performance IQ deficit is characteristic of depressed patients regardless of affective state.

Effect of repeated administration of a neuropsychological battery in the elderly

Our study explored the magnitude of practice effect in repeated administration of NP measures that tap different cognitive domains in normal elderly subjects (N = 122) between ages 57 and 85, who were evaluated over three annual testing probes. Results revealed that WAIS-R PIQ, serial recall of words, WMS visual memory, and memory for logical passages (immediate and delayed) are likely to improve on the retest due to practice effect in individuals below age 75, whereas test-retest changes in older people show a different pattern. Implications of age-specific changes on retest for differential diagnosis of dementia in clinical practice were considered.