Item Response Theory Analysis of the Texas Functional Living Scale

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Evaluating functional abilities within the context of memory assessment: A practice survey of neuropsychologists

Objective: Functioning in daily life is an important consideration when differentiating between individuals with normal cognition, mild neurocognitive disorder, and major neurocognitive disorder. Despite this, there is no gold standard measurement approach for assessing functional abilities and few guidelines on how to do so. The objective of this study was to examine neuropsychologists' practices regarding the assessment of functional abilities across the spectrum of memory ability. Method: A total of 278 psychologists who routinely conduct neuropsychological assessments completed an online survey (estimated 15% response rate) querying their practices and perspectives with respect to the assessment of functional abilities. Results: Respondents identified that changes to several components of daily functioning, including activities of daily living, were important when evaluating functional abilities. Respondents reported utilizing a variety of instruments to assess functioning, with an overwhelming majority indicating the use of semi-structured interviews. Although most respondents are satisfied with existing tools, a quarter of respondents felt strongly that there was a need for more instruments of everyday functioning. Respondents further indicated that their recommendations to patients, particularly regarding compensatory strategies and follow-up with other professionals, were informed by results of their functional assessment. Conclusions: Overall, our survey results indicate that neuropsychologists perceive multiple factors of daily life to be important considerations when evaluating functioning, use a variety of techniques to assess functioning, and perceive a need for more measures of functional abilities.

Development and validation of the patient-reported outcome scale for chronic kidney disease

PURPOSE

The patient-reported outcomes (PROs) measuring patient's experience and perception of disease are important components of approach to care. However, no tools are available to assess the PROs of chronic kidney disease (CKD). This study aims to develop and verify a PROs scale to evaluate clinical outcomes in CKD patients.

METHODS

The theoretical structure model and original item pool were formed through a literature review, patient interviews and references to relevant scales. The Delphi method, classical test theory methods and item response theory method were used to select items and adjust dimensions to form the final scale. Altogether 360 CKD patients were recruited through convenience sampling. CKD-PROs could be evaluated from four aspects, namely reliability, content validity, construct validity, responsibility, and feasibility.

RESULTS

The CKD-PROs scale covers 4 domains, including the physiological, psychological, social, and therapeutic domain, and 12 dimensions, 54 items. The Cronbach's α is 0.939, the split reliability coefficient is 0.945, and the correlation of the scores each item and domain's coefficients range from 0.413 to 0.669. The results of structure validity, content validity and reactivity showed that the multidimensional measurement of the scale met professional expectations. The recovery rate and effective rate of the scale were over 99%.

CONCLUSION

The CKD-PROs scale has great reliability, validity, reactivity, acceptability and is capable of being used as one of the evaluation tools for the clinical outcomes of CKD patients.

Conventional clock drawing tests have low to moderate reliability and validity for detecting subtle cognitive impairments in community-dwelling older adults

Background

Early identification of subtle cognitive decline in community-dwelling older adults is critical, as mild cognitive impairment contributes to disability and can be a precursor to dementia. The clock drawing test (CDT) is a widely adopted cognitive screening measure for dementia, however, the reliability and validity of paper-and-pencil CDT scoring scales for mild cognitive impairment in community samples of older adults is less well established. We examined the reliability, sensitivity and specificity, and construct validity of two free-drawn clock drawing test scales-the Rouleau System and the Clock Drawing Interpretation Scale (CDIS)-for subtle cognitive decline in community-dwelling older adults.

Methods

We analyzed Rouleau and CDIS scores of 310 community-dwelling older adults who had MoCA scores of 20 or above. For each scale we computed Cronbach's alpha, receiver operating characteristic curves (ROC) for sensitivity and specificity using the MoCA as the index measure, and item response theory models for difficulty level.

Results

Our sample was 75% female and 85% Caucasian with a mean education of 16 years. The Rouleau scale had excellent interrater reliability (94%), poor internal consistency [0.37 (0.48)], low sensitivity (0.59) and moderate specificity (0.71) at a score of 9. The CDIS scale had good interrater reliability (88%), moderate internal consistency [0.66 (0.09)], moderate sensitivity (0.78) and low specificity (0.45) at a score of 19. In the item response models, both scales' total scores gave the most information at lower cognitive levels.

Conclusion

In our community-dwelling sample, the CDIS's psychometric properties were better in most respects than the Rouleau for use as a screening instrument. Both scales provide valuable information to clinicians screening older adults for cognitive change, but should be interpreted in the setting of a global cognitive battery and not as stand-alone instruments.

Validity and reliability of the Chinese version of the Patient-Reported Outcomes Measurement Information System adult profile-57 (PROMIS-57)

Background

The PROMIS-57 is a commonly used self-reported instrument to solve the lack of generalizable and universal measures required to evaluate common symptoms and functions from patients’ perspectives. This study aimed to translate the PROMIS-57 into Chinese and psychometrically test the translated instrument on patients with breast cancer.

Methods

Translation, cross‑cultural adaptation, and psychometric evaluation of the instrument were performed from June 2020 to June 2021. Eligible patients were recruited and completed the PROMIS-57, Functional Assessment of Cancer Therapy-Breast (FACT-B), and a sociodemographic questionnaire.

Results

Data from 602 patients with a mean age of 48.83 years were analyzed. Most domains in the PROMIS-57 showed an absence of floor and ceiling effects. Multi-trait scaling analysis demonstrated acceptable convergent and discriminant validity. The correlations between the PROMIS-57 scores and the selected FACT-B scores supported the criterion validity via the Pearson correlation test. Measurement invariance was supported by the absence of differential item functioning for most items. Cronbach’s α of the domains ranged from 0.85–0.95. The unidimensional factor structure of all domains was supported using confirmatory factor analyses. Additionally, most items showed acceptable item information curves and item characteristics curve matrices.

Conclusion

The Chinese version of the PROMIS-57 was found to be a reliable and valid tool for assessing common symptoms and functions among patients with breast cancer.