Measuring symptoms of depression: comparing the Cornell Scale for Depression in Dementia and the Patient Health Questionnaire-9-Observation Version

Care home residents’ quality of life and its association with CQC ratings and workforce issues: the MiCareHQ mixed-methods study

Background

Care home staff have a critical bearing on quality. The staff employed, the training they receive and how well they identify and manage residents’ needs are likely to influence outcomes. The Care Act 2014 (Great Britain. The Care Act 2014. London: The Stationery Office; 2014) requires services to improve ‘well-being’, but many residents cannot self-report and are at risk of exclusion from giving their views. The Adult Social Care Outcomes Toolkit enables social care-related quality of life to be measured using a mixed-methods approach. There is currently no equivalent way of measuring aspects of residents’ health-related quality of life. We developed new tools for measuring pain, anxiety and depression using a mixed-methods approach. We also explored the relationship between care home quality, residents’ outcomes, and the skill mix and employment conditions of the workforce who support them.

Objectives

The objectives were to develop and test measures of pain, anxiety and depression for residents unable to self-report; to assess the extent to which regulator quality ratings reflect residents’ care-related quality of life; and to assess the relationship between aspects of the staffing of care homes and the quality of care homes.

Design

This was a mixed-methods study.

Setting

The setting was care homes for older adults in England.

Participants

Care home residents participated.

Results

Three measures of pain, anxiety and low mood were developed and tested, using a mixed-methods approach, with 182 care home residents in 20 care homes (nursing and residential). Psychometric testing found that the measures had good construct validity. The mixed-methods approach was both feasible and necessary with this population, as the majority of residents could not self-report. Using a combined data set (n = 475 residents in 54 homes) from this study and the Measuring Outcomes in Care Homes study (Towers AM, Palmer S, Smith N, Collins G, Allan S. A cross-sectional study exploring the relationship between regulator quality ratings and care home residents’ quality of life in England. Health Qual Life Outcomes 2019;17:22) we found a significant positive association between residents’ social care-related quality of life and regulator (i.e. Care Quality Commission) quality ratings. Multivariate regression revealed that homes rated ‘good/outstanding’ are associated with a 12% improvement in mean current social care-related quality of life among residents who have higher levels of dependency. Secondary data analysis of a large, national sample of care homes over time assessed the impact of staffing and employment conditions on Care Quality Commission quality ratings. Higher wages and a higher prevalence of training in both dementia and dignity-/person-centred care were positively associated with care quality, whereas high staff turnover and job vacancy rates had a significant negative association. A 10% increase in the average care worker wage increased the likelihood of a ‘good/outstanding’ rating by 7%.

Limitations

No care homes rated as inadequate were recruited to the study.

Conclusions

The most dependent residents gain the most from homes rated ‘good/outstanding’. However, measuring the needs and outcomes of these residents is challenging, as many cannot self-report. A mixed-methods approach can reduce methodological exclusion and an over-reliance on proxies. Improving working conditions and reducing staff turnover may be associated with better outcomes for residents.

Future work

Further work is required to explore the relationship between pain, anxiety and low mood and other indicators of care homes quality and to examine the relationship between wages, training and social care outcomes.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 19. See the NIHR Journals Library website for further project information.

Measurement validity of the Patient-Health Questionnaire-9 in US nursing home residents

OBJECTIVES

The objective of this study was to assess the measurement properties of the self-reported Patient Health Questionnaire-9 (PHQ-9) and its 10-item observer version (PHQ-10OV) among nursing home residents.

METHODS

We conducted a retrospective study of Minimum Data Set 3.0 assessments for national cohorts of Medicare Fee-for-Service beneficiaries who were newly admitted or incident long-stay residents in 2014-2015 at US nursing homes (NHs) certified by the Center for Medicare and Medicaid Services. Statistical analyses included examining internal reliability with McDonald's omega, structural validity with confirmatory factor analysis, and hypothesis testing for expected gender differences and criterion validity with descriptive statistics. The Chronic Condition Warehouse depression diagnoses were used as an administrative reference standard.

RESULTS

Both the PHQ-9 and PHQ-10OV had good internal reliability with omega values above 0.85. The self-reported scale yielded good model fit for a one-factor solution, while the PHQ-10OV had slightly poorer fit and a lower standardized factor loading on the additional irritability item. Both scales appear sufficiently one-dimensional given that somatic items had higher factor loading on a general depression factor than on a somatic subfactor. We were unable to obtain expected gender differences on the PHQ-10OV scale. The PHQ-9 and PHQ-10OV were both highly specific but had poor sensitivity compared with an administrative reference standard.

CONCLUSIONS

The PHQ-9 appears to be a valid and promising measurement instrument for research about depression among NH residents, while the validity of the PHQ-10OV should be examined further with a structured psychiatric interview as a stronger criterion standard.

The Brief Cognitive Impairment Scale (BCIS): preliminary investigation of a severe-stage dementia test emphasizing cognitive processing and interpersonal tolerance

We describe the development and validation of The Brief Cognitive Impairment Scale (BCIS), a cognitive screening instrument designed for persons with severe-stage dementia. Psychometric analyses were performed on neuropsychological data from long-term care residents (N = 247) who completed a brief battery of tests, including the BCIS. A principle component analysis yielded three factors that provide insight into how persons with severe dementia cognitively process information and may tolerate specific aspects of social stimulation, such as during personal care. A BCIS cut score can be used to identify severe dementia with a sensitivity of .82, a specificity of .84, and an area under the curve of .89. It may be used by clinicians or caregivers when advanced dementia is suspected, as an alternative to measures with suspected floor effects, when residents cannot tolerate more demanding assessment tools, and as part of non-pharmacologic treatment plans for behavior disturbances associated with dementia.

Differentiating levels of cognitive functioning: a comparison of the Brief Interview for Mental Status (BIMS) and the Brief Cognitive Assessment Tool (BCAT) in a nursing home sample

OBJECTIVES

In US nursing homes, cognitive assessment has been an essential component of the federally mandated Minimum Data Set assessment system, inclusive of the Brief Interview for Mental Status (BIMS) for identifying possible cognitive impairment. We compare it with the Brief Cognitive Assessment Tool (BCAT) to determine which instrument is more sensitive in differentiating degrees of cognitive functioning in nursing home residents. We attempt to cross-validate the psychometric properties of both measures.

METHOD

Two hundred twenty-nine individuals residing in a Maryland skilled nursing facility were referred for neurocognitive evaluation over a 10-month period. One hundred eighty-nine of these residents met inclusion criteria by completing the BCAT and BIMS, and were aged 60 or older.

RESULTS

The BIMS and the BCAT were confirmed to have strong internal consistency reliability and construct validity. Both cognitive tools were found to predict cognitive diagnoses generally, but only the BCAT was able to identify residents at all specific cognitive levels. The BIMS did not differentiate between residents with normal cognition and those with mild cognitive impairment, or between mild and moderate dementia. Both measures demonstrated high specificity and positive predictive values for identifying severe cognitive impairment or probable dementia. The BIMS had lower sensitivity and negative predictive values for identifying dementia compared to the BCAT. The BCAT accounted for an additional 47% of the variance in dementia diagnoses over and above BIMS scores.

CONCLUSION

Based on these findings, the BCAT appears to be more sensitive than the BIMS in predicting cognitive level for nursing home residents.