Psychometric testing of the Slovenian Person-centred Climate Questionnaire - staff version

Item distribution, internal consistency and structural validity of the German language person-centred climate questionnaire - staff version (PCQ-G-S): a cross-sectional study

BACKGROUND

Person-centredness is considered as best practice for people living with dementia. A frequently used instrument to assess person-centredness of a care environment is the Person-centred Climate Questionnaire (PCQ). The questionnaire comprises of 14 items with the three subscales a climate of safety, a climate of everydayness and a climate of community.

AIM

The aim of the study is to describe the translation process of the English language Person-centred Climate Questionnaire (Staff version, Patient version, Family version) into German language (PCQ-G) and to evaluate the first psychometric properties of the German language Person-centred Climate Questionnaire- Staff version (PCQ-G-S).

METHODS

We conducted a cross-sectional study. The three versions of the 14-item English PCQ were translated into German language (PCQ-G) based on the recommendations for cross-cultural adaption of measures. Item distribution, internal consistency and structural validity of the questionnaire were assessed among nursing home staff (PCQ-G-S). Item distribution was calculated using descriptive statistics. Structural validity was tested using principal component analysis (PCA), and internal consistency was assessed for the resulting subscales using Cronbach's alpha. Data collection took place from May to September 2021.

RESULTS

A total sample of 120 nurses was included in the data analysis. Nine out of 14 items of the PCQ-G-S demonstrated acceptable item difficulty, while five times showed a ceiling effect. The PCA analysis demonstrated a strong structural validity for a three-factor solution explaining 68.6% of the total variance. The three subscales demonstrated a good internal consistency with Cronbach's alpha scores of 0.8 for each of the subscales.

CONCLUSION

The analysis of the 14-item German version (PCQ-G-S) showed first evidence for a strong internal consistency and structural validity for evaluating staff perceptions of the person-centredness in German nursing homes. Based on this, further investigations for scale validity of the PCQ-G versions should be carried out.

A Rasch analysis of the Person-Centred Climate Questionnaire - staff version

Background

Person-centred care is the bedrock of modern dementia services, yet the evidence-base to support its implementation is not firmly established. Research is hindered by a need for more robust measurement instruments. The 14-item Person-Centred Climate Questionnaire - Staff version (PCQ-S) is one of the most established scales and has promising measurement properties. However, its construction under classical test theory methods leaves question marks over its rigour and the need for evaluation under more modern testing procedures.

Methods

The PCQ-S was self-completed by nurses and other care staff working across nursing homes in 35 Swedish municipalities in 2013/14. A Rasch analysis was undertaken in RUMM2030 using a partial credit model suited to the Likert-type items. Three subscales of the PCQ-S were evaluated against common thresholds for overall fit to the Rasch model; ordering of category thresholds; unidimensionality; local dependency; targeting; and Differential Item Functioning. Three subscales were evaluated separately as unidimensional models and then combined as subtests into a single measure. Due to large number of respondents (n = 4381), two random sub-samples were drawn, with a satisfactory model established in the first (‘evaluation’) and confirmed in the second (‘validation’). Final item locations and a table converting raw scores to Rasch-transformed values were created using the full sample.

Results

All three subscales had disordered thresholds for some items, which were resolved by collapsing categories. The three subscales fit the assumptions of the Rasch model after the removal of two items, except for subscale 3, where there was evidence of local dependence between two items. By forming subtests, the 3 subscales were combined into a single Rasch model which had satisfactory fit statistics. The Rasch form of the instrument (PCQ-S-R) had an adequate but modest Person Separation Index (< 0.80) and some evidence of mistargeting due to a low number of ‘difficult-to-endorse’ items.

Conclusions

The PCQ-S-R has 12 items and can be used as a unidimensional scale with interval level properties, using the nomogram presented within this paper. The scale is reliable but has some inefficiencies due to too few high-end thresholds inhibiting discrimination amongst populations who already perceive that person-centred care is very good in their environment.

Psychometric evaluation of the Chinese version of the Person-centred Climate Questionnaire - Staff version (PCQ-S)

OBJECTIVES

The aim of the study was to evaluate the psychometric properties of a Chinese translation of the English version of the Person-centred Climate Questionnaire - Staff version (PCQ-S) for Chinese palliative care staff in a hospital context.

DESIGN

This was a cross-sectional design. The 14-item English PCQ-S was translated and backtranslated using established procedures. Construct validity and reliability including internal consistency and test-retest reliability were assessed among hospital staff. Construct validity was tested using principal component analysis (PCA), internal consistency was assessed using Cronbach's alpha, and test-retest reliability was evaluated with the weighted kappa (Kp), Pearson correlation coefficient (r) and intra-class correlation coefficient (ICC).

SETTING

This study was conducted in three hospitals in Kunming, the capital of Yunnan province in south-west China.

PARTICIPANTS

A sample of hospital staff (n=163) on duty in the palliative care departments of three hospitals in Kunming consented to participate in the study.

RESULTS

The 14-item Chinese PCQ-S consists of the three subscales also present in other language versions. It showed strong internal consistency, with a Cronbach's alpha of 0.94 for the total scale, 0.87 for the safety subscale, 0.90 for the everydayness subscale and 0.88 for the community subscale. The Chinese PCQ-S had high test-retest reliability as evidenced by a high Kp coefficient and a high correlation coefficient for all scales between test and retest scores, on 'a climate of safety' (Kp=0.77, r=0.88, p<0.01), 'a climate of everydayness' (Kp=0.82, r=0.91, p<0.01), 'a climate of community' (Kp=0.75, r=0.79, p<0.01), and on overall scale scores (Kp=0.85, r=0.93, p<0.01). The ICC to evaluate the test-retest reliability was 0.97 (95% CI 0.95 to 0.98).

CONCLUSIONS

The Chinese version of the PCQ-S showed satisfactory reliability and validity for assessing staff perceptions of person-centred care in Chinese hospital environments.