Psychometric Validation of an Instrument for Measuring Patient Experiences with Outpatient Healthcare

Evaluating person-centered care in neurological outpatient care: a mixed-methods content validity study

BACKGROUND

Person-centered care (PCC) is gaining increased attention. PCC concerns the whole person behind the disease and can improve care for people with long-term conditions such as multiple sclerosis (MS) and Parkinson's disease (PD). However, there is a lack of tools to assess PCC from the patients' perspective, particularly in outpatient care. The Person-Centered Care instrument for outpatient care (PCCoc) is an instrument under development with the intention to fill this gap. The aim of this study was to test the user-friendliness and content validity of the PCCoc as experienced by persons with MS and PD in neurological outpatient care.

METHODS

Twenty persons with MS or PD completed the 35-item PCCoc followed by an interview regarding the instrument's intelligibility and ease of use to assess its user-friendliness. Participants then rated the relevance of each item. These ratings were used to calculate the content validity index (CVI) for individual items (I-CVI) and for the overall scale (S-CVI).

RESULTS

It took a median of 5 min for participants to complete the PCCoc. Instrument instructions were found clear, items easy to understand, and response categories distinct. No important missing areas were reported. I-CVI values ranged between 0.75 and 1, and S-CVI was 0.96.

CONCLUSIONS

We found support for the user-friendliness and content validity of the PCCoc among persons with MS and PD, suggesting that the PCCoc can be useful for evaluating and developing PCC in neurological outpatient care. Further testing in broader contexts, including psychometric testing, is warranted to establish its usefulness.

Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire

Aim

To develop and content validate a self-assessment questionnaire on motivational interviewing (MI) practice as the first stages in forming the questionnaire to be used in cross-sectional studies involving practitioners conducting the MI-based alcohol screening and brief intervention (ASBI).

Methods

A comprehensive mixed methods approach included a literature review, 3 rounds of expert panel (EP) opinions (n=10), cognitive testing (CT) with 10 MI-based ASBI practitioners, and questionnaire piloting with 31 MI-based ASBI practitioners. Based on the EP opinions in the second round, content validity indices (CVIs) and the modified kappa coefficient (k*) were calculated, focusing on the relevance and understandability of questions and comprehensiveness and meaningfulness of the response options. This analysis was performed in 2020, at the conclusion of the national "Together for a Responsible Attitude Towards Alcohol Consumption" ("Skupaj za odgovoren odnos do pitja alkohola", SOPA) project's pilot implementation.

Results

On a scale level, CVI values based on universal agreement for the entire questionnaire were high for 3/4 categories (S-CVI-UA>0.80), and CVI values based on average agreement were high across all categories (S-CVI-Ave>0.90). At the item level, CVI values (I-CVI) were never <0.50 (automatic item rejection), and the modified kappa value (k*) indicated poor validity for two items in the understandability category (k*=0.33). All problematic parts of the questionnaire were further tested and successfully modified based on the results of CT, and accepted in the third round of testing.

Conclusions

The final version of the questionnaire demonstrated appropriate content validity for use in studies among Slovenian MI-based ASBI practitioners and is now ready for further psychometric testing.