How to identify the most suitable questionnaires and rating scales for your clinical practice or research?

Moral distress measurement in animal care workers: a systematic review

OBJECTIVES

The mental health of veterinary and other animal health professionals is significantly impacted by the psychological stressors they encounter, such as euthanasia, witnessing animal suffering and moral distress. Moral distress, initially identified in nursing, arises when individuals are aware of the right action but are hindered by institutional constraints. We aimed to review existing research on moral distress scales among animal care workers by focusing on the identification and psychometric validity of its measurement.

DESIGN

Two-step systematic review. First, we identified all moral distress scales used in animal care research in the eligible original studies. Second, we evaluated their psychometric validity, emphasising content validity, which is a critical aspect of patient-reported outcome measures (PROMs). This evaluation adhered to the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The results were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses.

DATA SOURCES

PubMed, EMBASE and PsycINFO to search for eligible studies published between January 1984 and April 2023.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

We included original (primary) studies that (1) were conducted in animal care workers; (2) describing either the development of a moral distress scale, or validation of a moral distress scale in its original or modified version, to assess at least one of the psychometric properties mentioned in COSMIN guidelines.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers used standardised methods to search, screen and code included studies. We considered the following information relevant for extraction: study reference, name and reference of the moral distress scale used, psychometric properties assessed and methods and results of their assessments. The collected information was then summarised in a narrative synthesis.

RESULTS

The review identified only one PROM specifically adapted for veterinary contexts: the Measure of Moral Distress for Animal Professionals (MMD-AP), derived from the Measure of Moral Distress for Healthcare Professionals (MMD-HP). Both MMD-HP and MMD-AP were evaluated for the quality of development and content validity. The development quality of both measures was deemed doubtful. According to COSMIN, MMD-HP's content validity was rated as sufficient, whereas MMD-AP's was inconsistent. However, the evidence quality for both PROMs was rated low.

CONCLUSION

This is the first systematic review focused on moral distress measurement in animal care workers. It shows that moral distress is rarely measured using standardised and evidence-based methods and that such methods should be developed and validated in the context of animal care.

PROSPERO REGISTRATION NUMBER

CRD42023422259.

Psychometric validity of the Shirom-Melamed Burnout Measure and the Burnout Assessment Tool: a systematic review

In the absence of internationally recognised standardised criteria, several patient-reported outcome measures (PROMs) have been developed to measure occupational burnout. The aim of this study was to extend our 2021 review of the psychometric validity of five PROMs to the Shirom-Melamed Burnout Measure (SMBM) and the Burnout Assessment Tool (BAT). To do that we ran a systematic literature search in the MEDLINE, PsycINFO, and Embase databases following our previous methodological framework and the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN). We assessed the level of evidence using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) guideline. We identified 694 publications on SMBM and 421 on BAT, but the final review includes eight papers on SMBM and three on BAT. Of the seven psychometric properties assessed for SMBM, content, structural, and criterion validity were rated as insufficient, whereas the quality of evidence for construct and internal consistency was high and moderate, respectively. Of the nine psychometric properties assessed for BAT, content, structural, criterion, and construct validity was moderate and internal consistency was high. One limitation of this study is that we did not assess cross-cultural validity, because the number of studies reviewed is too small and content validity can only be assessed based on the original PROM version rather than translation. To conclude, BAT is superior to SMBM in terms of psychometric validity, but the quality of evidence for some properties is low or very low, suggesting a need for additional validation studies.

Prioritizing Outcome Measures for Value-Based Healthcare: Physicians' Perspectives in Saudi Arabia

OBJECTIVES

To inform the stepwise transformation to value-based healthcare in Saudi Arabia, we assess physicians' priorities for measuring general patient outcomes. This is done as an initial step toward the implementation of disease-specific outcome sets.

METHODS

A cross-sectional, electronic self-administered questionnaire-based study among physicians in 6 hospitals in Saudi Arabia was conducted between March 2022 and May 2022. Purposive sampling was used to select hospitals and physicians. The questionnaire included 30 health outcomes taken from about 60 disease-specific outcome sets. These were classified into 6 domains per the Outcome Measures Hierarchy Framework of Michael Porter. The physicians were asked to prioritize outcomes in each domain by their order of importance. The Relative Importance Index (RII) and multivariate binary logistic regression were used to analyze the priorities and to relate them to physicians' characteristics.

RESULTS

A total of 204 physicians completed the questionnaire accounting for 40% response rate. The top priority outcomes per domain were overall survival (RII 89.4%); quality of life (RII 92.4%); time to treatment (RII 90.8%); incidence of adverse effects (RII 72.9%); need for retreatment (RII 80.5%); and incidence of hospital-acquired infections (RII 89.3%). Regression analysis revealed that physician seniority is a characteristic associated with physicians' perceptions of the importance of measuring health outcomes (highest odds ratio 2.693; 95% CI 1.501-4.833; P = .001).

CONCLUSION

Establishing a general set of the most important outcomes that applies to all patients, including survival and mortality, quality of life, adverse events, and complications, need to be considered in the early stages of hospitals' transformation to value-based healthcare.

Determinants of Burnout among Teachers: A Systematic Review of Longitudinal Studies

We aimed to review the determinants of burnout onset in teachers. The study was conducted according to the PROSPERO protocol CRD42018105901, with a focus on teachers. We performed a literature search from 1990 to 2021 in three databases: MEDLINE, PsycINFO, and Embase. We included longitudinal studies assessing burnout as a dependent variable, with a sample of at least 50 teachers. We summarized studies by the types of determinant and used the MEVORECH tool for a risk of bias assessment (RBA). The quantitative synthesis focused on emotional exhaustion. We standardized the reported regression coefficients and their standard errors and plotted them using R software to distinguish between detrimental and protective determinants. A qualitative analysis of the included studies (n = 33) identified 61 burnout determinants. The RBA showed that most studies had external and internal validity issues. Most studies implemented two waves (W) of data collection with 6–12 months between W1 and W2. Four types of determinants were summarized quantitatively, namely support, conflict, organizational context, and individual characteristics, based on six studies. This systematic review identified detrimental determinants of teacher exhaustion, including job satisfaction, work climate or pressure, teacher self-efficacy, neuroticism, perceived collective exhaustion, and classroom disruption. We recommend that authors consider using harmonized methods and protocols such as those developed in OMEGA-NET and other research consortia.