Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures

Evaluation of the psychometric performance of the Spanish and Catalan versions of the patient reported experiences and Outcomes of Safety in Primary Care (PREOS-PC)-Compact questionnaire

BACKGROUND

Patients provide a unique, irreplaceable, and essential perspective in evaluating patient safety. The suite of Patient Reported Experiences and Outcomes of Safety in Primary Care (PREOS-PC) tools are a notable exception to the scarcity of patient-reported patient safety measures. Full evaluation of their performance has only been attempted for the English version, thereby limiting its international applicability.

OBJECTIVES

To assess the psychometric performance of the Spanish and Catalan versions of the PREOS-PC-Compact.

METHODS

Cross-sectional validation study. We used Classical Test Theory methods to examine scale score distribution, internal consistency, and construct validity; and Item Response Theory (IRT) methods to further explore construct validity.

RESULTS

3287 patients completed the Spanish version, and 1007 the Catalan version. Similar results were obtained for both versions. Confirmatory Factor Analysis supported a single construct for each scale. The correlations between PREOS-PC-Compact scales and known group analysis suggested adequate construct validity (inconclusive for known groups at the provider level). All four multi-item scales demonstrated adequate internal consistency reliability (α > 0.7), which was only confirmed for test-retest reliability for 'Practice activation.' A sample between 60-90 patients per practice was estimated sufficient to produce scores with reliability > 0.7 for all scales except for harm scales. IRT models showed disordered thresholds for 'Practice activation' and 'Harm burden' but showed excellent fit after reducing the response categories.

CONCLUSION

The Spanish and Catalan versions of the PREOS-PC-Compact are broadly valid and reliable tools to measure patient safety in Spanish primary care centres; confirmation of lower-than-expected test-rest reliability merits further examination .

Patient-reported assessment of compassion in Spanish: a systematic review

Aims and objectives

This systematic review aims to: (1) explore which tools have been used in Spanish to measure compassion; (2) know which of these tools could be used to assess compassion in healthcare settings from the perspective of patients; (3) evaluate the quality of these patient-reported measures in Spanish contexts; and (4) determine which of these instruments would be best suited to be used in healthcare settings.

Background

Compassion has been recognized as a fundamental dimension of quality healthcare.

Methods

Several scientific databases were consulted for relevant records published up to December 16th, 2021. In accordance with PRISMA guidelines, 64 studies were included.

Results and conclusions

while existing instruments, validated in Spanish, allow for the measurement of self-compassion or compassion to others, there are no valid and reliable measures currently available in Spanish to measure patient-reported compassion.

Relevance to clinical practice

In order to ensure and promote compassion in the health care context, it is essential to have a valid and reliable tool to measure this construct in a patient-informed way, and this is currently not possible in the Spanish-speaking context because of the lack of such an instrument in Spanish.

Adaptation and validation of a patient-reported compassion measure in the Spanish population: The Spanish version of the Sinclair Compassion Questionnaire (SCQesp)

International practice guidelines and policies recognize compassion as a fundamental dimension of quality care. A key element in enhancing compassion in healthcare settings is having reliable patient-reported experience measures. In the Spanish context, there is a need for a valid Spanish patient-reported compassion measure for use in both research and clinical practice. The Sinclair Compassion Questionnaire (SCQ) represents the gold standard for patient-reported compassion measures in English-speaking settings. The primary aim of this study is to culturally adapt and validate the SCQ in a Spanish population. A Spanish version of the SCQ (SCQesp) was used to collect data from 303 Spanish patients (in two contexts: hospitalized and medical visit). Confirmatory factor analysis confirmed a one-factor solution in the 15-item (SCQesp) and five-item (SCQesp-SF) short form version. The SCQesp showed excellent values of reliability: Cronbach's α = 0.98; composite variance = 0.98 (0.905-0.854); and stratified variance = 0.78. The SCQesp-SF showed similar values of reliability. The SCQesp has excellent psychometric properties, making it a valid and reliable measure for assessing compassion in healthcare research and clinical care. This scientifically rigorous and psychometrically robust compassion measure in Spanish could allow healthcare providers, researchers, and leaders to routinely assess compassion.

Evaluating conceptual model measurement and psychometric properties of Oral health-related quality of life instruments available for older adults: a systematic review

BACKGROUND

Older adults present a variety of oral diseases and conditions, in addition to co-morbidities and limited access to dental care, which significantly impact their oral health-related quality of life (OHRQoL). There are many instruments published to measure OHRQoL. However, it is challenging for clinicians and researchers to choose the best instrument for a given purpose.

PURPOSE

To identify OHRQoL instruments available for older adults and summarize the evidence on the conceptual and measurement model, psychometric properties, interpretability, and administration issues of OHRQoL instruments available for older adults through a systematic review.

METHODS

A systematic search was conducted in MEDLINE, EMBASE, LILACS, and CENTRAL up to February 2023. Articles reporting information on the concept model measurement, psychometric properties, and administration issues of an instrument measuring OHRQoL in older adults were included. Two researchers independently evaluated each instrument using the Evaluating Measures of Patient-Reported Outcomes (EMPRO) tool. The overall score and seven attribute-specific scores were calculated (range 0-100): Conceptual and measurement model, Reliability, Validity, Responsiveness, Interpretability, Burden, and Alternative forms.

RESULTS

We identified 14 instruments evaluated in 97 articles. The overall score varied between 73.7 and 8.9, with only six questionnaires over the threshold score 50.0. EORTC QLQ OH-15 (cancer-specific questionnaire) achieved the highest score (73.7), followed by OHIP (generic OHRQoL questionnaire) (66.9), GOHAI (generic OHRQoL questionnaire) (65.5), and OHIDL (generic OHRQoL questionnaire) (65.2). Overall, the Conceptual and measurement model and Validity showed the best performance, while Responsiveness and Interpretability showed the worst. Insufficient information was presented for an overall evaluation of DSQ and OHAI.

CONCLUSION

The evidence supports using EORTC QLQ-OH15 as a specific instrument to assess OHRQoL in cancer patients and the OHIP-49, GOHAI, or OHIDL as generic instruments to assess OHRQoL either for cross-sectional or longitudinal studies in older adults.

Environmental health knowledge of healthcare professionals: Instrument development and validation using the Rasch model

INTRODUCTION

environmental risk factors constitute a major public health issue, calling for preventive actions and interventions at multiple levels. An important step in this direction is increasing the environmental health (EH) knowledge of the healthcare professionals. In this context, tools designed to measure such knowledge are of imperative importance. The aim of the present study was to develop an EH knowledge tool for healthcare professionals.

METHODS

a group of experts defined the knowledge areas of the EH tool and their corresponding items. An online pilot and a validation study were performed. Internal consistency reliability was measured with the Kuder-Richardson 20 (KR-20) estimate, the construct validity and uni-dimensionality of the tool were assessed with the Rasch model. Known-groups validity was analysed with the two-sample t-test.

RESULTS

a total of n = 151 and n = 444 healthcare professionals and end-year medical and nursing students, participated in the pilot and the validation study, respectively. The resulting 33-item EH knowledge questionnaire for healthcare professionals (EHKQ-HP) obtained a KR-20 = 0.82. The scale is uni-dimensional. Its construct validity was verified, and its items cover a wide range of difficulties. Separation statistics were adequate and known-groups behaved as hypothesized.

CONCLUSIONS

the EHKQ-HP is a valuable resource for measuring the EH knowledge of the healthcare professionals. As such it will be useful in detecting EH knowledge gaps, and helping public health agents in making informed decisions when developing interventions for increasing this very knowledge. This would consequently help in improving the health of the general population.

[Properties of the CP-QOL-PCQ to measure health-related quality of life in children and adolescents with cerebral palsy in Argentina]

Introduction

The impact of cerebral palsy (CP) on quality of life requires the incorporation of subjective assessments of health, functional status, and well-being. A specific health-related quality of life (HRQoL) measure for CP is the Australian CP-QOL questionnaire, whose version for caregivers (PCQ) was adapted in Argentina. This study aimed to achieve the final structure and evaluate the reliability and validity of the CP-QOL-PCQ for the Argentine child and adolescent population.

Methods

100 caregivers of people from 3 to 24 years old with a diagnosis of CP from Argentina participated. In addition to the CP-QOL-PCQ, the KIDSCREEN-27 questionnaire was applied. Analysis of response distributions of all items, inter-item correlations, and internal consistency of the scales were performed using Cronbach's alpha. The convergent validity of the instrument was tested through the correlation with scales of similar content from the KIDSCREEN and through a priori hypotheses in groups of different ages and functional impairment.

Results

A final structure of the CP-QOL-PCQ was achieved with 8 multidimensional scales, with satisfactory inter-item correlations (>0.30) and internal consistency (>0.70). Moderate and high correlations (r>0.30) were obtained between similar dimensions of the CP-QOL-PCQ and the KIDSCREEN with similar concepts. Higher HRQoL scores were confirmed at a younger age and at a lower level of functional impairment (Cohen's d >0.20).

Conclusion

This provides evidence of reliability and validity to be expected for a HRQoL measurement instrument that can be implemented in the Argentine child and adolescent population with CP.

Placing patient-reported outcomes at the centre of cardiovascular clinical practice: implications for quality of care and management

Patient-reported outcomes (PROs) provide important insights into patients' own perspectives about their health and medical condition, and there is evidence that their use can lead to improvements in the quality of care and to better-informed clinical decisions. Their application in cardiovascular populations has grown over the past decades. This statement describes what PROs are, and it provides an inventory of disease-specific and domain-specific PROs that have been developed for cardiovascular populations. International standards and quality indices have been published, which can guide the selection of PROs for clinical practice and in clinical trials and research; patients as well as experts in psychometrics should be involved in choosing which are most appropriate. Collaborations are needed to define criteria for using PROs to guide regulatory decisions, and the utility of PROs for comparing and monitoring the quality of care and for allocating resources should be evaluated. New sources for recording PROs include wearable digital health devices, medical registries, and electronic health record. Advice is given for the optimal use of PROs in shared clinical decision-making in cardiovascular medicine, and concerning future directions for their wider application.

Functional social support: A systematic review and standardized comparison of different versions of the DUFSS questionnaire using the EMPRO tool

BACKGROUND

Functional social support is one of the most established predictors of health, and the Duke-UNC Functional Social Support Questionnaire (DUFSS) is one of the most commonly used instruments to measure this parameter. The objective of this study is to systematically review the available evidence on the psychometric and administration characteristics of the different versions of the DUFSS and perform a standardized assessment though to a specifically designed tool.

METHODS

A systematic review was performed in the PubMed/MEDLINE, SCOPUS, WOS and SCIELO databases. All articles that contained information on the development process of the instrument, the psychometric properties and aspects related to its administration were included, without restrictions based on publication date, language, or the version of the questionnaire that was studied. The selection and extraction procedure were carried out by two researchers. The articles finally included were peer-reviewed through a standardised assessment using the Evaluating the Measurement of Patient-Reported Outcomes (EMPRO) tool. PROSPERO registration number: CRD42022342977.

RESULTS

A total of 54 articles were identified. After eliminating duplicates and screening articles based on the selection criteria, 15 studies that examined the DUFSS questionnaire resulting in 4 different versions: 3 articles obtained the 8-item version; 11 the 11-item version; and a single article obtained two versions, the 14-item version and the 5-item version. At least 60% of them did so in a young adult population, predominantly female and with a medium-low socio-economic level or with characteristics of social vulnerability. The EMPRO evaluation showed that the 11-item version (54.01 total score) was the only one that had been studied on all recommended attributes and had higher total scores than the other versions: 8 items (36.31 total score), 14 items (27.48 total score) and 5 items (23.81 total score). This difference appears in all attributes studied, with the highest scores in "reliability (internal consistency)" and "validity".

CONCLUSIONS

Of the 4 versions identified in the DUFSS questionnaire, the 11-item version was found to be optimal based on the EMPRO standardized tool. Although, a priori, we could prioritise its use in epidemiological studies over the other versions, it should be noted that this version should also be used with caution because there are attributes that have not been studied.

Tools for measuring individual self-care capability: a scoping review

BACKGROUND

Our ability to self-care can play a crucial role in the prevention, management and rehabilitation of diverse conditions, including chronic non-communicable diseases. Various tools have been developed to support the measurement of self-care capabilities of healthy individuals, those experiencing everyday self-limiting conditions, or one or more multiple long-term conditions. We sought to characterise the various non-mono-disease specific self-care measurement tools for adults as such a review was lacking.

OBJECTIVE

The aim of the review was to identify and characterise the various non-mono-disease specific self-care measurement tools for adults. Secondary objectives were to characterise these tools in terms of their content, structure and psychometric properties.

DESIGN

Scoping review with content assessment.

METHODS

The search was conducted in Embase, PubMed, PsycINFO and CINAHL databases using a variety of MeSH terms and keywords covering 1 January 1950 to 30 November 2022. Inclusion criteria included tools assessing health literacy, capability and/or performance of general health self-care practices and targeting adults. We excluded tools targeting self-care in the context of disease management only or indicated to a specific medical setting or theme. We used the Seven Pillars of Self-Care framework to inform the qualitative content assessment of each tool.

RESULTS

We screened 26,304 reports to identify 38 relevant tools which were described in 42 primary reference studies. Descriptive analysis highlighted a temporal shift in the overall emphasis from rehabilitation-focused to prevention-focused tools. The intended method of administration also transitioned from observe-and-interview style methods to the utilisation of self-reporting tools. Only five tools incorporated questions relevant to the seven pillars of self-care.

CONCLUSIONS

Various tools exist to measure individual self-care capability, but few consider assessing capability against all seven pillars of self-care. There is a need to develop a comprehensive, validated tool and easily accessible tool to measure individual self-care capability including the assessment of a wide range of self-care practices. Such a tool could be used to inform targeted health and social care interventions.

Considerations for Pain Assessments in Cancer Patients: A Narrative Review of the Latin American Perspective

Cancer incidence in Latin America is lower than in Europe or the United States but morbidity and mortality rates are disproportionately high. A barrier to adequate pain control is inadequate pain assessment, which is a relatively easy and inexpensive metric. The objective of this narrative review is to describe pain assessment for cancer patients in Latin America. Cultural factors may influence pain perception, including contextualizing pain as noble or natural suffering and aspects of what is now called "spiritual pain." Unlike other painful conditions, cancer pain may be strongly associated with existential fear, psychosocial distress, anxiety, and spiritual concerns. Pain assessment allows not just quantification of pain intensity but may elucidate pain mechanisms involved or psychosocial aspects that may color the pain. Many current pain assessment instruments capture only pain intensity, which is but one aspect of the pain experience; some have expanded to include functional assessments, mental health status evaluations, and quality of life metrics. A quality-of-life assessment may be appropriate for cancer patients since chronic pain can severely impact function, which can in turn create a vicious cycle by exacerbating pain. The incidence of cancer in Latin America is expected to increase in the ensuing years. Better pain assessment and clinician education are needed to help manage pain in this large and growing patient population.

A Systematic Review of Parent-Child Communication Measures: Instruments and Their Psychometric Properties

Parent-child communication represents an important variable in clinical child and family psychology due to its association with a variety of psychosocial outcomes. To give an overview of instruments designed to measure the quality of parent-child communication from the child's (8-21 years) perspective and to assess the psychometric quality of these instruments, we performed a systematic literature search in Medline and PsycInfo (last: February 25, 2022). Peer-reviewed journal articles published in English with a child-rated instrument measuring the quality of parent-child communication were included. Initial screening for eligibility and inclusion, subsequent data extraction, and quality assessment were conducted by couples of review team members. Based on the screening of 5115 articles, 106 studies reported in 126 papers were included. We identified 12 parent-child communication instruments across the studies. The Parent-Adolescent Communication Scale (PACS) was used in 75% of the studies. On average, the evidence for psychometric quality of the instruments was low. Few instruments were used in clinical and at-risk samples. Several instruments are available to rate parent-child communication from the child's perspective. However, their psychometric evidence is limited and the theoretical foundation is largely undocumented. This review has limitations with regard to selection criteria and language bias.Registration PROSPERO: CRD42021255264.

Evaluating Self-Concept Measurements in Adolescents: A Systematic Review

(1) Background: To evaluate the self-concept of adolescents, a proper evaluation of several existing self-concept measurements is needed. The objectives of this study are to conduct a systematic review of the available measures used to assess self-concept in adolescents, to evaluate the psychometric properties of each measurement, and to assess the attributes of patient-reported outcome measurements (PROMs) of self-concept in adolescents. (2) Methods: The systematic review was conducted on six databases: EMBASE, MEDLINE, Cochrane, PubMed, CINAHL, and Web of Science, from inception to 2021. A standardized evaluation of psychometric properties was carried out using the Evaluating the Measurement of Patient-Reported Outcomes (EMPRO). The review was conducted independently by two reviewers. Each attribute in EMPRO was assessed and analyzed to obtain an overall score. Only scores that exceeded 50 were considered acceptable. (3) Results: From 22,388 articles, we reviewed 35 articles with five self-concept measurements. Four measurements were obtained that had values above the threshold (SPPC, SPPA, SDQ-II, and SDQII-S). However, there is not enough evidence to support the interpretability attribute in self-concept measurement. (4) Conclusions: There are various measurements of self-concept in adolescents accompanied by their psychometric properties. Each measurement of adolescent self-concept has a characteristic of psychometric properties and measurement attributes.

Chinese cross-culturally adapted patient-reported outcome measures (PROMs) for knee disorders: a systematic review and assessment using the Evaluating the Measurement of Patient-Reported Outcomes (EMPRO) instrument

BACKGROUND

Knee patient-reported outcome measures (PROMs) are widely used in research in China, but there is limited evidence on the quality of cross-culturally adapted and original Chinese PROMs. We investigated Chinese language knee PROMs to provide evidence for clinicians on their quality and to guide PROM choices.

METHOD

A systematic literature search of databases: PUBMED, CINAHL, EMBASE, and CNKI, using adequate search strings and a three-step screen process identified relevant studies. An independent standardized assessment of the selected studies based on the Evaluating the Measurement of Patient-Reported Outcomes (EMPRO) tool was performed. Inter-rater reliability was assessed using intraclass coefficients (ICC).

RESULTS

Thirty-three articles corresponding to 23 knee PROMs were evaluated with EMPRO global scores (100) ranging from 11.11 to 55.42. The attributes 'reliability,' 'validity,' and 'cultural and language adaptation' were significantly better evaluated compared to the attributes 'responsiveness,' 'interpretability,' and 'burden' (for all comparisons p < 0.0001). Moderate-to-excellent inter-rater agreement was observed with ICC values ranging from 0.538 to 0.934.

CONCLUSION

We identified six PROMs with a minimum acceptable threshold (> 50/100). The osteoarthritis of knee and hip quality of life, the lower extremity function scale, and the Western Ontario Meniscal Evaluation tool ranked highest. Nevertheless, no single PROM had evidence encompassing all EMPRO attributes, necessitating further studies, especially on responsiveness, interpretability, and burden. We identified duplication of effort as shown by repeated translations of the same PROM; this inefficiency could be ameliorated by rapid approval of Chinese language PROMs documented on original PROM developers' platforms.

Psychometric Properties of the Patient-Reported Outcome Measures for People With Ulnar Nerve Entrapment at the Elbow: A Systematic Review

OBJECTIVE

The objective of this study was to systematically review, critically appraise, and synthesize evidence on the measurement properties of patient-reported outcome measures (PROMs) for people with ulnar nerve entrapment at the elbow (UNE).

METHODS

CINAHL, MEDLINE, Embase, and Scopus were searched for studies reporting on the psychometric properties of the PROMs used to assess pain, disability, and quality of life of people with UNE. Relevant data were extracted based on the Consensus-Based Standards for the Selection of Health Measurement Instruments 2018 checklist. Two authors independently rated the quality and risk of bias of the studies. A qualitative synthesis was performed according to the Consensus-Based Standards for the Selection of Health Measurement Instruments guidelines. The results were categorized based on the identified PROMs, and all the psychometric properties were summarized and presented.

RESULTS

Eight included studies had a quality score of very good or higher. Among all the included PROMs, the Patient-Rated Ulnar Nerve Evaluation (PRUNE) was comprehensively evaluated in 4 studies and had high reliability, appropriate correlation to the physical component summary score of the 36-Item Short-Form Health Survey (r = -0.68), excellent content (cognitive interviews), structural (factor analysis) and discriminative validities, and high responsiveness. The Disabilities of the Arm, Shoulder and Hand Questionnaire was assessed in 5 studies and had appropriate properties, showing a high correlation with the 8-Item Short-Form Health Survey (r = 0.77) and PRUNE (r = 0.75) and moderate responsiveness.

CONCLUSIONS

The PRUNE was the most specific to UNE, had the most supporting studies and evidence of excellent reliability, validity, and responsiveness and therefore was the preferred PROM. The Disabilities of the Arm, Shoulder and Hand Questionnaire demonstrated more limited validation across 5 studies and had moderate responsiveness. Information on other included PROMs was limited in terms of psychometric properties.

IMPACT

This study provides insight into which PROM is potentially more suitable for measuring outcomes related to UNE.

Assessing the outcomes and experiences of care from the perspective of people living with chronic conditions, to support countries in developing people-centred policies and practices: study protocol of the International Survey of People Living with Chronic Conditions (PaRIS survey)

INTRODUCTION

In view of growing populations with chronic conditions, many countries are redesigning their health systems. However, little information is available about how health systems perform from the perspective of people living with chronic conditions. The Organisation for Economic Co-operation and Development (OECD) Member States therefore mandated the OECD to initiate the International Survey of People Living with Chronic Conditions (PaRIS survey), which aims to provide insight in outcomes and experiences of care as reported by people living with chronic conditions. The PaRIS-SUR consortium has been tasked by the OECD to support the development and implementation of the survey.

METHODS AND ANALYSIS

As primary care services play a pivotal role in the management of chronic conditions, the PaRIS survey will be implemented in the primary care setting. Data will be collected with a survey among users of primary care services aged 45 years or older, of whom many have chronic conditions. An additional survey is conducted among their primary care providers. The nested study design will allow analysis of the patient-reported data in relation to characteristics of and care provided by primary care providers within and across countries. In 2022, the survey will be tested in a Field Trial in participating countries. Data for cross-country comparison will be collected by the Main Survey in 2023.

ETHICS AND DISSEMINATION

Informed consent will be obtained from primary care providers and service users. National Project Managers search ethical approval of the survey in their country, if required. Reporting by the OECD will focus on questions for international comparison. A secured information technology platform will be developed for participants and stakeholders in countries to receive feedback and answer their own questions. Findings will also be disseminated through an international OECD flagship report, conferences, scientific papers and policy briefs, to inform strategies to improve care for people living with chronic conditions throughout the world.

Best-Worst Scaling and the Prioritization of Objects in Health: A Systematic Review

BACKGROUND AND OBJECTIVE

Best-worst scaling is a theory-driven method that can be used to prioritize objects in health. We sought to characterize all studies of best-worst scaling to prioritize objects in health, to assess trends of using best-worst scaling in prioritization over time, and to assess the relationship between a legacy measure of quality (PREFS) and a novel assessment of subjective quality and policy relevance.

METHODS

A systematic review identified studies published through to the end of 2021 that applied best-worst scaling to study priorities in health (PROSPERO CRD42020209745), updating a prior review published in 2016. The PubMed, EBSCOhost, Embase, Scopus, APA PsychInfo, Web of Science, and Google Scholar databases were used and were supplemented by a hand search. Data describing the application, development, design, administration/analysis, quality, and policy relevance were summarized and we tested for trends by comparing articles before and after 1 January, 2017. Multivariate statistics were then used to assess the relationships between PREFS, subjective quality, policy relevance, and other possible indicators.

RESULTS

From a total of 2826 unique papers identified, 165 best-worst scaling studies were included in this review. Applications of best-worst scaling to study priorities in health have continued to grow (p < 0.01) and are now used in all regions of the world, most often to study the priorities of patients/consumers (67%). Several key trends can be observed over time: increased use of pretesting (p < 0.05); increased use of online administration (p < 0.01), and decreased use of paper self-administered surveys (p = 0.02); increased use of heterogeneity analysis (p = 0.02); an increase in having a clearly stated purpose (p < 0.01); and a decrease in comparing respondents to non-respondents (p = 0.01). The average sample size has more than doubled, from 228 to 472 respondents, but formal sample size justifications remain low (5.3%) and unchanged over time (p = 0.68). While the average PREFS score remained unchanged at 3.1/5, both subjective quality and policy relevance trended up, but changes were not statistically significant (p = 0.06 and p = 0.13). Most of the variation in subjective quality was driven by PREFS (R2 = 0.42), but it was also positively assosciated with policy relevance, heterogeneity analysis, and using a balanced incomplete block design, and was negatively associated with not using developmental methods and an increasing sample size.

CONCLUSIONS

Using best-worst scaling to prioritize objects is now commonly used around the world to assess the priorities of patients and other stakeholders in health. Best practices are clearly emerging for best-worst scaling. Although legacy measures (PREFS) to measure study quality are reasonable, there may need to be new tools to assess both study quality and policy relevance.

What is the Most Valid and Reliable Compassion Measure in Healthcare? An Updated Comprehensive and Critical Review

Our previous review of compassion measures in healthcare between 1985 and 2016 concluded that no available measure assessed compassion in healthcare in a comprehensive or methodologically rigorous fashion. The present study provided a comparative review of the design and psychometric properties of recently updated or newly published compassion measures. The search strategy of our previous review was replicated. PubMed, MEDLINE, CINAHL, and PsycINFO databases and grey literature were searched to identify studies that reported information on instruments that measure compassion or compassionate care in clinicians, physicians, nurses, healthcare students, and patients. Textual qualitative descriptions of included studies were prepared. Instruments were evaluated using the Evaluating Measures of Patient-Reported Outcomes (EMPRO) tool. Measures that underwent additional testing since our last review included the Compassion Competence Scale (CCS), the Compassionate Care Assessment Tool (CCAT)^©, and the Schwartz Center Compassionate Care Scale (SCCCS)™. New compassion measures included the Sussex-Oxford Compassion for Others Scale (SOCS-O), a self-report measure of compassion for others; the Bolton Compassion Strengths Indicators (BSCI), a self-report measure of the characteristics (strengths) associated with a compassionate nurse; a five-item Tool to Measure Patient Assessment of Clinician Compassion (TMPACC); and the Sinclair Compassion Questionnaire (SCQ). The SCQ was the only measure that adhered to measure development guidelines, established initial construct validity by first defining the concept of interest, and included the patient perspective across all stages of development. The SCQ had the highest EMPRO overall score at 58.1, almost 9 points higher than any other compassion measure, and achieved perfect EMPRO subscale scores for internal consistency, reliability, validity, and respondent burden, which were up to 43 points higher than any other compassion measure. These findings establish the SCQ as the ‘gold standard’ compassion measure, providing an empirical basis for evaluations of compassion in routine care.

Saving time and effort: Best practice for adapting existing patient-reported outcome measures in hepatology

It is increasingly recognised that collecting patient reported outcome measures (PROMs) data is an important part of healthcare and should be considered alongside traditional clinical assessments. As part of a more holistic view of healthcare provision, there has been an increased drive to implement PROM collection as part of routine clinical care in hepatology. This drive has resulted in an increase in the number of PROMs currently developed to be used in various liver conditions. However, the development and validation of a new PROM is time-consuming and costly. Therefore, before deciding to develop a new PROM, researchers should consider identifying existing PROMs to assess their appropriateness and, if necessary, make adaptations to existing PROMs to ensure their rigour when used with the target population. Little is written in the literature on how to identify and adapt the existing PROMs in hepatology. This article aims to provide a summary of the current literature and guidance regarding identifying and adapting existing PROMs in clinical practice.

A systematic review and recommendations for prom instruments for older people with frailty in emergency care

Introduction

The current service metrics used to evaluate quality in emergency care do not account for specific healthcare outcome goals for older people living with frailty. These have previously been classified under themes of ‘Autonomy’ and ‘Functioning’. There is no person-reported outcome measure (PROM) for older people with frailty and emergency care needs. This study aimed to identify and co-produce recommendations for instruments potentially suitable for use in this population.

Methods

In this systematic review, we searched six databases for PROMs used between 2010 and 2021 by older people living with frailty receiving acute hospital care. Studies were reviewed against predefined eligibility criteria and appraised for quality using the COSMIN Risk of Bias checklist. Data were extracted to map instrument constructs against an existing framework of acute healthcare outcome goals. Instrument face and content validity were assessed by lay collaborators. Recommendations for instruments with potential emergency care suitability were formed through co-production.

Results

Of 9392 unique citations screened, we appraised the full texts of 158 studies. Nine studies were identified, evaluating nine PROMs. Quality of included studies ranged from ‘doubtful’ to ‘very good’. Most instruments had strong evidence for measurement properties. PROMs mainly assessed ‘Functioning’ constructs, with limited coverage of ‘Autonomy’. Five instruments were considered too burdensome for the emergency care setting or too specific for older people living with frailty.

Conclusions

Four PROMs were recommended as potentially suitable for further validation with older people with frailty and emergency care needs: COOP/WONCA charts, EuroQol, McGill Quality of Life (Expanded), and Palliative care Outcome Scale.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-022-00438-x.

Implementation of patient-reported outcome measures into health care for men with localized prostate cancer

Measuring treatment-related quality of life (QOL) has become an increasingly requisite component of delivering high-quality care for patients with prostate cancer. Patient-reported outcome measures (PROMs) have, therefore, become an important tool for understanding the adverse effects of radical prostate cancer treatment and have been widely integrated into clinical practice. By providing real-time symptom monitoring and improved clinical feedback to patients and providers, PRO assessment has led to meaningful gains in prostate cancer care delivery and quality improvement worldwide. By providing an avenue for benchmarking, collaboration and population health monitoring, PROMs have delivered substantial improvements beyond providing individual symptom feedback. However, multilevel barriers exist that need to be addressed before the routine implementation of PROMs is achieved. Improvements in collection, interpretation, standardization and reporting will be crucial for the continued implementation of PROM instruments in prostate cancer pathways.

Cross-cultural adaptation of the Spanish MINICHAL instrument into English for use in the United Kingdom

Background

Hypertension is a highly prevalent condition, with optimal treatment to BP targets conferring significant gains in terms of cardiovascular outcomes. Understanding why some patients do not achieve BP targets would be enhanced through greater understanding of their health-related quality of life (HRQoL). However, the only English language disease-specific instruments for measurement of HRQoL in hypertension have not been validated in accordance with accepted standards. It is proposed that the Spanish MINICHAL instrument for the assessment of HRQoL in hypertension could be translated, adapted and validated for use in the United Kingdom. The aim of the study was therefore to complete this process.

Methods

The MINICHAL authors were contacted and the original instrument obtained. This was then translated into English by two independent English-speakers, with these versions then reconciled, before back-translation and subsequent production of a 2nd reconciled version. Thereafter, a final version was produced after cognitive debriefing, for administration and psychometric analysis in the target population of patients living in the Exeter area (Southwest UK) aged 18–80 years with treatment-naïve grade II-III hypertension, before, during and after 18 weeks’ intensive treatment.

Results

The English-language instrument was administered to 30 individuals (median age: 58.5 years, 53% male). Psychometric analysis demonstrated a floor effect, though no ceiling effect. Internal consistency for both state of mind (StM) and somatic manifestations (SM) dimensions of the instrument were acceptable (Cronbach’s alpha = 0.81 and 0.75), as was test–retest reliability (ICC = 0.717 and 0.961) and construct validity, which was measured through co-administration with the EQ-5D-5L and Bulpitt-Fletcher instruments. No significant associations were found between scores and patient characteristics known to affect HRQoL. The EQ-5D-5L instrument found an improvement in HRQoL following treatment, with the StM and SM dimensions of the English language MINICHAL trending to support this (d = 0.32 and 0.02 respectively).

Conclusions

The present study details the successful English translation and validation of the MINICHAL instrument for use in individuals with hypertension. The data reported also supports an improvement in HRQoL with rapid treatment of grade II-III hypertension, a strategy which has been recommended by contemporaneous European guidelines.

Trial registration ISRCTN registry number: 57475376 (assigned 25/06/2015).

Developing an International Standard Set of Patient-Reported Outcome Measures for Psychotic Disorders

OBJECTIVE

The objective of this project was to develop a set of patient-reported outcome measures for adolescents and adults who meet criteria for a psychotic disorder.

METHODS

A research team and an international consensus working group, including service users, clinicians, and researchers, worked together in an iterative process by using a modified Delphi consensus technique that included videoconferencing calls, online surveys, and focus groups. The research team conducted systematic literature searches to identify outcomes, outcome measures, and risk adjustment factors. After identifying outcomes important to service users, the consensus working group selected outcome measures, risk adjustment factors, and the final set of outcome measures. International stakeholder groups consisting of >100 professionals and service users reviewed and commented on the final set.

RESULTS

The consensus working group identified four outcome domains: symptoms, recovery, functioning, and treatment. The domains encompassed 14 outcomes of importance to service users. The research team identified 131 measures from the literature. The consensus working group selected nine measures in an outcome set that takes approximately 35 minutes to complete.

CONCLUSIONS

A set of patient-reported outcome measures for use in routine clinical practice was identified. The set is free to service users, is available in at least two languages, and reflects outcomes important to users. Clinicians can use the set to improve clinical decision making, and administrators and researchers can use it to learn from comparing program outcomes.

What is the patient experience following revision knee replacement: A systematic review and meta-analysis of the medium term patient reported outcomes

AIMS

Revision knee replacement is an increasingly common procedure, however, information on patient-focused outcomes is limited. This systematic review and meta-analysis aimed to investigate the medium-term patient reported outcomes following a revision knee replacement.

METHODS

We performed a systematic review of MEDLINE and EMBASE (from inception to 1st March 2021) for articles reporting five year or greater patient reported outcome measures (PROMs) following revision knee replacement. A meta-analysis of PROMs data was undertaken using the Standardised Mean Difference (SMD). Quality of methodology was assessed using Wylde's non-summative four-point system. The study was registered with PROPSERO (CRD42021199289).

RESULTS

A total of 23 studies met the inclusion criteria containing 2414 patients at a mean minimum follow-up of 74 months (60-122). The reporting of PROMs were poorly standardised with several PROMs being used. The most commonly reported patient reported outcome was the Knee Society Score reported in 65% of studies (15/23). A meta-analysis of 629 eligible patients undergoing revision knee replacement revealed a significant improvement in pre-operative state with a SMD 2·05 95% CI 0.87, 3.23.

CONCLUSION

This systematic review has found a significant and sustained improvement in patient-reported outcomes following a revision knee arthroplasty beyond five years. We found a variation in the usage and administration of PROMs which hinders a clear synthesis of results. Furthermore, the PROMs have not been robustly tested for validity in the context of a revision knee replacement.

Development of a core outcome set for lateral elbow tendinopathy (COS-LET) using best available evidence and an international consensus process

Objectives

To develop a core outcome set for lateral elbow tendinopathy (COS-LET) and to provide guidance for outcome evaluation in future studies.

Methods

We implemented a multi-stage mixed-methods design combining two systematic reviews, domain mapping of outcome measurement instruments to the core domains of tendinopathy, psychometric analysis of instruments, two patient focus groups and a Delphi study incorporating two surveys and an international consensus meeting. Following the OMERACT guidelines, we used a 70% threshold for consensus.

Results

38 clinicians/researchers and 9 patients participated. 60 instruments were assessed for inclusion. The only instrument that was recommended for the COS-LET was Patient Rated Tennis Elbow Evaluation (PRTEE) for the disability domain. Interim recommendations were made to use: the PRTEE function subscale for the function domain; PRTEE pain subscale items 1, 4 and 5 for the pain over a specified time domain; pain-free grip strength for the physical function capacity domain; a Numerical Rating Scale measuring pain on gripping for the pain on activity/loading domain; and time off work for the participation in life activities domain. No recommendations could be made for the quality-of-life, patient rating of condition and psychological factors domains.

Conclusions

The COS-LET comprises the PRTEE for the disability domain. Interim-use recommendations included PRTEE subscales, time off work, pain-free grip strength and a Numerical Rating Scale measuring pain on gripping. Further work is required to validate these interim measures and develop suitable measures to capture the other domains.

A Standard Set of Value-Based Patient-Centered Outcomes and Measures of Overall Health in Adults

Background

The definition of population-specific outcomes is an essential precondition for the implementation of value-based health care. We developed a minimum standard outcome set for overall adult health (OAH) to facilitate the implementation of value-based health care in tracking, comparing, and improving overall health care outcomes of adults across multiple conditions, which would be of particular relevance for primary care and public health populations.

Methods

The International Consortium for Health Outcomes Measurement (ICHOM) convened an international panel (patients, clinicians, and topic experts). Following the development of a conceptual framework, a modified Delphi method (supported by public consultations) was implemented to identify, in sequence, the relevant domains, the best instruments for measuring them, the timing of measurement, and the relevant adjustment variables.

Findings

Outcomes were identified in relation to overall health status and the domains of physical, mental, and social health. Three instruments covering these domains were identified: PROMIS Scale v1.2—Global Health (10 items), WHO Wellbeing Index (5 items), and the WHO Disability Assessment Schedule 2.0 (12 items). Case-mix variables included a range of sociodemographic and biometric measures. Yearly measurement was proposed for all outcomes and most case-mix variables.

Interpretation

The ICHOM OAH Standard Set has been developed through consensus-based methods based on predefined criteria following high standards for the identification and selection of high-quality measures The involvements of a wide range of stakeholders supports the acceptability of the set, which is readily available for use and feasibility testing in clinical settings.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40271-021-00554-8.

Routine provision of feedback from patient-reported outcome measurements to healthcare providers and patients in clinical practice

BACKGROUND

Patient-reported outcomes measures (PROMs) assess a patient's subjective appraisal of health outcomes from their own perspective. Despite hypothesised benefits that feedback  on PROMs can support decision-making in clinical practice and improve outcomes, there is uncertainty surrounding the effectiveness of PROMs feedback.

OBJECTIVES

To assess the effects of PROMs feedback to patients, or healthcare workers, or both on patient-reported health outcomes and processes of care.

SEARCH METHODS

We searched MEDLINE, Embase, CENTRAL, two other databases and two clinical trial registries on 5 October 2020. We searched grey literature and consulted experts in the field.

SELECTION CRITERIA

Two review authors independently screened and selected studies for inclusion. We included randomised trials directly comparing the effects on outcomes and processes of care of PROMs feedback to healthcare professionals and patients, or both with the impact of not providing such information.

DATA COLLECTION AND ANALYSIS

Two groups of two authors independently extracted data from the included studies and evaluated study quality. We followed standard methodological procedures expected by Cochrane and EPOC. We used the GRADE approach to assess the certainty of the evidence. We conducted meta-analyses of the results where possible.

MAIN RESULTS

We identified 116 randomised trials which assessed the effectiveness of PROMs feedback in improving processes or outcomes of care, or both in a broad range of disciplines including psychiatry, primary care, and oncology. Studies were conducted across diverse ambulatory primary and secondary care settings in North America, Europe and Australasia. A total of 49,785 patients were included across all the studies. The certainty of the evidence varied between very low and moderate. Many of the studies included in the review were at risk of performance and detection bias. The evidence suggests moderate certainty that PROMs feedback probably improves quality of life (standardised mean difference (SMD) 0.15, 95% confidence interval (CI) 0.05 to 0.26; 11 studies; 2687 participants), and leads to an increase in patient-physician communication (SMD 0.36, 95% CI 0.21 to 0.52; 5 studies; 658 participants), diagnosis and notation (risk ratio (RR) 1.73, 95% CI 1.44 to 2.08; 21 studies; 7223 participants), and disease control (RR 1.25, 95% CI 1.10 to 1.41; 14 studies; 2806 participants). The intervention probably makes little or no difference for general health perceptions (SMD 0.04, 95% CI -0.17 to 0.24; 2 studies, 552 participants; low-certainty evidence), social functioning (SMD 0.02, 95% CI -0.06 to 0.09; 15 studies; 2632 participants; moderate-certainty evidence), and pain (SMD 0.00, 95% CI -0.09 to 0.08; 9 studies; 2386 participants; moderate-certainty evidence). We are uncertain about the effect of PROMs feedback on physical functioning (14 studies; 2788 participants) and mental functioning (34 studies; 7782 participants), as well as fatigue (4 studies; 741 participants), as the certainty of the evidence was very low. We did not find studies reporting on adverse effects defined as distress following or related to PROM completion.

AUTHORS' CONCLUSIONS

PROM feedback probably produces moderate improvements in communication between healthcare professionals and patients as well as in diagnosis and notation, and disease control, and small improvements to quality of life. Our confidence in the effects is limited by the risk of bias, heterogeneity and small number of trials conducted to assess outcomes of interest. It is unclear whether   many of these improvements are clinically meaningful or sustainable in the long term. There is a need for more high-quality studies in this area, particularly studies which employ cluster designs and utilise techniques to maintain allocation concealment.

Systematic review and standardised assessment of Chinese cross-cultural adapted hip Patient Reported Outcome Measures (PROMs)

PURPOSE

To perform a systemic literature search to identify Chinese cross culturally adapted and new designed Patient Reported Outcome Measures (PROMs) used for hip assessment, then a standardized evaluation of available instruments in order to provide evidence of high-quality PROMs for clinical use and adoption in future hip registries.

METHODS

A Systematic Review of the following databases: PUBMED, CINAHL, EMBASE, CNKI was performed to identify relevant PROMs. Instruments underwent standardized assessment and scoring using the EMPRO tool by two independent reviewers. Inter-rater reliability was assessed using intra-class correlation coefficients (ICC).

RESULTS

2188 articles were retrieved, with seven articles fitting the inclusion criteria consisting of six hip PROMs. Five PROMs were cross culturally adapted and one was originally designed in Mandarin Chinese. Total scores (/100) after EMPRO evaluation: Osteoarthritis of Knee and Hip Quality of Life (OAKHQOL): 55; Copenhagen Hip and Groin Outcome Score (HAGOS): 52; International Hip Outcome Tool (SC-iHOT-33): 45; Hip Disability and Osteoarthritis Outcome Score (HOOS): 37; Questionnaire on the Perceptions and Functions of Patients about Total Hip Arthroplasty (QPFPTHA): 36; Oxford Hip Score (OHS): 35. ICC values were 0.73 for the SC-iHOT-33 and ranged between 0.83-0.93 for the other PROMs indicating good to excellent inter-rater agreement.

CONCLUSION

Among the commonly used hip-specific PROMs found in arthroplasty registries, none of the Chinese adapted versions evaluated by EMPRO is currently rated acceptable for clinical use. Only OAKHQOL and HAGOS reached acceptability threshold. Further research on the attributes of cross-cultural adaptation, interpretability and burden assessment would be helpful.

The evolution of instrument selection for inclusion in core outcome sets at OMERACT: Filter 2.2

INTRODUCTION

OMERACT uses an evidence-based framework known as the 'OMERACT Filter Instrument Selection Algorithm' (OFISA) to guide decisions in the assessment of outcome measurement instruments for inclusion in a core outcome set for interventional and observational clinical trials.

METHODS

A group of OMERACT imaging and patient-centered outcome methodologists worked with imaging outcome groups to facilitate the selection of imaging outcome measurement instruments using the OFISA approach. The lessons learned from this work influenced the evolution to Filter 2.2 and necessitated changes to OMERACT's documentation and processes.

RESULTS

OMERACT has revised documentation and processes to incorporate the evolution of instrument selection to Filter 2.2. These revisions include creation of a template for detailed definitions of the target domain which is a necessary first step for instrument selection, modifications to the Summary of Measurement Properties (SOMP) table to account for sources of variability, and development of standardized reporting tables for each measurement property.

CONCLUSIONS

OMERACT Filter 2.2 represents additional modifications of the OMERACT guide for working groups in their rigorous assessment of measurement properties of instruments of various types, including imaging outcome measurement instruments. Enhanced reporting aims to increase the transparency of the evidence base leading to judgements for the endorsement of instruments in core outcome sets.

"Is there anything else you would like me to know?": Applying a trauma-informed approach to the administration of the adverse childhood experiences questionnaire

Nearly ubiquitous agreement exists regarding the potentially negative impact of adverse childhood experiences (ACEs) on health and well-being across the lifespan. This has propelled a movement across the nation for consistent screening of ACEs. Despite agreement regarding the consequences of ACEs, little research related specifically to the administration of the ACE questionnaire exists. Using data from a mixed-methods study of first-time mothers as means of illustration, this paper examines shortcomings of the ACE questionnaire. Participant responses revealed ambiguity with item structure, limited breadth of included events, and failure to capture the gravity of the experience. These shortcomings underscore inadequacies of the measure in accurately understanding individuals' lived experiences and call for the application of trauma-informed (TI) values, both in its content and administration. We apply the main tenets of a TI framework to the ACE questionnaire and make recommendations for its administration, translating theoretical underpinnings of a TI approach into action.

SPIRIT-PRO Extension explanation and elaboration: guidelines for inclusion of patient-reported outcomes in protocols of clinical trials

Patient-reported outcomes (PROs) are used in clinical trials to provide valuable evidence on the impact of disease and treatment on patients' symptoms, function and quality of life. High-quality PRO data from trials can inform shared decision-making, regulatory and economic analyses and health policy. Recent evidence suggests the PRO content of past trial protocols was often incomplete or unclear, leading to research waste. To address this issue, international, consensus-based, PRO-specific guidelines were developed: the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)-PRO Extension. The SPIRIT-PRO Extension is a 16-item checklist which aims to improve the content and quality of aspects of clinical trial protocols relating to PRO data collection to minimise research waste, and ultimately better inform patient-centred care. This SPIRIT-PRO explanation and elaboration (E&E) paper provides information to promote understanding and facilitate uptake of the recommended checklist items, including a comprehensive protocol template. For each SPIRIT-PRO item, we provide a detailed description, one or more examples from existing trial protocols and supporting empirical evidence of the item's importance. We recommend this paper and protocol template be used alongside the SPIRIT 2013 and SPIRIT-PRO Extension paper to optimise the transparent development and review of trial protocols with PROs.

Exploring the impact of Patient Reported Outcome Measures (PROMs) among orthopaedic surgeons in mainland China: systematic review and survey-based study on hip and knee instruments

BACKGROUND

Patient Reported Outcome Measures (PROMs) are widely used in Europe and North America in a variety of areas including research, clinical governance, clinical registries and insurance ascertainment. The aim of this study was to assess commonly used knee and hip PROMs among Chinese surgeons and to gain an insight into their impact on evaluation of clinical outcomes.

METHODS

1. A systematic literature search of databases Medline, EMBASE, CINAHL and CNKI was performed from the earliest records to 22/07/2020 for knee instruments and 22/08/2020 for hip instruments, to retrieve Chinese Mandarin cross culturally adapted and validated knee and hip PROMs. 2. An 11-item electronic questionnaire was then designed under four domain categories. The survey was distributed via a ubiquitous online social media platform to orthopaedic surgeons. Responses were collected and analyzed. Output from 1. was used to populate parts of the survey questionnaire.

RESULTS

The systematic online search yielded a total of 41 evaluation instruments, (10 hip and 31 knee); all of which were incorporated as response options. 234 viable questionnaires were retrieved with the largest group representing attending surgeons. 59.0% were familiar with the concept of PROMs among which 78.4% reported to have used PROMs themselves. In order of frequency of use, PROMs were purposed for clinical assessment (55.6%), research (40.7%), health regulation policies (18.6%) and insurance service requirements (10.6%). Implementation was prompted by both departmental (43.4%) and institutional policy (34.5%). 89.4% of PROMs users reported difficulties in the use of PROMs, with major barriers including license fees, limited access, inadequate training and burden of fill-out time (all > 40%).

CONCLUSION

There is evidence of limited familiarity with knee and hip PROMs among orthopaedic surgeons. Barriers to their use are significant. Development of a Chinese language PROMs database would be helpful.

Development and preliminary validation of the competency model for rural general practitioner in China

BACKGROUND

There is a shortage of rural general practitioners (GPs) in China. Training programs have been initiated to meet the needs of GP workforce in the rural areas; however, there is an absence of validated tool to assess their competencies.

OBJECTIVE

This study aimed to develop a competency model for rural general practitioner (CMRGP) after training in China and to examine its validity and reliability.

METHODS

A multistage process was adopted to develop the CMRGP comprised literature review, panel discussion and expert consultation, and the initial version of CMRGP was reduced from 10 domains and 77 items to 7 domains and 54 items. A pilot study was conducted among 202 rural GPs for the psychometric evaluation and application of the initial version of CMRGP, in which a questionnaire on the importance of items and self-evaluation was completed by the GPs.

RESULTS

In the pilot study, 132 completed questionnaires (65.3%) were returned. Acceptability and face validity of the CMRGP were supported by high importance scores of the items, in which 52 out of 54 items achieved score higher than 4.00 (possible score from 0 to 5). Factor analysis supported the construct validity. After the modification, the final version of CMRGP contained 6 domains and 47 items. Good reliability was supported by internal consistency reliability (Cronbach's α was 0.98) and split-half reliability (Spearman-Brown coefficient was 0.99).

CONCLUSIONS

The CMRGP demonstrated good reliability and validity. Pilot study showed its potential for application in the rural general practice and training program.

Development and validation of a patient-reported measure of compassion in healthcare: the Sinclair Compassion Questionnaire (SCQ)

OBJECTIVES

Compassion is a key indicator of quality care that is reportedly eroding from patients' care experience. While the need to assess compassion is recognised, valid and reliable measures are lacking. This study developed and validated a clinically informed, psychometrically rigorous, patient-reported compassion measure.

DESIGN

Data were collected from participants living with life-limiting illnesses over two study phases across four care settings (acute care, hospice, long term care (LTC) and homecare). In phase 1, data were analysed through exploratory factor analysis (EFA), with the final items analysed via confirmatory factor analysis (CFA) in phase 2. The Schwartz Center Compassionate Care Scale (SCCCS), the revised Edmonton Symptom Assessment Scale (ESAS-r) and Picker Patient Experience Questionnaire (PPEQ) were also administered in phase 2 to assess convergent and divergent validity.

SETTING AND PARTICIPANTS

633 participants were recruited over two study phases. In the EFA phase, a 54-item version of the measure was administered to 303 participants, with 330 participants being administered the final 15-item measure in the CFA phase.

RESULTS

Both EFA and CFA confirmed compassion as a single factor construct with factor loadings for the 15-item measure ranging from 0.76 to 0.86, with excellent test-retest reliability (intraclass correlation coefficient range: 0.74-0.89) and excellent internal reliability (Cronbach's alpha of 0.96). The measure was positively correlated with the SCCCS (r=0.75, p<0.001) and PPEQ (r=0.60, p<0.001). Participants reporting higher experiences of compassion had significantly greater well-being and lower depression on the ESAS-r. Patients in acute care and hospice reported significantly greater experiences of compassion than LTC residents.

CONCLUSIONS

There is strong initial psychometric evidence for the Sinclair Compassion Questionnaire (SCQ) as a valid and reliable patient-reported compassion measure. The SCQ provides healthcare providers, settings and administrators the means to routinely measure patients experiences of compassion, while providing researchers a robust measure to conduct high-quality research.

Nursing Home Survey on Patient Safety Culture: Cross-cultural Validation Data From Spanish Nursing Homes

OBJECTIVES

Developing an adequate patient safety culture is a relevant objective for all health care levels. The Nursing Home Survey on Patient Safety Culture (NHSOPS) is a 12-dimension tool assessing safety culture in nursing homes (NH) for elder people. The psychometric properties of its Spanish adaptation are evaluated in this study.

METHODS

Nursing homes with 15 beds or more, located in the Basque Country (North Spain), were invited in the study. All staff types were allowed to participate. Internal consistency was tested with Cronbach's α. Convergent and divergent validity with Spearman's correlations. Two-sample t test was used for known-groups validity. The NHSOPS dimensionality was tested with confirmatory factor analysis (CFA), and its stability in consecutive administrations (test-retest) was explored.

RESULTS

Five hundred fifty-three valid baseline and 83 retest replies were received. The data suggest that the NHSOPS can be represented by a 10-factor model. Two items (A6 and A10) had loadings of less than 0.12. The rest survey items obtained loadings of greater than 0.40. Estimated correlations supported the convergent and divergent validity of the survey. Managers and administrators, as well as staff considering their NH to be a safe place for residents, obtained higher NHSOPS scores, suggesting acceptable known-groups validity. On the other hand, test-retest variation was considerable.

CONCLUSIONS

The current data support a simpler model, similar to that of the Norwegian NHSOPS validation. The stability of the scale should be further assessed in a bigger sample. Test-retest reliability and developing an adequate scoring scheme are issues worth of further study.

Quality of Life Assessed Using Skindex-16 Scores Among Patients With Acne Receiving Isotretinoin Treatment

Importance

Acne is a common dermatologic condition and significantly affects psychosocial health and quality of life. An international task force recommended routine use of quality-of-life measures for clinic visits associated with acne management, but this has yet to translate into clinical practice.

Objective

To assess mean Skindex-16 scores over time among patients with moderate to severe acne receiving isotretinoin treatment.

Design, Setting, and Participants

A longitudinal, retrospective case series study of Skindex-16 data collected at monthly visits from 57 consecutive patients with acne receiving isotretinoin; data were collected and evaluated between November 23, 2016, and January 22, 2019. Continuous variables were compared using quantile regression. Multivariable linear mixed models evaluated mean (95% CI) score trajectory over time.

Main Outcomes and Measure

Skindex-16 scores, including normalized scores for the emotional, symptomatic, and functional aspects of having skin disease as well as an overall score.

Results

Fifty-seven patients (31 [54.4 %] males, with median [interquartile range] age of 17.2 [15.9-18.1] years) in this case series study completed the Skindex-16 at baseline and at least once during follow-up. Baseline Skindex-16 scores were similar by sex but worse with increasing age. Emotional impact was more bothersome to patients with acne requiring isotretinoin treatment than either symptoms or functioning. Improvements of greater than 50% in overall and Emotional domain scores were seen by month 2 of receiving isotretinoin treatment (eg, overall scores decreased from 39.4 to 17.5 by month 2; a decrease of 22.0; P < .001). Qualitatively, Skindex-16 scores reached their nadir between months 3 and 5; at month 4, overall Skindex-16 scores showed a 4.4-fold improvement (from 39.4 at baseline to 8.9; P < .001) and Emotional domain scores showed a 4.8-fold improvement (from 57.7 at baseline to 11.9; P < .001).

Conclusions and Relevance

The findings of this case series suggest that patients receiving isotretinoin treatment achieve greater than a 50% improvement in quality of life by month 2 and can expect approximately 4-fold to 5-fold improvements from baseline with a full course of isotretinoin. This study shows the potential of routine administration of quality of life measures to assess patient care in dermatology.

Protocol for the development of a core outcome set for lateral elbow tendinopathy (COS-LET)

BACKGROUND

Lateral elbow tendinopathy (LET) is a common condition that can cause significant disability and associated socioeconomic cost. Although it has been widely researched, outcome measures are highly variable which restricts evidence synthesis across studies. In 2019, a working group of international experts, health care professionals and patients, in the field of tendinopathy (International Scientific Tendinopathy Symposium Consensus (ICON) Group), published the results of a consensus exercise defining the nine core domains that should be measured in tendinopathy research. The aim of this study is to develop a core outcome set (COS) for LET mapping to these core domains. The primary output will provide a template for future outcome evaluation of LET. In this protocol, we detail the methodological approach to the COS-LET development.

METHODS

This study will employ a three-phase approach. (1) A systematic review of studies investigating LET will produce a comprehensive list of all instruments currently employed to quantify the treatment effect or outcome. (2) Instruments will be matched to the list of nine core tendinopathy outcome domains by a Steering Committee of clinicians and researchers with a specialist interest in LET resulting in a set of candidate instruments. (3) An international three-stage Delphi study will be conducted involving experienced clinicians, researchers and patients. Within this Delphi study, candidate instruments will be selected based upon screening using the Outcome Measures in Rheumatology (OMERACT) truth, feasibility and discrimination filters with a threshold of 70% agreement set for consensus.

CONCLUSIONS

There is currently no COS for the measurement or monitoring of LET in trials or clinical practice. The output from this project will be a minimum COS recommended for use in all future English language studies related to LET. The findings will be published in a high-quality journal and disseminated widely using professional networks, social media and via presentation at international conferences.

TRIAL REGISTRATION

Registered with the Core Outcome Measures in Effectiveness Trials (COMET) database, November 2019. https://www.comet-initiative.org/Studies/Details/1497 .

Psychological Tests in Arabic: A Review of Methodological Practices and Recommendations for Future Use

Mental health research among Arabic speakers is increasing, and with it the need to assess psychopathology of Arabic-speaking populations, including natives, refugees, and immigrants. However, major challenges include the unavailability of appropriate Arabic tools, and the difficulty of judging whether available tools are appropriate. Critical judgment of psychometric tools is important, because they are used for high stake decisions such as clinical outcomes and diagnoses. We identified Arabic-language tests that measure constructs related to mental illness and health, critically analyzed their methodologies, and provided broad recommendations for future research. We conducted a systematic search query using four online databases and followed step-wise exclusions. We identified 115 articles published between January 1998 and August 2019 which produced 138 Arabic tests to screen or diagnose or plan treatment for psychological disorders. More than 80% of tests were translated or adapted from English using methods that are not comparable with the latest standards. Methods of establishing validity, reliability, and equivalence, were also limited, with one quarter not reporting reliability, and the majority using only one source of validity evidence. There is much room for improvement when making decisions about translation or adaptation designs, as well as conducting and reporting psychometric evidence.

Smartphone App for monitoring Asthma in children and adolescents

PURPOSE

The asthma stepwise treatment approach recommended is based on monitoring patients' symptoms. The Asthma Research in Children and Adolescents (ARCA) cohort was created to provide evidence about the evolution of persistent asthma. This manuscript describes the development of an electronic health tool, comprising a mobile health application for patients with asthma and its associated online platform for pediatricians to monitor them.

METHODS

The development process followed 7 phases: the first 5 (Conceptualization, Preparation, Assessment scheduling, Image and user interface, and Technical development) defined and designed the tool, followed by a testing phase (functionality assessment and pilot test with ARCA patients), and a last phase which evaluated usability. Since the target population was aged 6-16 years, three versions were designed within the same smartphone application: parents/proxy, children, and adolescents. The online platform for pediatricians provides real-time information from the application: patients' responses over time with color-coded charts (red/amber/green, as in traffic lights).

RESULTS

The pilot test through semi-structured phone interviews of the first 50 participants included in the ARCA study (n = 53) detected their misunderstandings. Pediatricians were trained to emphasize that the application is free of charge and requires monthly answers. Median of the System Usability Scale scores (n = 85), ranging 0 (negative)-100 (positive), was > 93 in the three age versions of the application.

CONCLUSIONS

Technology has the capability of transforming the use of patient-reported outcomes. Describing all the development phases of a mobile health application for monitoring children and adolescents with asthma may increase the knowledge on how to design applications for young patients.

How to Include Patient-Reported Outcome Measures in Clinical Trials

PURPOSE OF REVIEW

Patient-reported outcome measures are increasingly important measures of patient experience, which can increase research robustness, maximise economic value and improve patient outcomes. This review outlines the benefits, challenges and practicalities of incorporating patient-reported outcome measures in clinical trials.

RECENT FINDINGS

Patient-reported outcome measures are often the best way of measuring patient symptoms and quality of life. Patient-reported outcome measures can help reduce observer bias, engage patients in the research process, and inform health service resource planning. A range of tools exist to help facilitate clinicians and researchers in selecting and utilising patient reported outcome measures. Key issues to consider when selecting an appropriate tool include the development, format and psychometric properties of the patient-reported outcome measures. The use of patient-reported outcome measures allow us to better understand the patient experience and their values. A range of tools exist to help facilitate the use of patient-reported outcome measures. This article outlines how we can incorporate patient-reported outcome measures in clinical trials.

International guidance on the selection of patient-reported outcome measures in clinical trials: a review

PURPOSE

Patient-reported outcomes (PROs) are increasingly used in clinical trials to provide patients' perspectives regarding symptoms, health-related quality of life, and satisfaction with treatments. A range of guidance documents exist for the selection of patient-reported outcome measures (PROMs) in clinical trials, and it is unclear to what extent these documents present consistent recommendations.

METHODS

We conducted a targeted review of publications and regulatory guidance documents that advise on the selection of PROMs for use in clinical trials. A total of seven guidance documents from the US Food and Drug Administration, European Medicines Agency, and scientific consortia from professional societies were included in the final review. Guidance documents were analyzed using a content analysis approach comparing them with minimum standards recommended by the International Society for Quality of Life Research.

RESULTS

Overall there was substantial agreement between guidance regarding the appropriate considerations for PROM selection within a clinical trial. Variations among the guidance primarily related to differences in their format and differences in the perspectives and mandates of their respective organizations. Whereas scientific consortia tended to produce checklist or rating-type guidance, regulatory groups tended to use more narrative-based approaches sometimes supplemented with lists of criteria.

CONCLUSION

The consistency in recommendations suggests an emerging consensus in the field and supports use of any of the major guidance documents available to guide PROM selection for clinical trials without concern of conflicting recommendations. This work represents an important first step in the international PROTEUS Consortium's ongoing efforts to optimize the use of PROs in clinical trials.

Selecting Patient-Reported Outcome Measures to Contribute to Primary Care Performance Measurement: a Mixed Methods Approach

New models of primary care include patient-reported outcome measures (PROMs) to promote patient-centered care. PROMs provide information on patient functional status and well-being, can be used to enhance care quality, and are proposed for use in assessing performance. Our objective was to identify a short list of candidate PROMs for use in primary care practice and to serve as a basis for performance measures (PMs). We used qualitative and quantitative methods to identify relevant patient-reported outcome (PRO) domains for use in performance measurement (PRO-PM) and their associated PROMs. We collected data from key informant groups: patients (n = 13; one-on-one and group interviews; concept saturation analysis), clinical thought leaders (n = 9; group discussions; thematic analysis), primary care practices representatives (n = 37; six focus groups; thematic analysis), and primary care payer representatives (n = 10; 12-question survey; frequencies of responses). We merged the key informant group information with findings from environmental literature scans. We conducted a targeted evidence review of measurement properties for candidate PROMs. We used a scoping review and key informant groups to identify PROM evaluation criteria, which were linked to the National Quality Forum measure evaluation criteria. We developed a de novo schema to score candidate PROMs against our criteria. We identified four PRO domains and 10 candidate PROMs: 3 for depressive symptoms, 2 for physical function, 3 for self-efficacy, 2 for ability to participate. Five PROMs met ≥ 70% of the evidence criteria for three PRO domains: PHQ-9 or PROMIS Depression (depression), PF-10 or PROMIS-PF (physical functioning), and PROMIS Self-Efficacy for Managing Treatments and Medications (self-efficacy). The PROMIS Ability to Participate in Social Roles and Activities met 68% of our criteria and might be considered for inclusion. Existing evidence and key informant data identified 5 candidate PROMs to use in primary care. These instruments can be used to develop PRO-PMs.

Improved measurement of tinnitus severity: Study of the dimensionality and reliability of the Tinnitus Handicap Inventory

OBJECTIVE

The Tinnitus Handicap Inventory (THI) is widely used in clinical practice and research as a three-dimensional measure of tinnitus severity. Despite extensive use, its factor structure remains unclear. Furthermore, THI can be considered a reliable measure only if Cronbach's alpha coefficient and Classical Test Theory is used. The more modern and robust Item Response Theory (IRT) has so far not been used to psychometrically evaluate THI. In theory, IRT allows a more precise evaluation of THI's factor structure, reliability, and the quality of individual items.

METHOD

There were 1115 patients with tinnitus (556 women and 559 men), aged 19-84 years (M = 51.55; SD = 13.28). The dimensionality of THI was evaluated using several models of Confirmatory Factor Analysis and an Item Response Theory approach. Exploratory non-parametric Mokken scaling was applied to determine a unidimensional and robust scale. Several IRT polytomous models were used to assess the overall quality of THI.

RESULTS

The bifactor model had the best fit (RMSEA = 0.055; CFI = 0.976; SRMR = 0.040) and revealed one strong general factor and several weak specific factors. Mokken scaling generated a reliable unidimensional scale (Loevinger's H = 0.463). In order to refine THI we propose that five items be removed. The IRT Generalized Partial Credit Model generated good parameters in terms of item location (difficulty), discrimination, and information content of items.

CONCLUSION

Our findings support the use of THI to evaluate tinnitus severity in terms of it being a reliable unidimensional scale. However, clinicians and researchers should rely only on its overall score, which reflects global tinnitus severity. To improve its psychometric quality, several refinements of THI are proposed.

Tools to assess the measurement properties of quality of life instruments: a meta-review

OBJECTIVE

This meta-review aims to discuss the methodological, research and practical applications of tools that assess the measurement properties of instruments evaluating health-related quality of life (HRQoL) that have been reported in systematic reviews.

DESIGN

Meta-review.

METHODS

Electronic search from January 2008 to May 2020 was carried out on PubMed, CINAHL, PsycINFO, SCOPUS, WoS, Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) database, Google Scholar and ProQuest Dissertations and Theses.

RESULTS

A total of 246 systematic reviews were assessed. Concerning the quality of the review process, some methodological shortcomings were found, such as poor compliance with reporting or methodological guidelines. Regarding the procedures to assess the quality of measurement properties, 164 (66.6%) of reviewers applied one tool at least. Tool format and structure differed across standards or scientific traditions (ie, psychology, medicine and economics), but most assess both measurement properties and the usability of instruments. As far as the results and conclusions of systematic reviews are concerned, only 68 (27.5%) linked the intended use of the instrument to specific measurement properties (eg, evaluative use to responsiveness).

CONCLUSIONS

The reporting and methodological quality of reviews have increased over time, but there is still room for improvement regarding adherence to guidelines. The COSMIN would be the most widespread and comprehensive tool to assess both the risk of bias of primary studies, and the measurement properties of HRQoL instruments for evaluative purposes. Our analysis of other assessment tools and measurement standards can serve as a starting point for future lines of work on the COSMIN tool, such as considering a more comprehensive evaluation of feasibility, including burden and fairness; expanding its scope for measurement instruments with a different use than evaluative; and improving its assessment of the risk of bias of primary studies.

PROSPERO REGISTRATION NUMBER

CRD42017065232.

What Are We Measuring? A Systematic Review of Outcome Measurements Used in Shoulder Surgery

Purpose

The purpose of this study was to identify the most commonly used outcome measurements following shoulder surgery and to investigate demographic variables related to their use.

Methods

PubMed and Embase were searched to identify studies in which at least 1 shoulder-specific outcome measurement was used. Exclusion criteria included duplicate studies, review articles, lack of surgical arm, written in a language other than English, or not adult-specific. Additionally, surgeries were subcategorized based on the type of pathology leading to surgery.

Results

Of the 589 articles identified in the search, 180 met the inclusion criteria. A total of 35 shoulder-specific outcome measurements were reported. The Constant-Murley score (CMS), American Shoulder and Elbow Surgeons Shoulder Score (ASES), Subjective Shoulder Value (SSV), Simple Shoulder Test (SST), and University of California Los Angeles Score (UCLA) were used in more than 10% of the articles. The CMS and SSV were used more commonly together than individually (P = .0074). Additionally, the ASES (P < .00001) and CMS (P = .0109) were associated with the country of origin of the article. The SST was used more frequently in randomized control trials (P = .0287). The ASES and DASH were associated with surgeries categorized under the degenerative indication (P = .001 and P = .0146). Finally, the SSV, ASES and DASH were all found to be significantly paired with surgeries that indicated traumatic pathology (P = .0061, P = .0077 and P = .0069, respectively).

Conclusions

There is great variability among the outcome measurements currently being used for assessing function following orthopaedic shoulder surgery; however, 5 scoring systems are used more frequently than others. There remains a large discrepancy between the ideal reporting, as noted in the recent literature review, and the current state of outcomes reported at this time.

Clinical Relevance

By identifying and evaluating the heterogeneity of the reporting and the usage of the performance indicators, these results can guide the standardization of outcome measurements in shoulder surgery and allow for better comparability when assessing outcomes between patients and studies.

Validation of the Spanish version of the questionnaire on Patient Empowerment in Long-Term Conditions

Background

Patient empowerment is a key factor in improving health outcomes.

Objective

To evaluate the psychometric properties of the Spanish version of the questionnaire on Patient Empowerment in Long-Term Conditions (PELC) that evaluates the degree of empowerment of patients with chronic diseases.

Methods

Three measurements were made (at baseline, 2 weeks and 12 weeks) of quality of life (QoL), self-care, self-efficacy and empowerment. Reliability was evaluated as internal consistency for the entire sample. Test-retest reproducibility was evaluated for patients who were stable from baseline to week 2 (n = 70). Validity was analysed (n = 124) as baseline correlations with QoL, self-care, self-efficacy, clinical data and psychosocial variables. Sensitivity to change was analysed in terms of effect size for patients who had improved between baseline and week 12 (n = 48).

Results

The study was carried out with 124 patients with a diagnosis of heart failure. Cronbach’s alpha was high, at >0.9, and the interclass correlation coefficient was low, at 0.47. PELC questionnaire scores showed differences depending on New York Heart Association functional class (p<0.05) and, as posited in the a priori hypotheses, were moderately correlated with emotional dimensions of QoL (0.53) and self-efficacy (0.43). Effect size for the clinically improved subsample was moderate (0.67).

Conclusions

The results suggest that the Spanish version of the PELC questionnaire has appropriate psychometric properties in terms of internal consistency and validity and is low in terms of reproducibility and sensitivity to change.

Measuring upper limb function in MS: Which existing patient reported outcomes are fit for purpose?

Background

Multiple Sclerosis (MS) clinical trials increasingly focus on progressive and advanced MS, with upper limb function (ULF) as a key outcome. Within clinical trials, Patient Reported Outcomes (PROs) quantify clinical variables and establish meaningfulness of changes. Scientific standards and regulatory criteria (from Food and Drug Administration [FDA]) require PROs be “fit-for-purpose”: well-defined and reliable measures of specific concepts in defined contexts.

Objective

To identify, from literature, existing PROs measuring ULF and determine which satisfy scientific and regulatory clinical trials requirements.

Method

We screened PubMed/Web of Science using multiple relevant terms. Abstracts and full texts were screened using suitability criteria. PRO development papers were evaluated using recently expanded Consensus Standards for Measurement Instruments (COSMIN) criteria for content development.

Results

We identified 3619 articles; 485 used 24 different ULF PROs. No PRO satisfied scientific and regulatory requirements as a well-defined measure of a clearly defined construct in a specific clinical context.

Conclusions

Existing ULF PROs don't meet fit-for-purpose criteria. MS clinical trials require new measures with greater emphasis on patient engagement to derive theoretical frameworks, concepts of interest, and contexts of use followed by systematic literature searches, expert input, and qualitative research to support item generation. Until then, trials will miss aspects of meaningful within-patient change and thereby misrepresent (likely underestimating) treatment effects.

•

With MS clinical trials increasingly focusing on progressive and advanced MS, we searched for and assessed existing Upper Limb Function (ULF) Patient Reported Outcome (PRO) for MS clinical trials

•

We established that existing PROs for ULF in MS do not meet regulatory and scientific criteria for content validity.

•

In fact, we established that the content development of existing PROs is worrisome – often falling short of guidelines around conceptual development, qualitative involvement of patients, use of representative samples and well-documented literature searches.

•

These results reiterate the work of other authors, where poor historical PRO content development has been established in various clinical contexts.

•

New measures are required.

A Practical Guide for Item Generation in Measure Development: Insights From the Development of a Patient-Reported Experience Measure of Compassion

BACKGROUND AND PURPOSE

Although various measure development guidelines exist, practical guidance on how to systematically generate items is nascent. This article provides practical guidance on item generation in measure development and the use of a Table of Specifications (TOS) in this process.

METHODS

In addition to a review of the literature, the item generation process within an ongoing study to develop a valid and reliable patient-reported measure of compassion is provided.

RESULTS

Consensus on an initial pool of 109 items and their response scale was achieved with the aid of a TOS.

CONCLUSIONS

Dynamic, experiential, and relational care constructs such as compassion lie at the heart of nursing. Practical guidance on item generation is needed to allow nurses to identify, measure, and improve compassion in research and practice.

International Consortium for Health Outcomes Measurement (ICHOM): Standardized Patient-Centered Outcomes Measurement Set for Heart Failure Patients

Whereas multiple national, international, and trial registries for heart failure have been created, international standards for clinical assessment and outcome measurement do not currently exist. The working group's objective was to facilitate international comparison in heart failure care, using standardized parameters and meaningful patient-centered outcomes for research and quality of care assessments. The International Consortium for Health Outcomes Measurement recruited an international working group of clinical heart failure experts, researchers, and patient representatives to define a standard set of outcomes and risk-adjustment variables. This was designed to document, compare, and ultimately improve patient care outcomes in the heart failure population, with a focus on global feasibility and relevance. The working group employed a Delphi process, patient focus groups, online patient surveys, and multiple systematic publications searches. The process occurred over 10 months, employing 7 international teleconferences. A 17-item set has been established, addressing selected functional, psychosocial, burden of care, and survival outcome domains. These measures were designed to include all patients with heart failure, whether entered at first presentation or subsequent decompensation, excluding cardiogenic shock. Sources include clinician report, administrative data, and validated patient-reported outcome measurement tools: the Kansas City Cardiomyopathy Questionnaire; the Patient Health Questionnaire-2; and the Patient-Reported Outcomes Measurement Information System. Recommended data included those to support risk adjustment and benchmarking across providers and regions. The International Consortium for Health Outcomes Measurement developed a dataset designed to capture, compare, and improve care for heart failure, with feasibility and relevance for patients and clinicians worldwide.

Psychometric Analysis and Effectiveness of the Psychological Readiness of Injured Athlete to Return to Sport (PRIA-RS) Questionnaire on Injured Soccer Players

The decision-making process about when an athlete may safely return to training and competition after an injury is a difficult decision. Safe return to training and competition is characterised by physical and psychological readiness to return to the sport. The objectives of this study are (1) to assess the measurement properties of the Psychological Readiness of Injured Athlete to Return to Sport questionnaire (PRIA-RS), and (2) to analyse the effectiveness which the PRIA-RS questionnaire possesses when applied during four consecutive seasons on professional soccer players. One hundred and nine male soccer players from the Albacete Soccer Club (Spain) were involved during four consecutive seasons for the current study: 2012–2013, 2013–2014, 2014–2015 and 2015–2016. Psychometric analysis (validity, reliability, internal consistency and effectiveness) and external psychometric analysis (evaluating measures of patient-reported outcomes (EMPRO)) were confirmed and supported. The main results of the study reveal that the psychometric properties of this questionnaire are optimum for their application in a professional sports context.