Patient-Reported Outcome Measures in Routine Clinical Care: The PROMise of a Better Future?

TRANSCULTURAL ADAPTATION AND VALIDATION OF THE 4-DOMAIN SPORTS PROM INTO ITALIAN

OBJECTIVES

This work aims to evaluate and validate the process of cross-cultural adaptation and validation of the 4-Domain Sports PROM (4-DSP) into Italian, assessing its understandability and reproducibility in all questionnaire domains for Italian-speaking patients.

METHODS

Cross-sectional study, level of evidence II. The questionnaire was self-administered by 100 patients (80 males and 20 females) who had undergone anterior cruciate ligament (ACL) reconstruction and had a one-year minimum follow-up. The mean age and standard deviation (SD) was 31.20 ± 12.65 years. According to their level of sports participation, 51% were recreational, 31% were regional, 12% were national, and 6% were international athletes. All patients filled in the 4-DSP questionnaire without direct supervision of their trainer/coach or researcher. All data were collected and processed anonymously. The translation and cultural adaptation of the 4-DSP involved six phases: (1) translation, (2) synthesis, (3) back-translation, (4) pre-test, (5) expert committee review, (6) final version approval by the author of the original version for publication.

RESULTS

The cross-cultural validation of the questionnaire 4-DSP into Italian presented a global Cronbach's ALPHA of 0.65, Conceptual equivalence to translation and relevance were 99.09% and 99.81%, respectively, and the percentage of agreement was 99.09%.

CONCLUSION

The cross-culturally validated version of the 4-DSP into Italian proved to be adequately understandable and reproducible in all questionnaire domains and can be safely and reliably used in Italian-speaking patients.

LEVEL OF EVIDENCE

Study level II.

Can we collect health-related quality of life information from anticoagulated atrial fibrillation participants who have recently experienced a bleed? An observational feasibility study in primary and secondary care in Wales and through a UK online forum

OBJECTIVE

To evaluate the feasibility of recruiting participants diagnosed with atrial fibrillation (AF) taking oral anticoagulation therapies (OATs) and recently experiencing a bleed to collect health-related quality of life (HRQoL) information.

DESIGN

Observational feasibility study. The study aimed to determine the feasibility of recruiting participants with minor and major bleeds, the most appropriate route for recruitment and the appropriateness of the patient-reported outcome measures (PROMs) selected for collecting HRQoL information in AF patients, and the preferred format of the surveys.

SETTING

Primary care, secondary care and via an online patient forum.

PARTICIPANTS

The study population was adult patients (≥18) with AF taking OATs who had experienced a recent major or minor bleed within the last 4 weeks.

PRIMARY AND SECONDARY OUTCOME MEASURES

Primary outcomes - PROMs: EuroQol 5 Dimensions-5 Levels, Perception of Anticoagulant Treatment Questionnaire, part 2 only (part 2), atrial fibrillation effect on quality of life. Secondary outcomes - Location of bleed, bleed severity, current treatment, patient perceptions of HRQoL in relation to bleeding events.

RESULTS

We received initial expressions of interest from 103 participants. We subsequently recruited 32 participants to the study-14 from primary care and 18 through the AF forum. No participants were recruited through secondary care. Despite 32 participants consenting, only 26 initial surveys were completed. We received follow-up surveys from 11 participants (8 primary care and 3 AF forum). COVID-19 had a major impact on the study.

CONCLUSIONS

Primary care was the most successful route for recruitment. Most participants recruited to the study experienced a minor bleed. Further ways to recruit in secondary care should be explored, especially to capture more serious bleeds.

TRIAL REGISTRATION NUMBER

The study is registered in the Clinicaltrials.gov database, NCT04921176.

Web-Based Patient-Reported Outcomes for ENT Patients-Evaluation of the Status Quo, Patients' View, and Future Perspectives

BACKGROUND

Patient-reported outcomes (PRO) assess disease burden and indicate unmet needs. Home-based electronic PRO measures (ePROMs) can support tumor aftercare (TAC). Creating an ePROM is the next step after implementing the software "OncoFunction" to assess PROs during TAC of head- and neck-cancer patients (HNC). Therefore, internet use and perception on ePROMs of ENT and TAC patients were evaluated.

METHODS

From May-July 2020, ENT patients at a high-volume outpatient department aged >18 without need for emergency treatment were invited to complete a questionnaire concerning internet use and access, hardware, and opinion on the chances, requirements, and designs of ePROMs.

RESULTS

415 questionnaires were evaluated; 46.3% of the respondents visited the common consultation hour (CCH) and 44.3% TAC; 71.9% were internet users, being younger than non-internet users; and 36.4% of TAC patients were non-internet users and 16.3% of them were without a web-enabled device. Significant differences existed in age and assessment of future perspectives between internet-/non-internet users and TAC/CCH patients, respectively. Regarding the design of ePROMs, patients preferred quarterly and short surveys. Data safety and feedback were important.

CONCLUSIONS

ePROMs are not suitable for everyone because of missing internet access and experience. A tailored approach to implement ePROMs in TAC is needed.

Saving time and effort: Best practice for adapting existing patient-reported outcome measures in hepatology

It is increasingly recognised that collecting patient reported outcome measures (PROMs) data is an important part of healthcare and should be considered alongside traditional clinical assessments. As part of a more holistic view of healthcare provision, there has been an increased drive to implement PROM collection as part of routine clinical care in hepatology. This drive has resulted in an increase in the number of PROMs currently developed to be used in various liver conditions. However, the development and validation of a new PROM is time-consuming and costly. Therefore, before deciding to develop a new PROM, researchers should consider identifying existing PROMs to assess their appropriateness and, if necessary, make adaptations to existing PROMs to ensure their rigour when used with the target population. Little is written in the literature on how to identify and adapt the existing PROMs in hepatology. This article aims to provide a summary of the current literature and guidance regarding identifying and adapting existing PROMs in clinical practice.

Patients' Satisfaction by SmileInTM Totems in Radiotherapy: A Two-Year Mono-Institutional Experience

Background: Patient’s satisfaction is recognized as an indicator to monitor quality in healthcare services. Patient-reported experience measures (PREMs) may contribute to create a benchmark of hospital performance by assessing quality and safety in cancer care. Methods: The areas of interest assessed were: patient-centric welcome perception (PCWP), punctuality, professionalism and comfort using the Lean Six Sigma (LSS) methodology. The RAMSI (Radioterapia Amica Mia SmileIN^{TM (SI)} My Friend Radiotherapy^SI), project provided for the placement of SI totems with four push buttons using HappyOrNot technology in a high-volume radiation oncology (RO) department. The SI technology was implemented in the RO department of the Fondazione Policlinico Universitario A. Gemelli IRCCS. SI totems were installed in different areas of the department. The SI Experience Index was collected, analyzed and compared. Weekly and monthly reports were created showing hourly, daily and overall trends. Results: From October 2017 to November 2019, a total of 42,755 votes were recorded: 8687, 10,431, 18,628 and 5009 feedback items were obtained for PCWP, professionalism, punctuality, and comfort, respectively. All areas obtained a SI-approved rate ≥ 8.0. Conclusions: The implementation of the RAMSI system proved to be doable according to the large amount of feedback items collected in a high-volume clinical department. The application of the LSS methodology led to specific corrective actions such as modification of the call-in-clinic system during operations planning. In order to provide healthcare optimization, a multicentric and multispecialty network should be defined in order to set up a benchmark.

The Listening Network and Cochlear Implant Benefits in Hearing-Impaired Adults

Older adults with mild or no hearing loss make more errors and expend more effort listening to speech. Cochlear implants (CI) restore hearing to deaf patients but with limited fidelity. We hypothesized that patient-reported hearing and health-related quality of life in CI patients may similarly vary according to age. Speech Spatial Qualities (SSQ) of hearing scale and Health Utilities Index Mark III (HUI) questionnaires were administered to 543 unilaterally implanted adults across Europe, South Africa, and South America. Data were acquired before surgery and at 1, 2, and 3 years post-surgery. Data were analyzed using linear mixed models with visit, age group (18–34, 35–44, 45–54, 55–64, and 65+), and side of implant as main factors and adjusted for other covariates. Tinnitus and dizziness prevalence did not vary with age, but older groups had more preoperative hearing. Preoperatively and postoperatively, SSQ scores were significantly higher (Δ0.75–0.82) for those aged <45 compared with those 55+. However, gains in SSQ scores were equivalent across age groups, although postoperative SSQ scores were higher in right-ear implanted subjects. All age groups benefited equally in terms of HUI gain (0.18), with no decrease in scores with age. Overall, younger adults appeared to cope better with a degraded hearing before and after CI, leading to better subjective hearing performance.

Validation and Implementation of 4-domain Patient-reported Outcome Measures (PROMs) Tailored for Orthopedic Sports Medicine

The validation of a 4-domain PROM tailored to orthopedic sports medicine was performed through item generation, item scaling, validity and reliability testing, statistical analysis, as well as item reduction. Conbrach's alpha was used to verify item homogeneity, i. e. their accuracy or consistency. This PROM showed acceptable statistical accuracy and clinical applicability for a variety of surgical treatments, regardless of the anatomical injury sites. Moreover, this PROM considers the athletes' primary physical demands in an non-injured baseline condition, their motivation to continue sports practice and participation, and the influence of sports practice on their quality of life. This 4-domain PROM tailored for orthopedic sports medicine appears to be a valid tool to assess athletes and high-performing practitioners with sports injuries, recording their perception of injury, expectations of treatment; evaluation of postoperative care and treatment received, and perceived outcomes compared to their pre-injury status of physical demands in sports activity. The tool is unique, allowing direct comparisons between athletes' perception of pre-injury baseline, injury, treatment, and outcome. It will be a welcome adjunct to the sports medicine professional's tool box when assessing athlete's status and outcome after injury and intervention.

Obtaining Patient-Reported Outcomes Electronically With "OncoFunction" in Head and Neck Cancer Patients During Aftercare

The disease and treatment of patients with head and neck cancer can lead to multiple late and long-term sequelae. Especially pain, psychosocial problems, and voice issues can have a high impact on patients' health-related quality of life. The aim was to show the feasibility of implementing an electronic Patient-Reported Outcome Measure (PROM) in patients with head and neck cancer (HNC). Driven by our department's intention to assess Patient-Reported Outcomes (PRO) based on the International Classification of Functioning during tumor aftercare, the program "OncoFunction" has been implemented and continuously refined in everyday practice. The new version of "OncoFunction" was evaluated by 20 head and neck surgeons and radiation oncologists in an interview. From 7/2013 until 7/2017, 846 patients completed the PROM during 2,833 of 3,610 total visits (78.5%). The latest software version implemented newly developed add-ins and increased the already high approval ratings in the evaluation as the number of errors and the time required decreased (6 vs. 0 errors, 1.35 vs. 0.95 min; p<0.01). Notably, patients had different requests using PRO in homecare use. An additional examination shows that only 59% of HNC patients use the world wide web. Using OncoFunction for online-recording and interpretation of PROM improved data acquisition in daily HNC patients' follow-up. An accessory timeline grants access to former consultations and their visualization supported and simplified structured examinations. This provides an easy-to-use representation of the patient's functional outcome supporting comprehensive aftercare, considering all aspects of the patient's life.

Validating a Patient-Reported Outcomes-Derived Algorithm for Classifying Symptom Complexity Levels Among Patients With Cancer

BACKGROUND

The patient-reported outcomes (PROs) symptom complexity algorithm, derived from self-reported symptom scores using the Edmonton Symptom Assessment System and concerns indicated on the Canadian Problem Checklist, has not been validated extensively.

METHODS

This is a retrospective chart review study using data from the Alberta Cancer Registry and electronic medical records from Alberta Health Services. The sample includes patients with cancer who visited a cancer facility in Alberta, Canada, from February 2016 through November 2017 (n=1,466).

RESULTS

The effect size (d=1.2) indicates that the magnitude of difference in health status between the severe- and low-complexity groups is large. The symptom complexity algorithm effectively classified subgroups of patients with cancer with distinct health status. Using Karnofsky performance status, the algorithm shows a sensitivity of 70.3%, specificity of 84.1%, positive predictive value of 79.1%, negative predictive value of 76.7%, and accuracy of 77.7%. An area under the receiver operating characteristic of 0.824 was found for the complexity algorithm, which is generally regarded as good, This same finding was also regarded as superior to the alternative algorithm generated by 2-step cluster analysis (area under the curve, 0.721).

CONCLUSIONS

The validity of the PRO-derived symptom complexity algorithm is established in this study. The algorithm demonstrated satisfactory accuracy against a clinician-driven complexity assessment and a strong correlation with the known group analysis. Furthermore, the algorithm showed a higher screening capacity compared with the algorithm generated from 2-step cluster analysis, reinforcing the importance of contextualization when classifying patients' symptoms, rather than purely relying on statistical outcomes. The algorithm carries importance in clinical settings, acting as a symptom complexity flag, helping healthcare teams identify which patients may need more timely, targeted, and individualized patient symptom management.

Questionnaires assessing the use of complementary health approaches in pediatrics and their measurement properties: A systematic review

OBJECTIVES

To identify questionnaires assessing the use of complementary health approaches (CHA) in pediatrics, describe their content, and appraise the methodological quality of the studies and the measurement properties of the questionnaires.

METHOD

Major electronic databases were searched from 2011 to 2020. Studies which aimed to assess the use of CHA and studies which reported developing and validating CHA questionnaires in pediatrics were included. Two reviewers independently screened the studies, extracted the data, and rated the methodological quality of the studies and measurement properties of the questionnaires using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. When consensus was not reached, a third reviewer was consulted.

RESULTS

Thirty-eight studies were included. From these studies, 35 CHA questionnaires with a variety of different items were identified. Only two studies aimed to evaluate the measurement properties of two questionnaires. One questionnaire, available as a self- and proxy-report, was initially validated in children with juvenile idiopathic arthritis, and the other, available as an interviewer-administered questionnaire, was validated in children with cancer. According to the COSMIN, the methodological quality of both studies was inadequate or doubtful, and both questionnaires was not thoroughly validated.

CONCLUSION

This systematic review showed a lack of a thoroughly validated CHA questionnaire in pediatrics. However, two questionnaires were found to hold promise. To address this gap, one of the existing questionnaires should be adapted and further validated.

Experiences of Unmet Need and Access to Supportive Care for Men Receiving Androgen Deprivation Therapy for Prostate Cancer: A Bi-national Study

OBJECTIVE

The number of men affected by incurable prostate cancer is expected to increase worldwide. Research is needed to enable men to share their experiences of unmet supportive care needs in current care delivery. We aimed to identify the most frequently reported domains of unmet supportive care needs, levels of anxiety, depression, distress, health-related quality of life, and to identify any perceived barriers to receiving supportive care.

DATA SOURCES

Men diagnosed with prostate cancer who had received a minimum of 6 months of ADT were recruited into a cross-sectional study. Participants completed standardised questionnaires; clinical and demographic data was also collected.

CONCLUSION

Two hundred seventy-two patients were invited, and 102 participated. No statistically significant differences were found between participant scores from Australia and UK in relation to anxiety and depression, exercise, health-related quality of life, or distress scores. Perceived barriers include service delivery related to information provision and difficulties in the navigation of complex care systems.

IMPLICATIONS FOR NURSING PRACTICE

Men affected by prostate cancer receiving ADT reported unmet supportive care needs, specifically related to sexual, informational, and psychological aspects of care. Mapping future trajectories of needs and identifying men at high risk can significantly improve timely and tailored interventions.

Study protocol for the validation of a new patient-reported outcome measure (PROM) of listening effort in cochlear implantation: the Listening Effort Questionnaire-Cochlear Implant (LEQ-CI)

INTRODUCTION

Listening effort may be defined as the cognitive resources needed to understand an auditory message. A sustained requirement for listening effort is known to have a negative impact on individuals' sense of social connectedness, well-being and quality of life. A number of hearing-specific patient-reported outcome measures (PROMs) exist currently; however, none adequately assess listening effort as it is experienced in the listening situations of everyday life. The Listening Effort Questionnaire-Cochlear Implant (LEQ-CI) is a new, hearing-specific PROM designed to assess perceived listening effort as experienced by adult CI patients. It is the aim of this study to conduct the first psychometric evaluation of the LEQ-CI's measurement properties.

METHODS AND ANALYSIS

This study is a phased, prospective, multi-site validation study in a UK population of adults with severe-profound sensorineural hearing loss who meet local candidacy criteria for CI. In phase 1, 250 CI patients from four National Health Service CI centres will self-complete a paper version of the LEQ-CI. Factor analysis will establish unidimensionality and Rasch analysis will evaluate item fit, differential item functioning, response scale ordering, targeting of persons and items, and reliability. Classical test theory methods will assess acceptability/data completeness, scaling assumptions, targeting and internal consistency reliability. Phase 1 results will inform refinements to the LEQ-CI. In phase 2, a new sample of adult CI patients (n=100) will self-complete the refined LEQ-CI, the Speech, Spatial and Qualities of Hearing Scale, the Nijmegen Cochlear Implant Questionnaire and the Fatigue Assessment Scale to assess construct validity.

ETHICS AND DISSEMINATION

This study was approved by the Abertawe Bro Morgannwg University Health Board/Swansea University Joint Study Review Committee and the Newcastle and North Tyneside 2 Research Ethics Committee, Ref: 18/NE/0320. Dissemination will be in high-quality journals, conference presentations and SEH's doctoral dissertation.

How to decide which patient-reported outcome measure to use? A practical guide for plastic surgeons

The use of patient-reported outcome measures (PROMs) is increasing across all medical specialties, as their importance to patient care is validated. They are likely to play a particularly important role in plastic and reconstructive surgery where outcomes are often subjective, and the recent guidance from the Royal College of Surgeons of England advising their use in cosmetic surgery highlights this. To drive their routine use across our specialty, it is important that clinicians are capable of understanding the often complex and confusing language that surrounds their design and validation. In this article, we describe the process of PROM design and validation, and we attempt to 'demystify' the language used in the health outcome literature. We present the important steps that a well-designed PROM must go through and suggest a straightforward guide for selecting the most appropriate PROMs for use in clinical practice. We hope that this will encourage greater use of PROM data across plastic and reconstructive surgery and ultimately help improve outcomes for our patients.

Improving Quality of Care in Patients with Liver Cirrhosis

Liver cirrhosis is a major chronic disease in the field of digestive diseases. It causes more than one million deaths per year. Despite established evidence based guidelines, the adherence to standard of care or quality indicators are variable. Complete adherence to the recommendations of guidelines is less than 50%. To improve the quality of care in patients with cirrhosis, we need a more holistic view. Because of high rate of death due to cardiovascular disease and neoplasms, the care of comorbid conditions and risk factors such as smoking, hypertension, high blood sugar or cholesterol, would be important in addition to the management of primary liver disease. Despite a holistic multidisciplinary approach for this goal, the management of such patients should be patient centered and individualized. The diagnosis of underlying etiology and its appropriate treatment is the most important step. Definition and customizing the quality indicators for quality measure in patients are needed. Because most suggested quality indicators are designed for measuring the quality of care in decompensated liver cirrhosis, we need special quality indicators for compensated and milder forms of chronic liver disease as well. Training the patients for participation in their own management, design of special clinics with dedicated health professionals in a form of chronic disease model, is suggested for improvement of quality of care in this group of patients. Special day care centers by a dedicated gastroenterologist and a trained nurse may be a practical model for better management of such patients.