Characteristics and decision making of hospital report card consumers: Lessons from an onsite-based cross-sectional study

The Credibility of Physician Rating Websites: A Systematic Literature Review

OBJECTIVES

Increasingly, the credibility of online reviews is drawing critical attention due to the lack of control mechanisms, the constant debate about fake reviews and, last but not least, current developments in the field of artificial intelligence. For this reason, the aim of this study was to examine the extent to which assessments recorded on physician rating websites (PRWs) are credible, based on a comparison to other evaluation criteria.

METHODS

Referring to the PRISMA guidelines, a comprehensive literature search was conducted across different scientific databases. Data were synthesized by comparing individual statistical outcomes, objectives and conclusions.

RESULTS

The chosen search strategy led to a database of 36,755 studies of which 28 were ultimately included in the systematic review. The literature review yielded mixed results regarding the credibility of PRWs. While seven publications supported the credibility of PRWs, six publications found no correlation between PRWs and alternative datasets. 15 studies reported mixed results.

CONCLUSIONS

This study has shown that ratings on PRWs seem to be credible when relying primarily on patients' perception. However, these portals seem inadequate to represent alternative comparative values such as the medical quality of physicians. For health policy makers our results show that decisions based on patients' perceptions may be well supported by data from PRWs. For all other decisions, however, PRWs do not seem to contain sufficiently useful data.

A composite measure for patient-reported outcomes in orthopedic care: design principles and validity checks

BACKGROUND

The complex, multidimensional nature of healthcare quality makes provider and treatment decisions based on quality difficult. Patient-reported outcome (PRO) measures can enhance patient centricity and involvement. The proliferation of PRO measures, however, requires a simplification to improve comprehensibility. Composite measures can simplify complex data without sacrificing the underlying information.

OBJECTIVE AND METHODS

We propose a five-step development approach to combine different PRO into one composite measure (PRO-CM): (i) theoretical framework and metric selection, (ii) initial data analysis, (iii) rescaling, (iv) weighting and aggregation, and (v) sensitivity and uncertainty analysis. We evaluate different rescaling, weighting, and aggregation methods by utilizing data of 3145 hip and 2605 knee replacement patients, to identify the most advantageous development approach for a PRO-CM that reflects quality variations from a patient perspective.

RESULTS

The comparison of different methods within steps (iii) and (iv) reveals the following methods as most advantageous: (iii) rescaling via z-score standardization and (iv) applying differential weights and additive aggregation. The resulting PRO-CM is most sensitive to variations in physical health. Changing weighting schemes impacts the PRO-CM most directly, while it proves more robust towards different rescaling and aggregation approaches.

CONCLUSION

Combining multiple PRO provides a holistic picture of patients' health improvement. The PRO-CM can enhance patient understanding and simplify reporting and monitoring of PRO. However, the development methodology of a PRO-CM needs to be justified and transparent to ensure that it is comprehensible and replicable. This is essential to address the well-known problems associated with composites, such as misinterpretation and lack of trust.

Hospital rating websites play a minor role for uro-oncologic patients when choosing a hospital for major surgery: results of the German multicenter NAVIGATOR-study

PURPOSE

Hospital rating websites (HRW) offer decision support in hospital choice for patients. To investigate the impact of HRWs of uro-oncological patients undergoing elective surgery in Germany.

METHODS

From 01/2020 to 04/2021, patients admitted for radical prostatectomy, radical cystectomy, or renal tumor surgery received a questionnaire on decision-making in hospital choice and the use of HRWs at 10 German urologic clinics.

RESULTS

Our study includes n = 812 completed questionnaires (response rate 81.2%). The mean age was 65.2 ± 10.2 years; 16.5% were women. Patients were scheduled for prostatectomy in 49.1%, renal tumor surgery in 20.3%, and cystectomy in 13.5% (other 17.1%). Following sources of information influenced the decision process of hospital choice: urologists' recommendation (52.6%), previous experience in the hospital (20.3%), recommendations from social environment (17.6%), the hospital's website (10.8%) and 8.2% used other sources. Only 4.3% (n = 35) used a HRW for decision making. However, 29% changed their hospital choice due to the information provided HRW. The most frequently used platforms were Weisse-Liste.de (32%), the AOK-Krankenhausnavigator (13%) and Qualitaetskliniken.de (8%). On average, patients rated positively concerning satisfaction with the respective HRW on the Acceptability E-Scale (mean values of the individual items: 1.8-2.1).

CONCLUSION

In Germany, HRWs play a minor role for uro-oncologic patients undergoing elective surgery. Instead, personal consultation of the treating urologist seems to be far more important. Although patients predominantly rated the provided information of the HRW as positive, only a quarter of users changed the initial choice of hospital.

Factors Associated with the Patient/Client Use of Report Cards, Physician Rating Websites, Social Media, and Google for Hospital and Physician Selection: A Nationwide Survey

Objective: To explore the factors associated with the different uses of report cards, physician rating websites, social media, and Google, including awareness, physician finding, and decision-making based on reviews from the patient/client perspective. Methods: We used computer-assisted telephone interviews to conduct a nationwide representative survey in Taiwan. Results: The urbanization level of the area, income, and long-term health conditions were not associated with the three kinds of usage of the websites studied. Seeking health information was an important factor in the three kinds of website use. The employment industry was associated with awareness, and education level was associated with physician seeking and actions based on reviews. Conclusions: Different factors influenced the three kinds of usage: awareness, actual use (i.e., finding an appropriate physician), and decision-making based on reviews. Seeking health information is of primary importance regardless of how the websites are used. Practical implications: Policy-makers should focus on educating individuals working outside the health care sector to increase awareness of these websites and to assist individuals with low levels of education in increasing their use of these websites.

Can competition improve hospital quality of care? A difference-in-differences approach to evaluate the effect of increasing quality transparency on hospital quality

Public reporting on the quality of care is intended to guide patients to the provider with the highest quality and to stimulate a fair competition on quality. We apply a difference-in-differences design to test whether hospital quality has improved more in markets that are more competitive after the first public release of performance data in Germany in 2008. Panel data from 947 hospitals from 2006 to 2010 are used. Due to the high complexity of the treatment of stroke patients, we approximate general hospital quality by the 30-day risk-adjusted mortality rate for stroke treatment. Market structure is measured (comparatively) by the Herfindahl-Hirschman index (HHI) and by the number of hospitals in the relevant market. Predicted market shares based on exogenous variables only are used to compute the HHI to allow a causal interpretation of the reform effect. A homogenous positive effect of competition on quality of care is found. This effect is mainly driven by the response of non-profit hospitals that have a narrow range of services and private for-profit hospitals with a medium range of services. The results highlight the relevance of outcome transparency to enhance hospital quality competition.

[Effects of statutory quality assurance in acute inpatient care]

BACKGROUND

Statutory quality assurance (QA) serves to ensure and further develop the quality of service provision. Particularly prominent in Germany's acute inpatient care are mandatory quality reports (QRs) and participation in external quality assessments (eQAs). Their effects have not yet been comprehensively evaluated.

OBJECTIVES

What are the effects of eQAs and QRs on the quality of care?

MATERIALS AND METHODS

Based on a selective literature review, international evidence on the effects of QA was compiled. This was supplemented by analyses of the quality reports of the Federal Office for Quality Assurance (BQS), the Institute for Applied Quality Improvement and Research in Health Care (AQUA), and the Institute for Quality Assurance and Transparency in Healthcare (IQTIG), which have been responsible for eQAs since 2001.

RESULTS

According to international literature, at most weak effects of these measures can be expected, especially on process quality. Studies from Germany mostly observe only uncontrolled temporal trends and partly show improved quality indicators. Only one controlled study each was able to show weak positive effects on outcome and process quality for eQAs and QRs, respectively.

CONCLUSIONS

There are no convincing evaluation results for either the QRs or the eQAs. Deficiencies in the addressee-oriented design of the QRs and the reported indicator results in terms of their validity, risk adjustment, and temporal availability can be cited as potential causes. Statutory QA should be revised by paying more attention to the prerequisites for successful performance feedback and by again creating room for an intrinsically motivated assessment of one's own quality of care.

Testing the effects on information use by older versus younger women of modality and narration style in a hospital report card

Background

Hospital report cards (HRCs) are usually presented in a textual and factual format, likely hampering information processing.

Objective

This study aimed to investigate the effects of audiovisual and narrative information in HRCs on user responses, and to test differences between older and younger women.

Design

A 2 (modality [textual vs. audiovisual]) × 3 (narration style [factual vs. process narrative vs. experience narrative]) online experiment was conducted. Information about breast cancer care was used as a case example. Age (younger [<65] vs. older [≥65]) was included as a potential effect modifier.

Setting and Participants

A total of 631 disease‐naïve women (M_age = 56.06) completed an online survey. The outcomes were perceived cognitive load, satisfaction, comprehension, information recall and decisional conflict. Data were analysed using AN(C)OVAs.

Results

Audiovisual (vs. textual) information resulted in higher information satisfaction across age groups, but was associated with lower comprehension in older women. An experience narrative (vs. factual information) increased satisfaction with attractiveness and emotional support of the information only in older women. A three‐way interaction effect was found, suggesting that older women were most satisfied with the comprehensibility of audiovisual factual or textual process narrative information. Younger women were most satisfied with the comprehensibility of audiovisual process narrative or textual factual information.

Discussion and Conclusion

Audiovisual and narrative information in an HRC showed beneficial effects on satisfaction measures. In particular, audiovisual information could be incorporated into HRCs to increase satisfaction with information.

Public Contribution

Lay persons helped in optimizing the visuals used in the stimulus materials by checking for clarity.