Publicly disclosed information about the quality of health care: response of the US public

A cross-sectional survey of patient perceptions of the National Neurosurgical Audit Programme (NNAP)

BACKGROUND

The National Neurosurgical Audit Programme (NNAP) publishes mortality outcomes of consultants and neurosurgical units across the United Kingdom. It is unclear how useful outcomes data is for patients and whether it influences their decision-making process. Our aim was to identify patients' perceptions and understanding of the NNAP data and its influences.

MATERIALS AND METHODS

This single-centre study was conducted in the outpatient neurosurgery clinics at a regional neurosurgical centre. All adult (age ≥ 18) neurosurgical patients, with capacity, were invited to take part. Native and non-native English speakers were eligible. Statistical analyses were performed on SPSS v28 (IBM). Ethical approval was obtained.

RESULTS

A total of 84 responses were received (54.7% females). Over half (51.0%) of respondents felt that they understood a consultant's mortality outcomes. Educational level determines respondents' understanding (χ2(8) = 16.870; p = .031). Most respondents were unaware of the NNAP (89.0%). Only a third of respondents (35.1%) understood the funnel plot used to illustrate mortality.

CONCLUSIONS

Most patients were unaware of the NNAP and most did not understand the data on the website. Understanding of mortality data seemed to be related to respondents' educational level which would be important to keep in mind when planning how to depict mortality data.

Web-Based Public Reporting as a Decision-Making Tool for Consumers of Long-Term Care in the United States and the United Kingdom: Systematic Analysis of Report Cards

BACKGROUND

Report cards can help consumers make an informed decision when searching for a long-term care facility.

OBJECTIVE

This study aims to examine the current state of web-based public reporting on long-term care facilities in the United States and the United Kingdom.

METHODS

We conducted an internet search for report cards, which allowed for a nationwide search for long-term care facilities and provided freely accessible quality information. On the included report cards, we drew a sample of 1320 facility profiles by searching for long-term care facilities in 4 US and 2 UK cities. Based on those profiles, we analyzed the information provided by the included report cards descriptively.

RESULTS

We found 40 report cards (26 in the United States and 14 in the United Kingdom). In total, 11 of them did not state the source of information. Additionally, 7 report cards had an advanced search field, 24 provided simplification tools, and only 3 had a comparison function. Structural quality information was always provided, followed by consumer feedback on 27 websites, process quality on 15 websites, prices on 12 websites, and outcome quality on 8 websites. Inspection results were always displayed as composite measures.

CONCLUSIONS

Apparently, the identified report cards have deficits. To make them more helpful for users and to bring public reporting a bit closer to its goal of improving the quality of health care services, both countries are advised to concentrate on optimizing the existing report cards. Those should become more transparent and improve the reporting of prices and consumer feedback. Advanced search, simplification tools, and comparison functions should be integrated more widely.

Does information disclosure among public hospitals stimulate medical cost change efforts? A pilot study in Shanghai

BACKGROUND

In 2013, the Shanghai Hospital Development Center issued a policy to advocate public hospitals to report their information about costs on diseases. The objective was to evaluate the impact of interhospital disclosure of costs on diseases on medical costs and compare costs per case following information disclosure between hospitals of different rankings.

METHODS

The study uses the hospital-level performance report issued by Shanghai Hospital Development Center in the fourth quarter of 2013, which covers quarterly aggregated hospital-level discharge data from 14 tertiary public hospitals participating in thyroid malignant tumors and colorectal malignant tumors information disclosure from the first quarter of 2012 to the third quarter of 2020. An interrupted time series model with segmented regression analysis is employed to examine changes in quarterly trends with respect to costs per case and length of stay before and after information disclosure. We identified high- and low-cost hospitals by ranking them on a costs per case basis per disease group.

RESULTS

This research identified significant differences in cost changes for thyroid malignant tumors and colorectal malignant tumors between hospitals after disclosing information. A hospital's discharge costs per case for thyroid malignant tumors increased significantly among top-cost hospitals (1629.251 RMB, P = 0.019), while decreased for thyroid and colorectal malignant tumors among low-cost hospitals (-1504.189 RMB, P = 0.003; -6511.650 RMB, P = 0.024, respectively).

CONCLUSION

Our findings indicate that information disclosure of costs on diseases results in changes in discharge costs per case. And low-cost hospitals continued to maintain their leading edge, whereas the high-cost hospitals changed their position in the industry by reducing discharge costs per case after information disclosure.

Factors Associated With Hospices' Nonparticipation in Medicare's Hospice Compare Public Reporting Program

BACKGROUND

To enhance the quality of hospice care and to facilitate consumers' choices, the Centers for Medicare and Medicaid Services (CMS) began the Hospice Quality Reporting Program, in which CMS posted the quality measures of participating hospices on its reporting website, Hospice Compare. Little is known about the participation rate and the types of nonparticipating hospices.

OBJECTIVE

To examine the factors associated with hospices' nonparticipation in Hospice Compare.

RESEARCH DESIGN

We analyzed data from the CMS 2016 Hospice Compare. "Nonparticipants" were those who did not submit any quality measure. With the data of the Provider of Service file, the Healthcare Cost Report Information System, and the Area Health Resources File, multivariate logistic regressions estimated the association between nonparticipants and hospice and market characteristics, including ownership, size, nurse staffing ratio, and market competition intensity.

RESULTS

Among the 4123 certified hospices subject to penalty from nonparticipation, 259 did not participate in Hospice Compare. California, New Mexico, Texas, and Wyoming had participation rates lower than 80%. Hospices that were for-profit, had no accreditation, had few nurses per patient day, provided no inpatient care, and were located in competitive markets were less likely to participate than other hospices.

CONCLUSIONS

Hospice Compare successfully motivated hospice in participating in the quality report program in most of states. For-profit hospices, hospices with less quality, and hospices located in competitive markets were less likely to participate. Further research is warranted to examine the quality of these nonparticipants, especially in the 4 states with a lower participation rate.

Measuring Hospital Performance Using Mortality Rates: An Alternative to the RAMR

Background: The risk-adjusted mortality rate (RAMR) is used widely by healthcare agencies to evaluate hospital performance. The RAMR is insensitive to case volume and requires a confidence interval for proper interpretation, which results in a hypothesis testing framework. Unfamiliarity with hypothesis testing can lead to erroneous interpretations by the public and other stakeholders. We argue that screening, rather than hypothesis testing, is more defensible. We propose an alternative to the RAMR that is based on sound statistical methodology, easier to understand and can be used in large-scale screening with no additional data requirements.

Methods: We use an upper-tail probability to screen for hospitals performing poorly and a lower-tail probability to screen for hospitals performing well. Confidence intervals and hypothesis tests are not needed to compute or interpret our measures. Moreover, unlike the RAMR, our measures are sensitive to the number of cases treated.

Results: To demonstrate our proposed methodology, we obtained data from the New York State Department of Health for 10 Inpatient Quality Indicators (IQIs) for the years 2009-2013. We find strong agreement between the upper tail probability (UTP) and the RAMR, supporting our contention that the UTP is a viable alternative to the RAMR.

Conclusion: We show that our method is simpler to implement than the RAMR and, with no need for a confidence interval, it is easier to interpret. Moreover, it will be available for all hospitals and all diseases/conditions regardless of patient volume.

Public Views on Healthcare Performance Indicators and Patient Choice

Patients on certain waiting lists in the UK National Health Service (NHS) are now offered the choice of persevering with their home hospital or switching to another hospital where they will be treated on a guaranteed date. Such decisions require knowledge of performance. We used facilitated focus groups to investigate the views of patients and members of the public on publication of information about the performance of healthcare providers. Six groups with a total of 50 participants met in six different locations in England.

Participants felt that independent monitoring of healthcare performance is necessary, but they were ambivalent about the value of performance indicators and hospital rankings. They tended to distrust government information and preferred the presentational style of ‘Dr Foster’, a commercial information provider, because it gave more detailed locally relevant information. Many participants felt the NHS did not offer much scope for choice of provider.

If public access to performance information is to succeed in informing referral decisions and raising quality standards, the public and general practitioners will need education on how to interpret and use the data.

Structure and process quality as predictors of satisfaction with elderly care

The structure versus process approach to quality of care presented by Donabedian is one of the most cited ever. However, there has been a paucity of research into the empirical validity of this framework, specifically concerning the relative effects of structure and process on satisfaction with elderly care as perceived by the older persons themselves. The current research presents findings from a national survey, including a wide range of quality indicators for elderly care services, conducted in 2012 at the request of the Swedish National Board of Health and Welfare in which responses from 95,000 elderly people living in 324 municipalities and districts were obtained. The results revealed that the only structural variable which significantly predicted quality of care was staffing, measured in terms of the number of caregivers per older resident. More interestingly, process variables (e.g. respect and access to information) explained 40% and 48% of the variance in satisfaction with care, over and above the structural variables, in home care and nursing homes respectively. The findings from this large nationwide sample examining Donabedian's model suggest that quality in elderly care is primarily determined by factors pertaining to process, that is, how caregivers behave towards the older persons. This encourages a continued quality improvement in elderly care with a particular focus on process variables.

Patient choice, Internet based information sources, and perceptions of health care: Evidence from Sweden using survey data from 2010 and 2013

BACKGROUND

Several countries have increased patients' abilities to choose their health care providers, frequently under the assumption that patients are themselves the best agents to make such decisions. In parallel, national and regional health authorities have enhanced access to Internet based information sources (IBIS) to assist patients in making an informed choice. Relatively little, however, is known about the effect that the use of such sources has on key outcomes, including patients' perceptions of care. The aim of this study is to analyze the role of the Internet for patients' confidence in the provider and perceived access to care in the context of choice based reforms in Sweden.

METHODS

The study uses a regional, population health survey from the southern part of Sweden. Non-parametric chi-square tests are used to assess the nature of Internet users, including their gender, age and socioeconomic status. Logistic regression models are specified to analyze the role of IBIS on patient perceptions of care while controlling for other factors.

RESULTS

Actual use of Internet based information sources for health care was relatively low in 2010 and only somewhat higher in 2013. The characteristics of IBIS users varied significantly across different population groups, such that they were younger, more educated, female, and also considered themselves to be in better health compared with those who reported not using this source of health care information. Finally, the average IBIS user was less likely to report having a high level of satisfaction with respect to their primary care use; OR 0.69 [95 % CI: 0.54-0,87] and OR 0.52 [95 % CI: 0,41-0,66], for confidence in provider and perceived access to care, respectively, in 2013.

CONCLUSIONS

Despite health agencies' attempts to make information on health care providers available on the Internet, this source of health care information is not used to any large extent in the current sample. The fact that some people use this source of information more compared with others suggests the need to consider alternative ways of informing the general public about choice options. The use of Internet based sources may also be linked with the experience of actually using health services, which suggests a need to further analyze this complex consumer behavior process.

The impact of Public Reporting on clinical outcomes: a systematic review and meta-analysis

Background

To assess both qualitatively and quantitatively the impact of Public Reporting (PR) on clinical outcomes, we carried out a systematic review of published studies on this topic.

Methods

Pubmed, Web of Science and SCOPUS databases were searched to identify studies published from 1991 to 2014 that investigated the relationship between PR and clinical outcomes. Studies were considered eligible if they investigated the relationship between PR and clinical outcomes and comprehensively described the PR mechanism and the study design adopted. Among the clinical outcomes identified, meta-analysis was performed for overall mortality rate which quantitative data were exhaustively reported in a sufficient number of studies. Two reviewers conducted all data extraction independently and disagreements were resolved through discussion. The same reviewers evaluated also the quality of the studies using a GRADE approach.

Results

Twenty-seven studies were included. Mainly, the effect of PR on clinical outcomes was positive. Meta-analysis regarding overall mortality included, in a context of high heterogeneity, 10 studies with a total of 1,840,401 experimental events and 3,670,446 control events and resulted in a RR of 0.85 (95 % CI, 0.79-0.92).

Conclusions

The introduction of PR programs at different levels of the healthcare sector is a challenging but rewarding public health strategy. Existing research covering different clinical outcomes supports the idea that PR could, in fact, stimulate providers to improve healthcare quality.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-016-1543-y) contains supplementary material, which is available to authorized users.

Do patients with gastrointestinal cancer want to decide where they have tests and surgery? A questionnaire study of provider choice

BACKGROUNDS

Choice of provider has been an important strategy among policy makers, intended, in part, to drive improvements in quality and efficiency of healthcare. This study examined the information requirements, and decision-making experiences and preferences of patients who have had surgery for gastrointestinal cancer, to assess the status of provider choice in current practice.

METHODS

The single-item Control Preferences Scale was used to determine patients' experiences and preferences when being referred for tests, and choosing where to have surgery. Participants used a Likert scale to rate the importance of 23 information items covering a variety of structures, processes and outcomes at the hospital level and the department level. Participants were recruited by post and online.

RESULTS

463 responses were analysed. Patients reported very low levels of involvement in provider choice, with their doctor deciding where they underwent tests or surgery in 77.0% and 81.8% of cases, respectively. Over two-thirds of participants would have preferred greater involvement in provider choice than they experienced. Of note, patient age and education were not associated with reported preferences. Information on how long patients with cancer wait for treatment, annual operative volume and postoperative mortality rate, as well as retained foreign bodies and infection rates were considered very important.

CONCLUSIONS

There was a substantial unmet desire for greater involvement in provider choice among study participants. Respondents attached particular importance to surgery-specific information. Efforts should be made to increase involvement of patients with gastrointestinal cancer in provider decisions, across primary and secondary care, to deliver more patient-centred care. The reported lack of patient involvement in provider choice suggests it is unlikely to be working as an effective lever to drive quality improvement at present.

Accounting for quality: on the relationship between accounting and quality improvement in healthcare

BACKGROUND

Accounting-that is, standardized measurement, public reporting, performance evaluation and managerial control-is commonly seen to provide the core infrastructure for quality improvement in healthcare. Yet, accounting successfully for quality has been a problematic endeavor, often producing dysfunctional effects. This has raised questions about the appropriate role for accounting in achieving quality improvement. This paper contributes to this debate by contrasting the specific way in which accounting is understood and operationalized for quality improvement in the UK National Health Service (NHS) with findings from the broadly defined 'social studies of accounting' literature and illustrative examples.

DISCUSSION

This paper highlights three significant differences between the way that accounting is understood to operate in the dominant health policy discourse and recent healthcare reforms, and in the social studies of accounting literature. It shows that accounting does not just find things out, but makes them up. It shows that accounting is not simply a matter of substance, but of style. And it shows that accounting does not just facilitate, but displaces, control. The illumination of these differences in the way that accounting is conceptualized helps to diagnose why accounting interventions often fail to produce the quality improvements that were envisioned. This paper concludes that accounting is not necessarily incompatible with the ambition of quality improvement, but that it would need to be understood and operationalized in new ways in order to contribute to this end. Proposals for this new way of advancing accounting are discussed. They include the cultivation of overlapping and even conflicting measures of quality, the evaluation of accounting regimes in terms of what they do to practice, and the development of distinctively skeptical calculative cultures.

What Influences Patients' Decisions When Choosing a Health Care Provider? Measuring Preferences of Patients with Knee Arthrosis, Chronic Depression, or Alzheimer's Disease, Using Discrete Choice Experiments

OBJECTIVE

To investigate what influences patients' health care decisions and what the implications are for the provision of information on the quality of health care providers to patients.

DATA SOURCES/STUDY SETTING

Dutch patient samples between November 2006 and February 2007.

STUDY DESIGN

Discrete choice experiments were conducted in three patient groups to explore what influences choice for health care providers.

DATA COLLECTION

Data were obtained from 616 patients with knee arthrosis, 368 patients with chronic depression, and 421 representatives of patients with Alzheimer's disease.

PRINCIPAL FINDINGS

The three patients groups chose health care providers on a different basis. The most valued attributes were effectiveness and safety (knee arthrosis); continuity of care and relationship with the therapist (chronic depression); and expertise (Alzheimer's disease). Preferences differed between subgroups, mainly in relation to patients' choice profiles, severity of disease, and some background characteristics.

CONCLUSIONS

This study showed that there is substantial room for (quality) information about health care providers in patients' decision processes. This information should be tailor-made, targeting specific patient segments, because different actors and factors play a part in their search and selection process.

Diabetic retinopathy care--an international quality comparison

PURPOSE

The purpose of this paper is to study the quality indicator appropriateness and use it for international quality comparison on diabetic retinopathy (DR) patient care process in one American and one Dutch eye hospital.

DESIGN/METHODOLOGY/APPROACH

A 17-item DR quality indicator set was composed based on a literature review and systematically applied in two hospitals. Qualitative analysis entailed document study and 12 semi-structured face-to-face interviews with ophthalmologists, managers, and board members of the two hospitals.

FINDINGS

While the medical-clinical approach to DR treatment in both hospitals was similar, differences were found in quality of care perception and operationalization. Neither hospital systematically used outcome indicators for DR care. On the process level, the authors found larger differences. Similarities and differences were found in the structure of both hospitals. The hospitals' particular contexts influenced the interpretation and use of quality indicators.

PRACTICAL IMPLICATIONS

Although quality indicators and quality comparison between hospitals are increasingly used in international settings, important local differences influence their application. Context should be taken into account. Since that context is locally bound and directly linked to hospital setting, caution should be used interpreting the results of quality comparison studies.

ORIGINALITY/VALUE

International quality comparison is increasingly suggested as a useful way to improve healthcare. Little is known, however, about the appropriateness and use of quality indicators in local hospital care practices.

Exploring consumer understanding and preferences for pharmacy quality information

Objective:

To describe consumer understanding of pharmacy quality measures and consumer preferences for pharmacy quality information.

Methods:

Semi-structured focus group design was combined with survey methods. Adults who filled prescription medications for self-reported chronic illnesses at community pharmacies discussed their understanding of Pharmacy Quality Alliance approved quality measures. Questions examined preference of pharmacy quality information rating systems (e.g. stars versus percentages) and desired data display/formats. During the focus group, participants completed a survey examining their understanding of each pharmacy quality measure. All focus group discussions were transcribed verbatim. Data were analyzed using thematic analysis and descriptive statistics.

Results:

Thirty-four individuals participated (mean age= 62.85; SD=16.05). Participants were unfamiliar with quality measures information and their level of understanding differed for each quality measure. Surveys indicated 94.1% understood “Drug-Drug Interactions” and “Helping Patients Get Needed Medications” better than other measures (e.g., 76.5% understood “Suboptimal Treatment of Hypertension in Patients with Diabetes”). Qualitative analysis indicated participants preferred an overall pharmacy rating for quick access and use. However, participants also wanted quality measures information displayed by health conditions. Participants favored comparison of their pharmacy to city data instead of state data. Most participants liked star ratings better than percentages, letter grades, or numerical ratings.

Conclusions:

Individuals who have a chronic illness and regularly use community pharmacies are interested in pharmacy quality measures. However, specific quality measures were not understood by some participants. Participants had specific preferences for the display of pharmacy quality information which will be helpful in the design of appropriate quality report systems.

Patients' and clinicians' views of comparing the performance of providers of surgery: a qualitative study

OBJECTIVES

Comparison of providers' outcomes is intended to encourage patient choice and stimulate clinicians to improve the quality of their services. Given that success will depend on how patients and clinicians respond, our aim was to explore their views of using outcome data to compare providers.

METHOD

Qualitative data from six focus groups with patients (n = 45) and seven meetings with surgical clinicians (n = 107) were collected during autumn 2010. Discussions audio-taped, transcribed and a thematic analysis carried out.

RESULTS

Patients and clinicians confirmed the value of making comparisons of the outcomes of providers publicly available. However, both groups harboured three principal concerns: the validity of the data; fears that the data would be misinterpreted by the media, politicians and commissioners, and the focus should not just be on providers but also on the performance of individual surgeons. In addition, patients felt that information on providers' outcomes would only ever have a limited impact on their choice because there were other important factors to be taken into account: accessibility, waiting time, the size of the provider and the quality of other aspects such as cleanliness and nursing. Also patients acknowledged the importance of friends' and relatives' experiences and that they would seek their GP's advice.

CONCLUSIONS

While comparisons of providers' outcomes should be available to patients to stimulate improvements in performance, information should be directed principally to hospital clinicians and to GPs. Impact may be enhanced by providing data on individual clinicians rather than providers. The extent to which these findings are generalizable to other areas of health care is uncertain.

Public reporting in Germany: the content of physician rating websites

BACKGROUND

Physician rating websites (PRWs) are gaining in popularity among patients seeking quality information about physicians. However, little knowledge is available about the quantity and type of information provided on the websites.

OBJECTIVE

To determine and structure the quantity and type of information about physicians in the outpatient sector provided on German-language physician rating websites.

METHODS

In a first step, we identified PRWs through a systematic internet search using German keywords from a patient´s perspective in the two search engines Google and Yahoo. Afterwards, information about physicians available on the websites was collected and categorised according to Donabedian´s structure/process/outcome model. Furthermore, we investigated whether the information was related to the physician himself/ herself or to the practice as a whole.

RESULTS

In total, eight PRWs were detected. Our analysis turned up 139 different information items on eight websites; 67 are related to the structural quality, 4 to process quality, 5 to outcomes, and 63 to patient satisfaction/experience. In total, 37% of all items focus specifically on the physician and 63% on the physician's practice. In terms of the total amount of information provided on the PRWs, results range from 61 down to 13.5 items.

CONCLUSIONS

A broad range of information is available on German PRWs. While structural information can give a detailed overview of the financial, technical and human resources of a practice, other outcome measures have to be interpreted with caution. Specifically, patient satisfaction results are not risk-adjusted, and thus, are not appropriate to represent a provider's quality of care. Consequently, neither patients nor physicians should yet use the information provided to make their final decision for or against an individual physician.

Liberalizing the health care market: the new government's ambition for the English National Health Service

England's National Health Service (NHS) faces the prospect of a radical overhaul by the current coalition government, with the aim of improving the quality and efficiency of health services. The government has identified the increased use of competition between providers as a primary lever to achieve its goals and is creating a competitive market comprising state, private, and not-for-profit providers. This market will be overseen by an independent economic regulator with powers to intervene and shape local markets for health services. While the use of market incentives is not wholly novel, if implemented, these new reforms imply a rapid expansion of the scope and scale of competitive market forces within the NHS. This article examines the government's current proposals for increased use of competition and considers its potential impact in the light of the available evidence. It argues that despite some research evidence pointing to the potentially beneficial effects of competition on quality and efficiency, there are also risks of adverse outcomes. Consequently, there is significant uncertainty as to whether this policy will deliver the desired objectives.

Choice processes and satisfaction with care according to parents of children and young adults with intellectual disability in The Netherlands

BACKGROUND

Despite the expressed desire for access to information on care providers and increased availability of this information, the use of available information falls short of expectations. We lack research on the decision-making processes and on how these processes are influenced. A study that employs "real-life" decisions is necessary.

METHODS

Our experimental study design established the effects of providing decision-support information only (services/quality indicators) and providing a combination of information and personal decision-making support (counselling/peer meetings) on the choice process and satisfaction with care.

RESULTS

These forms of support affected the choice process, but did not affect satisfaction with care. Decision-support information combined with personal decision-making support led to less frequent switching of care providers and to more satisfaction with choice information. Parents make limited use of online decision-support information, but did use decision counselling.

CONCLUSION

This population is better supported with an intensified personal approach rather than through the current generic approach using websites.

Consumers' interpretation and use of comparative information on the quality of health care: the effect of presentation approaches

BACKGROUND

Public reports about health-care quality have not been effectively used by consumers thus far. A possible explanation is inadequate presentation of the information.

OBJECTIVE

To assess which presentation features contribute to consumers' correct interpretation and effective use of comparative health-care quality information and to examine the influence of consumer characteristics.

DESIGN

Fictitious Consumer Quality Index (CQI) data on home care quality were used to construct experimental presentation formats of comparative information. These formats were selected using conjoint analysis methodology. We used multilevel regression analysis to investigate the effects of presenting bar charts and star ratings, ordering of the data, type of stars, number of stars and inclusion of a global rating.

SETTING AND PARTICIPANTS

Data were collected during 2 weeks of online questioning of 438 members of an online access panel.

RESULTS

Both presentation features and consumer characteristics (age and education) significantly affected consumers' responses. Formats using combinations of bar charts and stars, three stars, an alphabetical ordering of providers and no inclusion of a global rating supported consumers. The effects of the presentation features differed across the outcome variables.

CONCLUSIONS

Comparative information on the quality of home care is complex for consumers. Although our findings derive from an experimental situation, they provide several suggestions for optimizing the information on the Internet. More research is needed to further unravel the effects of presentation formats on consumer decision making in health care.

Consumer trust in sources of physician quality information

Trust in the source of information about physician quality is likely to be an important factor in how consumers use that information in encounters with their doctor or in decisions about choice of provider. In this article, the authors use survey data from a nationally representative sample of 8,140 individuals with chronic illness to examine variation in consumer trust in different sources of physician quality information and how market segmentation factors explain such variation. The authors find that consumers place greater trust in physicians and hospitals relative to institutional sources and personal sources. The level of trust, however, varies considerably across consumers as a function of demographic, socioeconomic, behavioral/lifestyle factors but is not related to measures of context. These results suggest that the sources of public reports comparing physician quality may be a barrier to the use of quality data by consumers in the ways envisioned by supporters of greater quality transparency.

Patients’ opinions of health care providers for supporting choice and quality improvement

Patients are increasingly using the internet to access information on health care and services, as well as writing reviews of their own experiences. With patient choice increasing in many health systems, payers, purchasers and providers are attempting to take control of this trend by designing and managing their own patient opinion websites. This essay identifies and explores three aspects of online reviews of health care: the role of patients as judges of health care quality; the motivation behind patients posting reviews; and patients’ use of such information. It then discusses how useful patient opinion websites might be in supporting patient choice in health care markets and in expanding voice channels for quality improvement.

Overview of a formal scoping review on health system report cards

Background

There is an extensive body of literature on health system quality reporting that has yet to be characterized. Scoping is a novel methodology for systematically assessing the breadth of a body of literature in a particular research area. Our objectives were to showcase the scoping review methodology in the review of health system quality reporting, and to report on the extent of the literature in this area.

Methods

A scoping review was performed based on the York methodology outlined by Arksey and O'Malley from the University of York, United Kingdom. We searched 14 peer reviewed and grey literature databases limiting the search to English language and non-English language articles with English abstracts published between 1980 and June 2006 with an update to November 2008. We also searched specific websites, reference lists, and key journals for relevant material and solicited input from key stakeholders. Inclusion/exclusion criteria were applied to select relevant material and qualitative information was charted from the selected literature.

Results

A total of 10,102 articles were identified from searching the literature databases, 821 were deemed relevant to our scoping review. An additional 401 were identified from updates, website searching, references lists, key journals, and stakeholder suggestions for a total of 1,222 included articles. These were categorized and catalogued according to the inclusion criteria, and further subcategories were identified through the charting process. Topic areas represented by this review included the effectiveness of health system report cards (n = 194 articles), methodological issues in their development (n = 815 articles), stakeholder views on report cards (n = 144 articles), and ethical considerations around their development (n = 69 articles).

Conclusions

The scoping review methodology has permitted us to characterize and catalogue the extensive body of literature pertaining to health system report cards. The resulting literature repository that our review has created can be of use to researchers and health system stakeholders interested in the topic of health system quality measurement and reporting.

How do healthcare consumers process and evaluate comparative healthcare information? A qualitative study using cognitive interviews

BACKGROUND

To date, online public healthcare reports have not been effectively used by consumers. Therefore, we qualitatively examined how healthcare consumers process and evaluate comparative healthcare information on the Internet.

METHODS

Using semi-structured cognitive interviews, interviewees (n = 20) were asked to think aloud and answer questions, as they were prompted with three Dutch web pages providing comparative healthcare information.

RESULTS

We identified twelve themes from consumers' thoughts and evaluations. These themes were categorized under four important areas of interest: (1) a response to the design; (2) a response to the information content; (3) the use of the information, and (4) the purpose of the information.

CONCLUSION

Several barriers to an effective use of comparative healthcare information were identified, such as too much information and the ambiguity of terms presented on websites. Particularly important for future research is the question of how comparative healthcare information can be integrated with alternative information, such as patient reviews on the Internet. Furthermore, the readability of quality of care concepts is an issue that needs further attention, both from websites and communication experts.

Public reporting of hospital quality: recommendations to benefit patients and hospitals

Public reporting of hospital performance holds tremendous promise for improving the care provided by hospitals. To date, however, consumers have failed to embrace public reporting, despite considerable efforts to promote it. We review a number of reasons that public reporting has failed to live up to expectations, and we make 10 recommendations to improve the value of public reporting for both patients and hospitals. We also review 3 leading performance reporting programs to evaluate how well they adhere to these recommendations.

Public reporting of nursing home quality of care: lessons from the United States experience for canadian policy discussion

While the demand for continuing care services in Canada grows, the quality of such services has come under increasing scrutiny. Consideration has been given to the use of public reporting of quality data as a mechanism to stimulate quality improvement and promote public accountability for and transparency in service quality. The recent adoption of the Resident Assessment Instrument (RAI) throughout a number of Canadian jurisdictions means that standardized quality data are available for comparisons among facilities across regions, provinces and nationally. In this paper, we explore current knowledge on public reporting in nursing homes in the United States to identify what lessons may inform policy discussion regarding potential use of public reporting in Canada. Based on these findings, we make recommendations regarding how public reporting should be progressed and managed if Canadian jurisdictions were to implement this strategy.

Quality information and fragmented markets: patient responses to hospital volume thresholds

Over the last two decades, information dissemination policies to improve patient hospital choice have emerged. But during this same period, policy makers have also generally adopted a market-oriented approach vis-à-vis hospitals, with limited regulation of facility expansion and few restrictions on hospital mergers and ownership changes. These policies may be in tension, and this analysis examines whether there have been changes over time in patient responses to information about the value of high-volume hospitals and the degree to which hospital market changes may have limited these patient responses. The results indicate modest changes consistent with an increase in quality-seeking behavior for several services for which research indicates a volume-outcome relationship. At the same time, there are services for which trends have been moving in the opposite direction--toward greater local-care seeking--and changes for the remaining services have been fairly small. Even for services with a trend toward greater patient sensitivity to volume as a marker for quality, however, hospital market changes have reduced the change over time in high-volume hospital use. These results highlight some of the limitations of market-oriented strategies for increasing patient use of high-quality hospitals.

From quasi-market to market in the National Health Service in England: What does this mean for the purchasing of health services?

The purchasing function was first developed within the British National Health Service as part of a quasi-market introduced by a Conservative government in 1990 and retained by the Labour government on coming to power in 1997. Since 2002 further reforms in England have begun to transform the quasi-market into a ‘real’ market with greater diversity of supplier, including from the private sector, a payment regime designed to reward additional hospital activity and new rights for patients to choose their provider. Evidence from the quasi-market era suggests that the purchasing function made little significant impact on services for patients or shifts in the pattern of hospital provision. The new market reforms, in theory, provide an opportunity to overcome prior weaknesses in the purchasing function. As this market develops, we suggest that the purchasers should develop three new sets of skills and activities if they are to be effective: the identification of need and shaping of demand; shaping the structure of supply; and holding the market to account.

Toward public disclosure of surgical results: experience of cardiac surgery in the United Kingdom

Public disclosure of surgical results has been implemented in recent years. This article discusses the disclosure of cardiac surgery results in the United Kingdom.

[The objective assessment of the quality of hospital care: dream or reality?]

One of the hottest topics of the international journals is the question: what is the effect of the public indicator-based quality assessment on the quality of care and on the decision of stakeholders, and which criteria should be applied for development of public quality assessment system. According to the international literature the paper discusses 6 topics: (1) the ability of indicators to distinguish providers from the point of view of quality; (2) the appropriateness of outcome indicators to assess providers; (3) the ability of league tables to rank providers; (4) the people's behaviour during choosing providers; (5) the impact of indicator-based public report; (6) recommendations for developing quality assessment system. Based on the literature review, the ability of indicators in distinguishing providers from the point of view of quality is doubtful primarily because of risk-adjustment problems. Other reasons are: the outcomes of care do not definitely refer to the quality of care process; the rankings of providers (league tables) based on more indicators are not reliable; people take into account mainly distance and the opinions of acquaintance when they choose providers; as a result of public reports the overall quality of care is declining. The publication of the results of measurement to assess providers has to be considered as a tool. For the purpose of helping people in choosing providers, the publication of patient satisfaction survey designed according to their preferences could achieve the desired effect. The quality improvement aims are definitely helped by the direct feedback to providers about the indicator values. Furthermore, much finer picture can be made if the standardized audits of care and organisational processes are inserted into external assessment procedures.

Endoscopists attitudes on the publication of "quality" data for endoscopic procedures: a cross-sectional survey

Background

Whilst the public now have access to mortality & morbidity data for cardiothoracic surgeons, such "quality" data for endoscopy are not generally available. We studied endoscopists' attitudes to and the practicality of this data being published.

Methods

We sent a questionnaire to all consultant gastrointestinal (GI) surgeons, physicians and medical GI specialist registrars in the Northern region who currently perform GI endoscopic procedures (n = 132). We recorded endoscopist demographics, experience and current data collection practice. We also assessed the acceptability and utility of nine items describing endoscopic "quality" (e.g. mortality, complication & completion rates).

Results

103 (78%) doctors responded of whom 79 were consultants (77%). 61 (59%) respondents were physicians. 77 (75%) collect any "quality" data. The most frequently collected item was colonoscopic completion rate. Data were most commonly collected for appraisal, audit or clinical governance. The majority of doctors (54%) kept these data only available to themselves, and just one allowed the public to access this. The most acceptable data item was annual number of endoscopies and the least was crude upper GI bleeding mortality. Surgeons rated information less acceptable and less useful than physicians. Acceptability and utility scores were not related to gender, length of experience or current activity levels. Only two respondents thought all items totally unacceptable and useless.

Conclusion

The majority of endoscopists currently collect "quality" data for their practice although these are not widely available. The endoscopists in this study consider the publication of their outcome data to be "fairly unacceptable/not very useful" to "neutral" (score 2–3). If these data were made available to patients, consideration must be given to both its value and its acceptability.

Regulating health care in low- and middle-income countries: Broadening the policy response in resource constrained environments

Regulation is traditionally seen as the use of bureaucratic and administrative controls by government to correct market failure. Yet traditional methods such as licensing and certification frequently fail to control behaviour because of the limited resources available to government in low- and middle-income countries, and because of the powerful countervailing incentives that encourage deviant behaviour to continue. It is increasingly being realised, therefore, that goals of policy can sometimes be achieved more efficiently by involving other actors in the regulatory mechanism. In addition, a more flexible view of regulatory tools and strategies may enable governments, particularly in resource constrained environments, to utilise a much wider range of administrative controls and market enhancing incentives. The review suggests a wide range of tools that may be utilised to encourage better behaviour. These require that governments become aware of the need to reinforce controls with enabling incentives, utilise external standards where local measures are deemed inadequate and promote greater access to information on standards and services to consumers and providers.

The California Cardiac Surgery and Intervention Project: Evolution of a Public Reporting Program

Mandatory public reporting of cardiac surgery outcomes in California was instituted in 2003. To study the impact of the program, the outcomes of coronary artery bypass graft (CABG), valve, and percutaneous coronary intervention (PCI) procedures performed after January 1, 2003 were compared with previous years using the Patient Discharge Database (PDD) of the Office of Statewide Health Planning and Development. Risk-adjusted in-hospital mortality for CABG, CABG plus valve or aneurysm, and valve procedures decreased during 2003 and 2004 compared with 1998 through 2002, and PCI mortality remained unchanged. The average annual procedural volume per hospital decreased 25 per cent (232% ± 205% to 173% ± 157%) for CABG and 18 per cent (310% ± 278% to 253% ± 235%) for all cardiac surgeries, whereas PCI increased 12 per cent (433% ± 277% to 492% ± 356%). During 2003 and 2004, less than one-half of the 120 hospitals performed 200 or more cardiac surgeries per year, and only 25 performed 300 or more. Higher CABG mortality was observed primarily in low-volume programs, but the relationship of volume to risk-adjusted mortality was not significant for any surgical group or for PCI. Identification of outlier status was facilitated by use of 30-day posthospital outcomes (death or reoperation) in addition to in-hospital mortality. This study suggests that the introduction of a mandatory cardiac surgery reporting program in California was associated with improved outcomes.

Development of an information source for patients and the public about general practice services: an action research study

OBJECTIVE

The publication of information about the performance of health-care providers is regarded as central to promoting greater accountability and empowering patients to exercise choice. The evidence suggests that the public is not very interested in accessing or using current sources of information. This study aimed to explore the information needs of patients in the context of UK primary care and to develop an information source about general practice services, designed to be usable by and useful to patients.

DESIGN

An action research study making use of data from formal and informal interviews, focus groups, participant observation and document review.

SETTING

The geographical areas covered by two Primary Care Trusts in the north of England and two Local Health Boards in south Wales.

PARTICIPANTS

A partnership between 103 members of the public, general practice staff from 19 practices, NHS managers from four Primary Care Organizations and the research team.

RESULTS

The public would like to know more about the quality and range of general practice services but current sources of information do not meet their needs. The public do not like league tables comparing the performance of practices and only a small number of people want to use comparative information to choose between practices. They seem to be more interested in the context and availability of services and the willingness of practices to improve, than in the practice's absolute or relative performance. They want to be clear about the source of the information so that they can make personal judgements about its veracity. Information is most likely to be useful if it adheres to the basic principles of cognitive science in terms of its structure, content and presentation format. Using these findings, paper and electronic prototype versions of a guide to general practice services have been developed.

CONCLUSIONS

In order to maximize the potential use of performance information by the public it is necessary to move beyond provider-led and professionally constructed approaches to information provision and ensure that the public is actively involved in the development of information sources. Such involvement produces a different kind of information to that currently available to the public. The findings of this study have important implications for policy. Most importantly, it seems that the traditional consumerist model underlying a policy of making comparative performance information available to the public to enable them to exercise choice between primary care providers may not be appropriate. An alternative model of information provision, which recognizes the public's commitment to their practice and is integrated with 'soft' sources of knowledge is more likely to engage and be of use to the public.

Is a public reporting approach appropriate for nursing home care?

Publicizing quality information has been used as a quality improvement strategy in the acute care sector for more than a decade. Despite research showing mixed results of these efforts, publicly reporting quality measures is currently being pursued as a quality improvement strategy for nursing homes. Designed to empower consumers to make informed choices and to stimulate provider competition on quality, nursing home public reporting began in 1998 with the Nursing Home Compare Web site and has received greater emphasis in the 2002 Nursing Home Quality Initiative, both directed by the federal government. Focusing on the response of three key stakeholder groups across settings of care-consumers, providers, and purchasers-I identify several challenges that nursing home reporting must overcome to be successful. I conclude that publicly reporting quality measures for nursing homes will have a harder time promoting quality improvement than for acute care settings, where results have been disappointing thus far. In addition to the conceptual analysis, I evaluate whether the quality information reported on Nursing Home Compare had any impact on nursing home occupancy rates following its release. Using a pre/post-release design, I find that the effect of public reporting on nursing home occupancy rates has been minimal thus far. Although some estimates of effect are statistically significant and in the hypothesized direction, they all suggest very small effect sizes. It is unclear whether the absence of a larger reporting effect to date is specific to Nursing Home Compare or whether it inheres to the broader task of using quality information to promote change in the nursing home care sector.

Strategies to enhance price and quality competition in health care: lessons learned from tracking local markets

Drawing on observations from tracking changes in local health care markets over the past ten years, this article critiques two Federal Trade Commission and Department of Justice recommendations to enhance price and quality competition. First, we take issue with the notion that consumers, acting independently, will drive greater competition in health care markets. Rather we suggest an important role remains for trusted agents who can analyze inherently complex price and quality information and negotiate on consumers' behalf. With aggregated information identifying providers who deliver cost-effective care, consumers would be better positioned to respond to financial incentives about where to seek care and thereby drive more meaningful competition among providers to reduce costs and improve quality. Second, we take issue with the FTC/DOJ recommendation to provide more direct subsidies to prevent distortions in competition. In the current political environment, it is not practical to provide direct subsidies for all of the unfunded care that exists in health care markets today; instead, some interference with competition may be necessary to protect cross subsidies. Barriers can be reduced, though, by revising pricing policies that have resulted in marked disparities in the relative profitability of different services.

What are ‘third way’ governments learning? Health care consumers and quality in England and Germany

This paper examines how consumer information is related to attempts to improve quality of healthcare in England and Germany, both being non-market systems. The paper traces the changes in policy between the first and second electoral terms of the respective 'third way' governments. Both systems are attempting to give consumers more information. But the question is how that information can be used. A degree of convergence can be observed concerning the amount of choice permitted to consumers. In the case of England, the amount of choice consumers have is gradually increasing, while in Germany, attempts are being made to restrict the wide choice of providers in order to cap expenditure.