National quality monitoring of Medicare health plans: the relationship between enrollees' reports and the quality of clinical care

BACKGROUND

The clinical quality of health plans varies. The associations between different measures of health plan quality are incompletely understood.

OBJECTIVE

To assess the relationships between enrollee reports on the quality of health plans as measured by the Consumer Assessment of Health Plans Study (CAHPS 2.0) survey and the clinical quality of care measured by the Medicare Health Plan Employer Data and Information Set (HEDIS).

DESIGN

Observational cohort study.

SAMPLE

National sample of 233 Medicare health plans that reported data using the CAHPS 2.0 survey and Medicare HEDIS during 1998.

MEASURES

Five composite measures and four ratings derived from the CAHPS survey and six measures of clinical quality from Medicare HEDIS.

RESULTS

Two composite measures ("getting needed care" and "health plan information and customer service") were significantly associated with most of the HEDIS clinical quality measures. The proportion of enrollees having a personal doctor was also significantly associated with rates of mammography, eye exams for diabetics, beta-blocker use after myocardial infarction, and follow-up after mental health hospitalization. Enrollees' ratings of health plan care were less consistently associated with HEDIS performance. In multivariable analyses, the measure of health plan communication ("health plan information and customer service") was the most consistent predictor of HEDIS performance.

CONCLUSIONS

The pattern of associations we observed among some of the measures suggests that the CAHPS survey and HEDIS are complementary quality monitoring strategies. Our results suggest that health plans that provide better access and customer service also provide better clinical care.

Racial disparity in influenza vaccination: does managed care narrow the gap between African Americans and whites?

CONTEXT

Substantial racial disparities exist in use of some health services. Whether managed care could reduce racial disparities in the use of preventive services is not known.

OBJECTIVE

To determine whether the magnitude of racial disparity in influenza vaccination is smaller among managed care enrollees than among those with fee-for-service insurance.

DESIGN, SETTING, AND PARTICIPANTS

The 1996 Medicare Current Beneficiary Survey of a US cohort of 13 674 African American and white Medicare beneficiaries with managed care and fee-for-service insurance.

MAIN OUTCOME MEASURES

Percentage of respondents (adjusted for sociodemographic characteristics, clinical comorbid conditions, and care-seeking attitudes) who received influenza vaccination and magnitude of racial disparity in influenza vaccination, compared among those with managed care and fee-for-service insurance.

RESULTS

Eight percent of the beneficiaries were African American and 11% were enrolled in managed care. Overall, 65.8% received influenza vaccination. Whites were substantially more likely to be vaccinated than African Americans (67.7% vs 46.1%; absolute disparity, 21.6%; 95% confidence interval [CI], 18.2%-25.0%). Managed care enrollees were more likely than those with fee-for-service insurance to receive influenza vaccination (71.2% vs 65.4%; difference, 5.8%; 95% CI, 3.6%-8.3%). The adjusted racial disparity in fee-for-service was 24.9% (95% CI, 19.6%-30.1%) and in managed care was 18.6% (95% CI, 9.8%-27.4%). These adjusted racial disparities were both statistically significant, but the absolute percentage point difference in racial disparity between the 2 insurance groups (6.3%; 95% CI, -4.6% to 17.2%) was not.

CONCLUSION

Managed care is associated with higher rates of influenza vaccination for both whites and African Americans, but racial disparity in vaccination is not reduced in managed care. Our results suggest that additional efforts are needed to adequately address this disparity.

Racial differences in cardiac revascularization rates: does "overuse" explain higher rates among white patients?

BACKGROUND

Coronary artery bypass graft (CABG) surgery and percutaneous transluminal coronary angioplasty (PTCA) are well-established treatments for symptomatic coronary artery disease. Previous studies have documented racial differences in rates of use of these cardiac revascularization procedures. Other studies suggest that these procedures are overused: that is, they are done for patients with clinically inappropriate indications.

OBJECTIVE

To test the hypothesis that the higher rate of cardiac revascularization among white patients is associated with a higher prevalence of overuse (revascularization for clinically inappropriate indications) among white patients than among African-American patients.

DESIGN

Observational cohort study using Medicare claims and medical record review.

SETTING

173 hospitals in five U.S. states.

PARTICIPANTS

A stratified, weighted, random sample of 3960 Medicare beneficiaries who underwent coronary angiography during 1991 and 1992; 1692 of these patients underwent 1711 revascularization procedures within 90 days.

MEASUREMENTS

The proportion of CABG and PTCA procedures rated appropriate, uncertain, and inappropriate according to RAND criteria, and the multivariate odds of undergoing inappropriate revascularization among African-American patients and white patients.

RESULTS

After angiography, rates of PTCA (23% vs. 19%) and CABG surgery (29% vs. 17%) were significantly higher among white patients than among African-American patients. The respective rates of inappropriate PTCA and CABG surgery were 14% and 10%. Among the study states, rates of inappropriate use ranged from 4% to 24% for PTCA and 0% to 14% for CABG surgery. White patients were more likely than African-American patients to receive inappropriate PTCA (15% vs. 9%; difference, 6 percentage points [95% CI, -0.4 to 12.7 percentage points]), and difference by race was statistically significant among men (20% vs. 8%; difference, 12 percentage points [CI, 1.2 to 21.7 percentage points]). Rates of inappropriate CABG surgery did not differ by race (10% in both groups).

CONCLUSIONS

Among a large and diverse sample of Medicare beneficiaries in five U.S. states, overuse of PTCA was greater among white men than among other groups, but this difference did not fully account for racial disparities in revascularization. Overuse of cardiac revascularization varied significantly by geographic region.

Publicly disclosed information about the quality of health care: response of the US public

Public disclosure of information about the quality of health plans, hospitals, and doctors continues to be controversial. The US experience of the past decade suggests that sophisticated quality measures and reporting systems that disclose information on quality have improved the process and outcomes of care in limited ways in some settings, but these efforts have not led to the "consumer choice" market envisaged. Important reasons for this failure include limited salience of objective measures to consumers, the complexity of the task of interpretation, and insufficient use of quality results by organised purchasers and insurers to inform contracting and pricing decisions. Nevertheless, public disclosure may motivate quality managers and providers to undertake changes that improve the delivery of care. Efforts to measure and report information about quality should remain public, but may be most effective if they are targeted to the needs of institutional and individual providers of care.

Unmet health needs of uninsured adults in the United States

CONTEXT

In 1998, 33 million US adults aged 18 to 64 years lacked health insurance. Determining the unmet health needs of this population may aid efforts to improve access to care.

OBJECTIVE

To compare nationally representative estimates of the unmet health needs of uninsured and insured adults, particularly among persons with major health risks.

DESIGN AND SETTING

Random household telephone survey conducted in all 50 states and the District of Columbia through the Behavioral Risk Factor Surveillance System.

PARTICIPANTS

A total of 105,764 adults aged 18 to 64 years in 1997 and 117,364 in 1998, classified as long-term (>/=1 year) uninsured (9.7%), short-term (<1 year) uninsured (4.3%), or insured (86.0%).

MAIN OUTCOME MEASURES

Adjusted proportions of participants who could not see a physician when needed due to cost in the past year, had not had a routine checkup within 2 years, and had not received clinically indicated preventive services, compared by insurance status.

RESULTS

Long-term- and short-term-uninsured adults were more likely than insured adults to report that they could not see a physician when needed due to cost (26.8%, 21.7%, and 8.2%, respectively), especially among those in poor health (69.1%, 51.9%, and 21.8%) or fair health (48.8%, 42.4%, and 15.7%) (P<.001). Long-term-uninsured adults in general were much more likely than short-term-uninsured and insured adults not to have had a routine checkup in the last 2 years (42.8%, 22.3%, and 17.8%, respectively) and among smokers, obese individuals, binge drinkers, and people with hypertension, elevated cholesterol, diabetes, or human immunodeficiency virus risk factors (P<.001). Deficits in cancer screening, cardiovascular risk reduction, and diabetes care were most pronounced among long-term-uninsured adults.

CONCLUSIONS

In our study, long-term-uninsured adults reported much greater unmet health needs than insured adults. Providing insurance to improve access to care for long-term-uninsured adults, particularly those with major health risks, could have substantial clinical benefits. JAMA. 2000;284:2061-2069

Impact of sociodemographic case mix on the HEDIS measures of health plan quality

BACKGROUND

The widely used Health Plan Employer Data and Information Set (HEDIS) measures may be affected by differences among plans in sociodemographic characteristics of members.

OBJECTIVE

The objective of this study was to estimate effects of geographically linked patient sociodemographic characteristics on differential performance within and among plans on HEDIS measures.

RESEARCH DESIGN

Using logistic regression, we modeled associations between age, sex, and residential area characteristics of health plan members and results on HEDIS measures. We then calculated the impact of adjusting for these associations on plan-level measures.

SUBJECTS

This study included 92,232 commercially insured members with individual-level HEDIS data and an additional 20,615 members whose geographic distribution was provided.

MEASURES

This study used 7 measures of screening and preventive services.

RESULTS

Performance was negatively associated with percent receiving public assistance in the local area (6 of 7 measures), percent black (5 measures), and percent Hispanic (2 measures) and positively associated with percent college educated (6 measures), percent urban (2 measures), and percent Asian (1 measure) after controlling for plan and product type. These effects were generally consistent across plans. When measures were adjusted for these characteristics, rates for most plans changed by less than 5 percentage points. The largest change in the difference between plans ranged from 1.5% for retinal exams for people with diabetes to 20.2% for immunization of adolescents.

CONCLUSIONS

Performance on quality indicators for individual members is associated with sociodemographic context. Adjustment has little impact on the measured performance of most plans but a substantial impact on a few. Further study with more plans is required to determine the appropriateness and feasibility of adjustment.

The relationship between managed care insurance and use of lower-mortality hospitals for CABG surgery

CONTEXT

Explicit information about the quality of coronary artery bypass graft (CABG) surgery has been available for nearly a decade in New York State; however, the extent to which managed care insurance plans direct enrollees to the lowest-mortality CABG surgery hospitals remains unknown.

OBJECTIVE

To compare the proportion of patients with managed care insurance and fee-for-service (FFS) insurance who undergo CABG surgery at lower-mortality hospitals.

DESIGN

A retrospective cohort study of CABG surgery discharges from 1993 to 1996, using New York Department of Health databases and multivariate analysis to estimate the use of lower-mortality hospitals by patients with different types of health insurance.

SETTING

Cardiac surgical centers in New York, of which 14 were classified as lower-mortality hospitals (mean rate, 2.1%) and 17 were classified as higher-mortality hospitals (mean rate, 3.2%).

PATIENTS

A total of 58,902 adults older than 17 years who were hospitalized for CABG surgery. Patients were excluded if their CABG surgery was combined with any valve procedure or left ventricular aneurysm resection or if they were younger than 65 years and enrolled in Medicare FFS or Medicare managed care.

MAIN OUTCOME MEASURE

Probability of a patient receiving CABG surgery at a lower-mortality hospital.

RESULTS

Compared with patients with private FFS insurance (n = 18,905), patients with private managed care insurance (n=7169) and Medicare managed care insurance (n=880) were less likely to receive CABG surgery at a lower-mortality hospital (relative risk [RR] of surgery at a lower-mortality hospital compared with patients with private FFS insurance, 0.77; 95% confidence interval [CI], 0.74-0.81; P<.001; and RR, 0.61; 95% CI, 0.54-0.70; P<.001, respectively, after controlling for multiple potential confounding factors). Patients with Medicare FFS insurance used lower-mortality hospitals at rates more similar to those with private FFS insurance (n = 31,948; RR, 0.95; 95% CI, 0.91-0.98; P=.004).

CONCLUSIONS

Patients in New York State with private managed care and Medicare managed care insurance were significantly less likely to use lower-mortality hospitals for CABG surgery compared with patients with private FFS insurance.

Enhancing performance measurement: NCQA's road map for a health information framework. National Committee for Quality Assurance

Measuring the quality of health care delivery is one of the most critical challenges facing US health care. Performance measurement can be used to track the quality of care that health plans and medical groups deliver, but effective performance measurement requires timely access to detailed and accurate data. In 1996, the National Committee for Quality Assurance (NCQA) commissioned a report to learn what actions would improve health plans' capacity to electronically report performance data for the Health Plan Employer Data and Information Set (HEDIS). Tracking clinical performance will require not just clinical data stored in information systems, but an integrated health information framework. Seven features are essential to this framework: (1) it specifies data elements; (2) it establishes linkage capability among data elements and records; (3) it standardizes the element definitions; (4) it is automated to the greatest possible extent; (5) it specifies procedures for continually assessing data quality; (6) it maintains strict controls for protecting security and confidentiality of the data; and (7) it specifies protocols for sharing data across institutions under appropriate and well-defined circumstances. Health plans should anticipate the use of computerized patient records and prepare their data management for an information framework by (1) expanding and improving the capture and use of currently available data; (2) creating an environment that rewards the automation of data; (3) improving the quality of currently automated data; (4) implementing national standards; (5) improving clinical data management practices; (6) establishing a clear commitment to protecting the confidentiality of enrollee information; and (7) careful capital planning. Health care purchasers can provide the impetus for implementing the information framework if they demand detailed, accurate data on the quality of care.

Use of public performance reports: a survey of patients undergoing cardiac surgery

CONTEXT

Publicly released performance reports ("report cards") are expected to foster competition on the basis of quality. Proponents frequently cite the need to inform patient choice of physicians and hospitals as a central element of this strategy.

OBJECTIVE

To examine the awareness and use of a statewide consumer guide that provides risk-adjusted, in-hospital mortality ratings of hospitals that provide cardiac surgery.

DESIGN

Telephone survey conducted in 1996.

SETTING

Pennsylvania, where since 1992, the Pennsylvania Consumer Guide to Coronary Artery Bypass Graft [CABG] Surgery has provided risk-adjusted mortality ratings of all cardiac surgeons and hospitals in the state.

PARTICIPANTS

A total of 474 (70%) of 673 eligible patients who had undergone CABG surgery during the previous year at 1 of 4 hospitals listed in the Consumer Guide as having average mortality rates between 1% and 5% were successfully contacted.

MAIN OUTCOME MEASURES

Patients' awareness of the Consumer Guide, their knowledge of its ratings, their degree of interest in the report, and barriers to its use.

RESULTS

Ninety-three patients (20%) were aware of the Consumer Guide, but only 56 (12%) knew about it before surgery. Among these 56 patients, 18 reported knowing the hospital rating and 7 reported knowing the surgeon rating, 11 said hospital and/or surgeon ratings had a moderate or major impact on their decision making, but only 4 were able to specify either or both correctly. When the Consumer Guide was described to all patients, 264 (56%) were "very" or "somewhat" interested in seeing a copy, and 273 (58%) reported that they probably or definitely would change surgeons if they learned that their surgeon had a higher than expected mortality rate in the previous year. A short time window for decision making and a limited awareness of alternative hospitals within a reasonable distance of home were identified as important barriers to use.

CONCLUSIONS

Only 12% of patients surveyed reported awareness of a prominent report on cardiac surgery mortality before undergoing cardiac surgery. Fewer than 1% knew the correct rating of their surgeon or hospital and reported that it had a moderate or major impact on their selection of provider. Efforts to aid patient decision making with performance reports are unlikely to succeed without a tailored and intensive program for dissemination and patient education.

Strategies and methods for aligning current and best medical practices. The role of information technologies

Rapid change in American medicine requires that physicians adjust established behaviors and acquire new skills. In this article, we address three questions: What do we know about how to change physicians' practices? How can physicians take advantage of new and evolving information technologies that are likely to have an impact on the future practice of medicine? and What strategic educational interventions will best enable physicians to show competencies in information management and readiness to change practice? We outline four guiding principles for incorporating information systems tools into both medical education and practice, and we make eight recommendations for the development of a new medical school curriculum. This curriculum will produce a future medical practitioner who is capable of using information technologies to systematically measure practice performance, appropriateness, and effectiveness while updating knowledge efficiently.

Influence of cardiac-surgery performance reports on referral practices and access to care. A survey of cardiovascular specialists

BACKGROUND

Reports on the comparative performance of physicians are becoming increasingly common. Little is known, however, about the credibility of these reports with target audiences or their influence on the delivery of medical services.

METHODS

Since 1992, Pennsylvania has published the Consumer Guide to Coronary Artery Bypass Graft Surgery, which lists annual risk-adjusted mortality rates for all hospitals and surgeons providing such surgery in the state. In 1995, we surveyed a randomly selected sample of 50 percent of Pennsylvania cardiologists and cardiac surgeons to find out whether they were aware of the guide and, if so, to determine their views on its usefulness, limitations, and influence on providers.

RESULTS

Eighty-two percent of the cardiologists and all the cardiac surgeons were aware of the guide. Only 10 percent of these respondents reported that its mortality rates were "very important" in assessing the performance of a cardiothoracic surgeon. Less than 10 percent reported discussing the guide with more than 10 percent of their patients who were candidates for a coronary-artery bypass graft (CABG). Eighty-seven percent of the cardiologists reported that the guide had a minimal influence or none on their referral recommendations. For both groups, the most important limitations of the guide were the absence of indicators of quality other than mortality (cited by 78 percent), inadequate risk adjustment (79 percent), and the unreliability of data provided by hospitals and surgeons (53 percent). Fifty-nine percent of the cardiologists reported increased difficulty in finding surgeons willing to perform CABG surgery in severely ill patients who required it, and 63 percent of the cardiac surgeons reported that they were less willing to operate on such patients.

CONCLUSIONS

The Consumer Guide to Coronary Artery Bypass Graft Surgery has limited credibility among cardiovascular specialists. It has little influence on referral recommendations and may introduce a barrier to care for severely ill patients. If publicly released performance reports are intended to guide the choice of providers without impeding access to medical care, a collaborative process involving physicians may enhance the credibility and usefulness of the reports.