Balancing participation and expertise: a comparison of locally and centrally managed health care quality improvement within primary care practices

In a longitudinal qualitative study, the authors evaluated two health care quality improvement (QI) methods that emphasized either participation (local approach) or expertise (central approach). They followed teams using these approaches to develop depression care QI programs for primary care practices over several years, observing their processes and outcomes and learning about participants' perceptions, beliefs, and experiences. Concordant with the literature, most participants preferred the local approach, but some were willing to relinquish some decision making to experts. Participants identified unique advantages of both the local (e.g., maximizes buy-in and local fit) and central (e.g., maximizes efficiency, reduces burden) approaches. The authors propose a hybrid model in which experts make strategic decisions about what practices to adopt and local site personal make tactical decisions about implementation. They believe that balancing participation and expertise provides the best formula for producing lasting QI for health care organizations across a wide variety of circumstances.

The effect of adherence to practice guidelines on depression outcomes

BACKGROUND

Few studies have assessed clinician adherence to depression practice guidelines and the relationship between clinician adherence and depression outcomes.

OBJECTIVE

To estimate how frequently specific guideline recommendations are followed and to assess whether following guideline recommendations is linked to improved depression outcomes.

DESIGN

Observational analysis of data collected from 1996 to 1998 in 3 randomized clinical trials.

SETTING

45 primary care practices in 13 U.S. states.

PATIENTS

1131 primary care patients with depression.

MEASUREMENTS

Expert panel methods were used to develop a patient survey-based index that measured adherence to clinical practice guidelines on depression. Rates of adherence to the 20 indicators that form the index were evaluated. Multivariable regression that controlled for case mix was used to assess how index scores predicted continuous and dichotomous depression measures at 12, 18, and 24 months.

RESULTS

Quality of care was high (clinician adherence > or =79%) for 6 indicators, including primary care clinician detection of depression. Quality of care was low (adherence, 20% to 38%) for 8 indicators, including management of suicide risk (3 indicators), alcohol abuse (2 indicators), and elderly patients; assessment of symptoms and history of depression; and treatment adjustment for patients who did not respond to initial treatment. Greater adherence to practice guidelines significantly predicted fewer depressive symptoms on continuous measures (P < 0.001 for 12 months, P < 0.01 for 18 months, and P < 0.001 for 24 months) and dichotomous measures (P < 0.05 for 18 and 24 months).

LIMITATIONS

Data are based on patient self-report. Possible changes in practice since 1998 may limit the generalizability of the findings.

CONCLUSIONS

Adherence to guidelines was high for one third of the recommendations that were measured but was very low for nearly half of the measures, pointing to specific needs for quality improvement. Guideline-concordant depression care appears to be linked to improved outcomes in primary care patients with depression.

Predicting outcomes of primary care patients with major depression: development of a depression prognosis index

OBJECTIVE

Depression research and practice focus increasingly on diverse patient populations with varying probabilities of response to clinical care. Prognostic indices use preexisting patient characteristics to estimate the probability of subsequent negative clinical outcomes and are useful tools for improving the study and care of diverse populations. Few such measures, however, have been developed for mental health conditions. This study developed and validated a depression prognosis measure for primary care patients with major depression.

METHODS

Consecutive patients in 108 primary care practices were screened for depression, and 1,471 with major depression were enrolled. A Depression Prognosis Index (DPI) predicting persistent depression six months after baseline was developed for a random one-third subsample and validated with the remaining two-thirds. Models included prior treatment, demographic characteristics, comorbidities, and other physical, psychological, and social predictors.

RESULTS

Sixty-four percent to 65% of patients classified by baseline DPI score as being in the sample quartile with the worst prognosis had probable major depression six months later, compared with 14% to 15% in the best-prognosis quartile. The DPI had an R2 of .40 in the development sample and .27 in the validation sample. Important predictors included severity of depression symptoms at baseline, social support, common physical symptoms, and having completed three months of antidepressants at sample entry.

CONCLUSIONS

The ability of the DPI to predict six-month outcomes compares favorably to that of prognostic indices for general medical problems. These results validate the DPI and provide conceptual guidance for further development of depression risk stratification instruments for clinical and research use.

Prevalence of depression-PTSD comorbidity: implications for clinical practice guidelines and primary care-based interventions

BACKGROUND

Compared to those with depression alone, depressed patients with posttraumatic stress disorder (PTSD) experience more severe psychiatric symptomatology and factors that complicate treatment.

OBJECTIVE

To estimate PTSD prevalence among depressed military veteran primary care patients and compare demographic/illness characteristics of PTSD screen-positive depressed patients (MDD-PTSD+) to those with depression alone (MDD).

DESIGN

Cross-sectional comparison of MDD patients versus MDD-PTSD+ patients.

PARTICIPANTS

Six hundred seventy-seven randomly sampled depressed patients with at least 1 primary care visit in the previous 12 months. Participants composed the baseline sample of a group randomized trial of collaborative care for depression in 10 VA primary care practices in 5 states.

MEASUREMENTS

The Patient Health Questionnaire-9 assessed MDD. Probable PTSD was defined as a Primary Care PTSD Screen > or = 3. Regression-based techniques compared MDD and MDD-PTSD+ patients on demographic/illness characteristics.

RESULTS

Thirty-six percent of depressed patients screened positive for PTSD. Adjusting for sociodemographic differences and physical illness comorbidity, MDD-PTSD+ patients reported more severe depression (P < .001), lower social support (P < .001), more frequent outpatient health care visits (P < .001), and were more likely to report suicidal ideation (P < .001) than MDD patients. No differences were observed in alcohol consumption, self-reported general health, and physical illness comorbidity.

CONCLUSIONS

PTSD is more common among depressed primary care patients than previously thought. Comorbid PTSD among depressed patients is associated with increased illness burden, poorer prognosis, and delayed response to depression treatment. Providers should consider recommending psychotherapeutic interventions for depressed patients with PTSD.

Teaching systems-based practice to primary care physicians to foster routine implementation of evidence-based depression care

Although health care organizations seeking to improve quality often must change the system for delivering care, there is little available evidence on how to educate staff and providers about this change. As part of a 2002-2003 Veterans Health Administration multisite project using collaborative care to improve the management of depression, the authors implemented the Translating Initiatives for Depression into Effective Solutions (TIDES) program. Five steps were followed for teaching systems-based practice: (1) determine providers' educational needs (through administrative data, expert opinion, and provider discussion), (2) develop educational materials (based on needs assessed), (3) help each of seven sites develop an educational intervention, (4) implement the intervention, and (5) monitor the intervention's effectiveness. Sites relied primarily on passive educational strategies. There was variable implementation of the different components (e.g., lecture, educational outreach). No site chose to write up its education plan, as was suggested. The authors thus suggest that the educational model was successful at identifying providers' needs and creating appropriate materials, because the program was not advertised in other ways and because almost all providers referred patients to the program. However, the educational model was only partially successful at getting sites to develop and implement an educational plan, although provider behavior did change. Overall, the program was somewhat effective at teaching systems-based practice. The authors believe the best way to enhance effectiveness is to build education into the system rather than rely on a separate system for education.

Impacts of evidence-based quality improvement on depression in primary care: a randomized experiment

CONTEXT

Previous studies testing continuous quality improvement (CQI) for depression showed no effects. Methods for practices to self-improve depression care performance are needed. We assessed the impacts of evidence-based quality improvement (EBQI), a modification of CQI, as carried out by 2 different health care systems, and collected qualitative data on the design and implementation process.

OBJECTIVE

Evaluate impacts of EBQI on practice-wide depression care and outcomes.

DESIGN

Practice-level randomized experiment comparing EBQI with usual care.

SETTING

Six Kaiser Permanente of Northern California and 3 Veterans Administration primary care practices randomly assigned to EBQI teams (6 practices) or usual care (3 practices). Practices included 245 primary care clinicians and 250,000 patients.

INTERVENTION

Researchers assisted system senior leaders to identify priorities for EBQI teams; initiated the manual-based EBQI process; and provided references and tools. EVALUATION PARTICIPANTS: Five hundred and sixty-seven representative patients with major depression.

MAIN OUTCOME MEASURES

Appropriate treatment, depression, functional status, and satisfaction.

RESULTS

Depressed patients in EBQI practices showed a trend toward more appropriate treatment compared with those in usual care (46.0% vs 39.9% at 6 months, P = .07), but no significant improvement in 12-month depression symptom outcomes (27.0% vs 36.1% poor depression outcome, P = .18). Social functioning improved significantly (mean score 65.0 vs 56.8 at 12 months, P = .02); physical functioning did not.

CONCLUSION

Evidence-based quality improvement had perceptible, but modest, effects on practice performance for patients with depression. The modest improvements, along with qualitative data, identify potential future directions for improving CQI research and practice.

Measuring the quality of colorectal cancer screening: the importance of follow-up

PURPOSE

As evidence mounts for effectiveness, an increasing proportion of the United States population undergoes colorectal cancer screening. However, relatively little is known about rates of follow-up after abnormal results from initial screening tests. This study examines patterns of colorectal cancer screening and follow-up within the nation's largest integrated health care system: the Veterans Health Administration.

METHODS

We obtained information about patients who received colorectal cancer screening in the Veterans Health Administration from an existing quality improvement program and from the Veterans Health Administration's electronic medical record. Linking these data, we analyzed receipt of screening and follow-up testing after a positive fecal occult blood test.

RESULTS

A total of 39,870 patients met criteria for colorectal cancer screening; of these 61 percent were screened. Screening was more likely in patients aged 70 to 80 years than in those younger or older. Female gender (relative risk, 0.92; 95 percent confidence interval, 0.9-0.95), Black race (relative risk, 0.92; 95 percent confidence interval, 0.89-0.96), lower income, and infrequent primary care visits were associated with lower likelihood of screening. Of those patients with a positive fecal occult blood test (n = 313), 59 percent received a follow-up barium enema or colonoscopy. Patient-level factors did not predict receipt of a follow-up test.

CONCLUSIONS

The Veterans Health Administration rates for colorectal cancer screening are significantly higher than the national average. However, 41 percent of patients with positive fecal occult blood tests failed to receive follow-up testing. Efforts to measure the quality of colorectal cancer screening programs should focus on the entire diagnostic process.

Primary care patients' involvement in decision-making is associated with improvement in depression

BACKGROUND

Depression is undertreated in primary care settings. Little research investigates the impact of patient involvement in decisions on guideline-concordant treatment and depression outcomes.

OBJECTIVE

The objective of this study was to determine whether patient involvement in decision-making is associated with guideline-concordant care and improvement in depression symptoms.

DESIGN

Prospective cohort study.

SETTING

Multisite, nationwide randomized clinical trial of quality improvement strategies for depression in primary care.

SUBJECTS

Primary care patients with current symptoms and probable depressive disorder.

MEASUREMENTS

Patients rated their involvement in decision-making (IDM) about their care on a 5-point scale from poor to excellent 6 months after entry into the study. Depressive symptoms were measured every 6 months for 2 years using a modified version of the Center for Epidemiologic Studies-Depression (CES-D) scale. We examined probabilities (Pr) of receipt of guideline-concordant care and resolution of depression across IDM groups using multivariate logistic regression models controlling for patient and provider factors.

RESULTS

For each 1-point increase in IDM ratings, the probability of patients' report of receiving guideline-concordant care increased 4% to 5% (adjusted Pr 0.31 vs. 0.50 for the lowest and highest IDM ratings, respectively, P < 0.001). Similarly, for each 1-point increase in IDM ratings, the probability of depression resolution increased 2% to 3% (adjusted Pr 0.10 vs. 0.19 for the lowest and highest IDM ratings respectively, P = 0.004).

CONCLUSIONS

Depressed patients with higher ratings of involvement in medical decisions have a higher probability of receiving guideline-concordant care and improving their symptoms over an 18-month period. Interventions to increase patient involvement in decision-making may be an important means of improving care for and outcomes of depression.

Assessing the institutional approach to implementing smoking cessation practice guidelines in veterans health administration facilities

National smoking cessation guidelines include recommended strategies for providers and health care organizations, but they offer little guidance on how to structure care. We conducted a cross-sectional survey at 40 Veterans Health Administration facilities, to describe the structure of smoking cessation care, to assess adherence to national guidelines, and to assess facilities' preferred approach to providing smoking cessation treatment. We categorized sites as those using a primary care approach (most smokers treated by the primary care provider) versus a specialty approach (medication restricted to smoking cessation clinics, to which most patients were referred). Nearly all sites reported systematic screening for smoking and counseling of smokers, usually by both nursing staff members and the primary care provider. Most sites used a specialty approach, restricting medication access to smokers attending a cessation program. Future research should evaluate whether this approach provides adequate access and responsiveness to patient preferences for the full population of smokers in primary care.

Strategies for promoting organizational and practice change by advancing implementation research

BACKGROUND

The persistence of a large quality gap between what we know about how to produce high quality clinical care and what the public receives has prompted interest in developing more effective methods to get evidence into practice. Implementation research aims to supply such methods.

PURPOSE

This article proposes a set of recommendations aimed at establishing a common understanding of what implementation research is, and how to foster its development.

METHODS

We developed the recommendations in the context of a translation research conference hosted by the VA for VA and non-VA health services researchers.

IMPACTS

Health care organizations, journals, researchers and academic institutions can use these recommendations to advance the field of implementation science and thus increase the impact of clinical and health services research on the health and health care of the public.

Determinants of physician unwillingness to offer medical abortion using mifepristone

PURPOSE

We sought to identify factors associated with contemplating versus not contemplating offering medical abortion with mifepristone among physicians not opposed to it.

METHODS

We analyzed data from a Kaiser Family Foundation survey of a nationally representative sample of 790 American obstetrician/gynecologists and primary care physicians. Our study sample consisted of 419 physicians who were not personally opposed to medical abortion and could be classified as not actively considering (precontemplation) or actively considering (contemplation) offering mifepristone. We conducted multivariate logistic regression to predict being unlikely to offer mifepristone (i.e., in the precontemplation stage of change).

PRINCIPAL FINDINGS

In 2001, 1 year after U.S. Food and Drug Administration (FDA) approval, 5% of physicians surveyed were offering mifepristone. Among the 750 physicians not offering mifepristone, 57% were not opposed. Of those not opposed, 74% reported that they were unlikely to offer mifepristone in the next year (precontemplation) as compared to 23% who might offer it (contemplation). Independent predictors of being in the precontemplation stage were being a primary care versus OB/GYN physician (odds ratio [OR] 3.29, p = .02), being in private versus hospital-based practice (OR 2.40, p = .03), and lacking concerns about FDA regulations (OR 2.06, p = .01) or violence and protests (OR 1.93, p = .03) as barriers to offering mifepristone.

CONCLUSIONS

For precontemplation-stage physicians, the most efficient strategy for increasing the availability of medical abortion may be to design programs that emphasize clinical benefits and feasibility to stimulate interest in the procedure. For contemplation-stage physicians, the optimum approach may be one that helps to overcome barriers associated with FDA regulations and concerns about violence and protests.

Improving detection of suicidal ideation among depressed patients in primary care

PURPOSE

Primary care clinicians have difficulty detecting suicidal patients. This report evaluates the effect of 2 primary care interventions on the detection and subsequent referral or treatment of patients with depression and recent suicidal ideation.

METHODS

Adult patients in 12 mixed-payer primary care practices and 9 not-for-profit staff model health maintenance organization (HMO) practices were screened for depression. Matched practices were randomized within plan type to intervention or usual care. The intervention for mixed-payer practices entailed brief training of physicians and office nurses to provide care management. The intervention for HMO practices consisted of guided development of quality improvement teams for depression care. A total of 880 enrolled patients met study criteria for depression, 232 of whom met criteria for recent suicidal ideation. Intervention effects on suicide detection and referral to mental health specialty care were evaluated with mixed-effects multilevel models in intent-to-treat analyses.

RESULTS

Depressed patients with recent suicidal ideation were detected on 40.7% of index visits in intervention practices, compared with 20.5% in usual care practices (odds ratio = 2.64, 95% confidence interval, 1.45-5.07), with HMO plan type and male sex associated with detection. The interventions had no effect on referral of patients, starting an antidepressant, or suicidal ideation reported at a 6-month follow-up, although power was limited for all 3 analyses.

CONCLUSIONS

Primary care interventions to improve depression care can improve detection of recent suicidal ideation. Further work is needed to improve physician response to detection, including referral to specialty care and more aggressive treatment, and to observe the effect on outcomes.

Smokers' interest in quitting and services received: using practice information to plan quality improvement and policy for smoking cessation

Given the prevalence of smoking, its impact, and the benefits of cessation, helping smokers quit should be a top priority for health care organizations. To restructure health care delivery and guide future policy, the authors used baseline survey data from an 18-site Veterans Health Administration group randomized trial to assess the level of interest in quitting smoking for a practice population and determine what smoking cessation services they reported receiving. Among 1941 current smokers, 55% did not intend to quit in the next 6 months, and the remainder intended to quit in the next month (13%) to 6 months (32%). Forty-five percent reported a quit attempt in the prior year. While nearly two thirds of smokers reported being counseled about cessation within the past year, only 29% were referred to a cessation program, and 25% received a prescription for nicotine patches. Tobacco control efforts within this population should focus on increasing the rate of assisting patients with quitting.

Comparing strategies for United States veterans' mortality ascertainment

Background

We aimed to determine optimal strategies for complete mortality ascertainment comparing death certificates and United States (US) Veterans Administration (VA) records.

Methods

We constructed a cohort of California veterans who died in fiscal year (FY) 2000 and used VA services the year before death. We determined decedent status using California death certificates linked to VA utilization data and the VA Beneficiary Identification and Records Locator System (BIRLS) death file. We compared the characteristics of decedents who would not have been identified by either single source (e.g., VA BIRLS alone or California death certificates alone) with the rest of the cohort.

Results

A total of 8,813 veteran decedents were identified from both VA decedent files and death certificates. Of all decedents, 5,698 / 8,813 (65%) veterans were identified in both source files, but 2,426 / 8,813 (28%) decedents were not identified in VA BIRLS, and 689 / 8,813 (8%) were not identified in death certificates. Compared to the rest of the cohort, decedents whose mortality status was ascertained through either single source differed by race / ethnicity, marital status, and California residence. Clinically, veterans identified from either single source had less comorbidity and were less likely to have been users of VA inpatient or long term care, but equally or more likely to have been users of VA outpatient services.

Conclusion

As single sources, VA decedent files and death certificates each provided an incomplete record, and death ascertainment was improved by using both source files. Potential bias may vary depending on analytic interest.

GEOGRAPHIC VARIATION ACROSS VETERANS AFFAIRS MEDICAL CENTERS IN THE TREATMENT OF EARLY STAGE PROSTATE CANCER

PURPOSE

We investigated geographic variation in the treatment of early stage prostate cancer in a national sample of veterans after widespread adoption of the prostate specific antigen test.

MATERIALS AND METHODS

Our sample consisted of 16,352 cases from the Veterans Affairs Central Cancer Registry that were diagnosed between January 1997 and December 1999 with stage I or II prostate cancer. We used a 2-stage nested logit model to compare surgery, radiation therapy and noncurative treatment among 4 geographic regions of the United States.

RESULTS

Multivariate analysis showed that patients in the West (referent group) had a higher OR of undergoing surgery than radiation compared with the Northeast, South or Midwest (OR 0.77, 95% CI 0.67 to 0.87, OR 0.86, 95% CI 0.76 to 0.98 and OR 0.75, 95% CI 0.64 to 0.87, respectively. Black men, men with lower grade and higher stage tumors, and unmarried men were less likely to undergo curative treatment and less likely to undergo surgery than radiation.

CONCLUSIONS

Geographic variation persists in patterns of care in men with early stage prostate cancer. However, this variation is limited to the choice between surgery and radiation rather than to the choice between curative and noncurative treatment.

Variations in nurse practitioner use in Veterans Affairs primary care practices

BACKGROUND

Increasingly, primary care practices include nurse practitioners (NPs) in their staffing mix to contain costs and expand primary care. To achieve these aims in U.S. Department of Veterans Affairs medical centers (VAMCs), national policy endorsed involvement of NPs as primary care (PC) providers.

OBJECTIVES

To evaluate the degree to which VAMCs incorporated NPs into PC practices between 1996 and 1999, and to identify the internal and external practice environment features associated with NP use.

STUDY DESIGN

We surveyed 131 PC directors of all VAMCs in 1996 and 1999 to ascertain the staffing and characteristics of the PC practice and parent organization (e.g., academic affiliation, level of physician staffing, use of managed care arrangements), and drew on previously published studies and HRSA State Health Workforce Profiles to characterize each practice's regional health care environment (e.g., geographic region, state NP practice laws, state managed care penetration). Using multivariate linear regression, we evaluate the contribution of these environmental and organizational factors on the number of NPs/10,000 PC patients in 1999, controlling for the rate of NP use in 1996.

PRINCIPAL FINDINGS

From 1996-1999, NP use increased from 75 percent to 90 percent in VA PC practices. The mean number of NPs per practice increased by about 60 percent (2.0 versus 3.2; p<.001), while the rate of NPs/10,000 PC patients trended upward (2.2 versus 2.7; p=.09). Staffing of other primary care clinicians (e.g., physicians and physician assistants per practice) remained stable, while the NP-per-physician rate increased (0.2 versus 0.4; p<.001). After multivariate adjustment, greater reliance on managed-care-oriented provider education programs (p=.02), the presence of NP training programs (p=.05), and more specialty-trained physicians/10,000 PC patients (p=.09) were associated with greater NP involvement in primary care.

CONCLUSIONS

Staffing models in VA PC practices have, in fact, changed, with NPs having a greater presence. However, we found substantial practice-based variations in their use, suggesting that more research is needed to better understand how they have been integrated into practice and what impact their involvement has had on the VA's ability to achieve its restructuring goals.

Profiling quality of care: Is there a role for peer review?

BACKGROUND

We sought to develop a more reliable structured implicit chart review instrument for use in assessing the quality of care for chronic disease and to examine if ratings are more reliable for conditions in which the evidence base for practice is more developed.

METHODS

We conducted a reliability study in a cohort with patient records including both outpatient and inpatient care as the objects of measurement. We developed a structured implicit review instrument to assess the quality of care over one year of treatment. 12 reviewers conducted a total of 496 reviews of 70 patient records selected from 26 VA clinical sites in two regions of the country. Each patient had between one and four conditions specified as having a highly developed evidence base (diabetes and hypertension) or a less developed evidence base (chronic obstructive pulmonary disease or a collection of acute conditions). Multilevel analysis that accounts for the nested and cross-classified structure of the data was used to estimate the signal and noise components of the measurement of quality and the reliability of implicit review.

RESULTS

For COPD and a collection of acute conditions the reliability of a single physician review was quite low (intra-class correlation = 0.16-0.26) but comparable to most previously published estimates for the use of this method in inpatient settings. However, for diabetes and hypertension the reliability is significantly higher at 0.46. The higher reliability is a result of the reviewers collectively being able to distinguish more differences in the quality of care between patients (p < 0.007) and not due to less random noise or individual reviewer bias in the measurement. For these conditions the level of true quality (i.e. the rating of quality of care that would result from the full population of physician reviewers reviewing a record) varied from poor to good across patients.

CONCLUSIONS

For conditions with a well-developed quality of care evidence base, such as hypertension and diabetes, a single structured implicit review to assess the quality of care over a period of time is moderately reliable. This method could be a reasonable complement or alternative to explicit indicator approaches for assessing and comparing quality of care. Structured implicit review, like explicit quality measures, must be used more cautiously for illnesses for which the evidence base is less well developed, such as COPD and acute, short-course illnesses.

Lipid screening in HIV-infected veterans

BACKGROUND

Lipid screening is recommended for patients taking protease inhibitors (PIs).

METHODS

We examined data from the Veterans Administration Immunology Case Registry to assess lipid screening among HIV-infected veterans who received PIs for at least 6 consecutive months during 1999 and 2001. We estimated crude and adjusted associations between lipid screening and patient characteristics (age, gender, HIV exposure, and race/ethnicity), comorbidities (AIDS, cardiovascular disease, diabetes, hypertension, smoking, and hyperlipidemia), and facility characteristics (urban location, case management, guidelines, and quality improvement programs).

RESULTS

Among 4065 patients on PIs, clinicians screened 2395 (59%) for lipids within 6 months of initiating treatment. Adjusting for patient characteristics, comorbidities, facility traits, and clustering, lipid screening was more common among patients who were cared for in urban areas (relative risk [RR] = 1.3, confidence limits: 1.0-1.5), diabetic (RR = 1.2, confidence limits: 1.1-1.3), or previously hyperlipidemic (RR = 1.4, confidence limits: 1.3-1.5) and less common among patients with a history of intravenous drug use (IVDU) (RR = 0.90, confidence limits: 0.79-1.0) or unknown HIV risk (RR = 0.85, confidence limits: 0.75-0.95).

CONCLUSIONS

Six in 10 patients taking PIs receive lipid screening within 6 months of PI use. Systemic interventions to improve overall HIV quality of care should also address lipid screening, particularly among patients with unknown or IVDU HIV risk and those cared for in nonurban areas.

A new instrument to measure appropriateness of services in primary care

OBJECTIVE

To develop a new instrument for judging the appropriateness of three key services (new prescription, diagnostic test, and referral) as delivered in primary care outpatient visits.

DESIGN

Candidate items were generated by a seven-member expert panel, using a five-step nominal technique, for each of three service categories in primary care: new prescriptions, diagnostic tests, and referrals. Expert panelists and a convenience sample of 95 community-based primary care physicians ranked items for (i) importance and (ii) feasibility of ascertaining from a typical office chart record. Resulting items were used to construct a measure of appropriateness using principals of structured implicit review. Two physician reviewers used this measure to judge the appropriateness of 421 services from 160 outpatient visits.

SETTING

Primary care practices in a staff model health maintenance organization and a large preferred provider network.

MEASURES

Inter-rater agreement was measured using intraclass correlation coefficient (ICC) and kappa statistic.

RESULTS

For overall appropriateness, the ICC and kappa were 0.52 and 0.44 for new medication, 0.35 and 0.32 for diagnostic test, and 0.40 and 0.41 for referral, respectively. Only 3% of services were judged to be inappropriate by either reviewer. The proportion of services judged to be less than definitely appropriate by one or both reviewers was 56% for new medication, 31% for diagnostic test, and 22% for referral.

CONCLUSIONS

This new measure of appropriateness of primary care services has fair inter-rater agreement for new medications and referrals, similar to appropriateness measures of other general services, but poor agreement for diagnostic tests. It may be useful as a tool to assess the appropriateness of common primary care services in studies of health care quality, but is not suitable for evaluating performance of individual physicians.

Primary care patients with depression are less accepting of treatment than those seen by mental health specialists

OBJECTIVE

This study examined whether depressed patients treated exclusively in primary care report less need for care and less acceptability of treatment options than those depressed patients treated in the specialty mental health setting after up to 6 months of treatment.

DESIGN

Cross-sectional study.

SETTING

Forty-five community primary care practices.

PARTICIPANTS

A total of 881 persons with major depression who had received mental health services in the previous 6 months and who enrolled in 3 of the 4 Quality Improvement for Depression Collaboration Studies.

MEASUREMENTS AND RESULTS

Patients were categorized into 1 of 2 groups: 1) having received mental health services exclusively from a primary care provider (45%), or 2) having received any services from a mental health specialist (55%) in the previous 6 months. Compared with patients who received care from mental health specialists, patients who received mental health services exclusively from primary care providers had 2.7-fold the odds (95% confidence interval [CI], 1.6 to 4.4) of reporting that no treatment was definitely acceptable and had 2.4-fold the odds (95% CI, 1.5 to 3.9) of reporting that evidence-based treatment options (antidepressant medication) were definitely not acceptable. These results were adjusted for demographic, social/behavioral, depression severity, and economic factors using multiple logistic regression analysis.

CONCLUSIONS

Patients with depression treated exclusively by primary care providers have attitudes and beliefs more averse to care than those seen by mental health specialists. These differences in attitudes and beliefs may contribute to lower quality depression care observed in comparisons of primary care and specialty mental health providers.

The acceptability of treatment for depression among African-American, Hispanic, and white primary care patients

BACKGROUND

Ethnic minority patients are less likely than white patients to receive guideline-concordant care for depression. It is uncertain whether racial and ethnic differences exist in patient beliefs, attitudes, and preferences for treatment.

METHODS

A telephone survey was conducted of 829 adult patients (659 non-Hispanic whites, 97 African Americans, 73 Hispanics) recruited from primary care offices across the United States who reported 1 week or more of depressed mood or loss of interest within the past month and who met criteria for Major Depressive Episode in the past year. Within this cohort, we examined differences among African Americans, Hispanics, and whites in acceptability of antidepressant medication and acceptability of individual counseling.

RESULTS

African Americans (adjusted OR, 0.30; 95% CI 0.19-0.48) and Hispanics (adjusted OR, 0.44; 95% CI, 0.26-0.76) had lower odds than white persons of finding antidepressant medications acceptable. African Americans had somewhat lower odds (adjusted OR, 0.63; 95% CI, 0.35-1.12), and Hispanics had higher odds (adjusted OR, 3.26; 95% CI, 1.08-9.89) of finding counseling acceptable than white persons. Some negative beliefs regarding treatment were more prevalent among ethnic minorities; however adjustment for these beliefs did not explain differences in acceptability of treatment for depression.

CONCLUSIONS

African Americans are less likely than white persons to find antidepressant medication acceptable. Hispanics are less likely to find antidepressant medication acceptable, and more likely to find counseling acceptable than white persons. Racial and ethnic differences in beliefs about treatment modalities were found, but did not explain differences in the acceptability of depression treatment. Clinicians should consider patients' cultural and social context when negotiating treatment decisions for depression. Future research should identify other attitudinal barriers to depression care among ethnic minority patients.

Quality improvement implementation in the nursing home

OBJECTIVE

To examine quality improvement (QI) implementation in nursing homes, its association with organizational culture, and its effects on pressure ulcer care.

DATA SOURCES/STUDY SETTING

Primary data were collected from staff at 35 nursing homes maintained by the Department of Veterans Affairs (VA) on measures related to QI implementation and organizational culture. These data were combined with information obtained from abstractions of medical records and analyses of an existing database.

STUDY DESIGN

A cross-sectional analysis of the association among the different measures was performed.

DATA COLLECTION/EXTRACTION METHODS

Completed surveys containing information on QI implementation, organizational culture, employee satisfaction, and perceived adoption of guidelines were obtained from 1,065 nursing home staff. Adherence to best practices related to pressure ulcer prevention was abstracted from medical records. Risk-adjusted rates of pressure ulcer development were calculated from an administrative database.

PRINCIPAL FINDINGS

Nursing homes differed significantly (p<.001) in their extent of QI implementation with scores on this 1 to 5 scale ranging from 2.98 to 4.08. Quality improvement implementation was greater in those nursing homes with an organizational culture that emphasizes innovation and teamwork. Employees of nursing homes with a greater degree of QI implementation were more satisfied with their jobs (a 1-point increase in QI score was associated with a 0.83 increase on the 5-point satisfaction scale, p<.001) and were more likely to report adoption of pressure ulcer clinical guidelines (a 1-point increase in QI score was associated with a 28 percent increase in number of staff reporting adoption, p<.001). No significant association was found, though, between QI implementation and either adherence to guideline recommendations as abstracted from records or the rate of pressure ulcer development.

CONCLUSIONS

Quality improvement implementation is most likely to be successful in those VA nursing homes with an underlying culture that promotes innovation. While QI implementation may result in staff who are more satisfied with their jobs and who believe they are providing better care, associations with improved care are uncertain.

Adherence to pressure ulcer prevention guidelines: implications for nursing home quality

OBJECTIVES

This study aims to assess overall nursing home (NH) implementation of pressure ulcer (PU) prevention guidelines and variation in implementation rates among a geographically diverse sample of NHs.

DESIGN

Review of NH medical records.

SETTING

A geographically diverse sample of 35 Veterans Health Administration NHs.

PARTICIPANTS

A nested random sample of 834 residents free of PU on admission.

MEASUREMENTS

Adherence to explicit quality review criteria based on the Agency for Healthcare Research and Quality Practice Guidelines for PU prevention was measured. Medical record review was used to determine overall and facility-specific adherence rates for 15 PU guideline recommendations and for a subset of six key recommendations judged as most critical.

RESULTS

Six thousand two hundred eighty-three instances were identified in which one of the 15 guideline recommendations was applicable to a study patient based on a specific indication or resident characteristic in the medical record. NH clinicians adhered to the appropriate recommendation in 41% of these instances. For the six key recommendations, clinicians adhered in 50% of instances. NHs varied significantly in adherence to indicated guideline recommendations, ranging from 29% to 51% overall adherence across all 15 recommendations (P <.001) and from 24% to 75% across the six key recommendations (P <.001). Adherence rates for specific indications also varied, ranging from 94% (skin inspection) to 1% (education of residents or families). Standardized assessment of PU risk was identified as one of the most important and measurable recommendations. Clinicians performed this assessment in only 61% of patients for whom it was indicated.

CONCLUSIONS

NHs' overall adherence to PU prevention guidelines is relatively low and is characterized by large variations between homes in adherence to many recommendations. The low level of adherence and high level of variation to many best-care practices for PU prevention indicate a continued need for quality improvement, particularly for some guidelines.

What patient population does visit-based sampling in primary care settings represent?

BACKGROUND

Evaluations of outpatient interventions often rely on consecutive sampling of clinic visitors, and assume that study results generalize to the population of patients cared for.

OBJECTIVE

The representativeness of such visit-based sampling compared with the population of patients seen during the same year, in terms of sociodemographic and clinical characteristics of the user groups that visit-based sampling yielded were assessed.

METHODS

One thousand five hundred forty-six continuing patients visiting the primary care firms in an urban VA medical center were consecutively sampled, and visit frequencies were compared for these patients with subsets of the patient population. Administrative and survey data was then used to describe the types of patients visit-based sampling most represented compared with the types of patients sampled less frequently.

RESULTS

The average sampled patient visited the firms significantly more often than patients in the reference population (18.7 vs. 9.5). Sampled patients were significantly older (>55 years), in poorer health (higher prevalence of cancer, stroke, hypertension), less likely to smoke, and more likely to be single than the average patient visiting the firms (P<0.05). Adjusting for age and sickness, frequent visitors were more apt to have experienced continuity of care during the prior year, to prefer VA care, and to be unemployed.

CONCLUSIONS

Consecutive visit-based sampling actually selected patients with a visit pattern more typical of the patient population visiting four or more times a year. Studies using sampling of consecutive visitors will typically under-represent low users of care and should account for the degree to which results may not generalize to the broader practice population.

Primary care practice management in rural and urban Veterans Health Administration settings

Limited access to specialty care in rural settings may result in more expectations of primary care providers and a higher demand for primary care. The authors used survey and administrative data from 1999 from the Veterans Health Administration (VHA) to compare primary care practice management and performance in 19 rural to 103 urban VHA hospitals nationally. Rural VHA hospitals were smaller, less likely to be academically affiliated, and had fewer integrated specialty care services. Primary care providers in rural settings were more likely to manage specialty care services, provide continuity across patient care settings, and have complete responsibility for a broader range of services. However, rural hospitals had more staff per patient allocated to primary care than did urban hospitals. Patients in rural settings received comparable quality care to those in urban settings, and they appeared to be more satisfied with the care they received. Within the VHA system, primary care providers in rural settings provided a broader range of services than those in urban ones. This increased breadth may be attributable to the lack of availability of integrated specialty care services in rural settings. Because of this broader range of responsibilities, the provision of primary care in rural settings may require higher staffing patterns and may be inherently more costly than in urban settings; therefore, researchers should be cautious when comparing primary care expenditures across rural and urban settings.

Understanding team-based quality improvement for depression in primary care

OBJECTIVE

To assess the impacts of the characteristics of quality improvement (QI) teams and their environments on team success in designing and implementing high quality, enduring depression care improvement programs in primary care (PC) practices.

STUDY SETTING/DATA SOURCES

Two nonprofit managed care organizations sponsored five QI teams tasked with improving care for depression in large PC practices. Data on characteristics of the teams and their environments is from observer process notes, national expert ratings, administrative data, and interviews.

STUDY DESIGN

Comparative formative evaluation of the quality and duration of implementation of the depression improvement programs developed by Central Teams (CTs) emphasizing expert design and Local Teams (LTs) emphasizing participatory local clinician design, and of the effects of additional team and environmental factors on each type of team. Both types of teams depended upon local clinicians for implementation.

PRINCIPAL FINDINGS

The CT intervention program designs were more evidence-based than those of LTs. Expert team leadership, support from local practice management, and support from local mental health specialists strongly influenced the development of successful team programs. The CTs and LTs were equally successful when these conditions could be met, but CTs were more successful than LTs in less supportive environments.

CONCLUSIONS

The LT approach to QI for depression requires high local support and expertise from primary care and mental health clinicians. The CT approach is more likely to succeed than the LT approach when local practice conditions are not optimal.

Interventions that increase use of adult immunization and cancer screening services: a meta-analysis

PURPOSE

The relative effectiveness of the diverse approaches used to promote preventive care activities, such as cancer screening and adult immunization, is unknown. Despite many high-quality published studies, practices and policymakers attempting to improve preventive care have little definitive information on which to base decisions. Thus, we quantitatively assessed the relative effectiveness of previously studied approaches for improving adherence to adult immunization and cancer screening guidelines.

DATA SOURCES

MEDLINE, the Cochrane Effective Practice and Organization of Care Review Group register, previous systematic reviews, and the Medicare Health Care Quality Improvement Project database.

STUDY SELECTION

Controlled clinical trials that assessed interventions to increase use of immunizations for influenza and pneumococcal pneumonia and screening for colon, breast, and cervical cancer in adults.

DATA EXTRACTION

Two reviewers independently extracted data on characteristics and outcomes from unmasked articles. Intervention components to increase use of services were classified as reminder, feedback, education, financial incentive, legislative action, organizational change, or mass media campaign.

DATA SYNTHESIS

Of 552 abstracts and articles, 108 met the inclusion criteria. To assess the effect of intervention components, meta-regression models were developed for immunizations and each cancer screening service by using 81 studies with a usual care or control group. The most potent intervention types involved organizational change (the adjusted odds ratios for increased use of services from organizational change ranged from 2.47 to 17.6). Organizational change interventions included the use of separate clinics devoted to prevention, use of a planned care visit for prevention, or designation of nonphysician staff to do specific prevention activities. The next most effective intervention components were patient financial incentives (adjusted odds ratios, 1.82 to 3.42) and patient reminders (adjusted odds ratios, 1.74 to 2.75); the adjusted odds ratios ranged from 1.29 to 1.53 for patient education and from 1.10 to 1.76 for feedback.

CONCLUSIONS

Rates of adult immunization and cancer screening are most likely to improve when a health care organization supports performance of these activities through organizational changes in staffing and clinical procedures. Involving patients in self-management through patient financial incentives and reminders is also likely to positively affect performance.

Cost-effectiveness of practice-initiated quality improvement for depression: results of a randomized controlled trial

CONTEXT

Depression is a leading cause of disability worldwide, but treatment rates in primary care are low.

OBJECTIVE

To determine the cost-effectiveness from a societal perspective of 2 quality improvement (QI) interventions to improve treatment of depression in primary care and their effects on patient employment.

DESIGN

Group-level randomized controlled trial conducted June 1996 to July 1999.

SETTING

Forty-six primary care clinics in 6 community-based managed care organizations.

PARTICIPANTS

One hundred eighty-one primary care clinicians and 1356 patients with positive screening results for current depression.

INTERVENTIONS

Matched practices were randomly assigned to provide usual care (n = 443 patients) or to 1 of 2 QI interventions offering training to practice leaders and nurses, enhanced educational and assessment resources, and either nurses for medication follow-up (QI-meds; n = 424 patients) or trained local psychotherapists (QI-therapy; n = 489). Practices could flexibly implement the interventions, which did not assign type of treatment.

MAIN OUTCOME MEASURES

Total health care costs, costs per quality-adjusted life-year (QALY), days with depression burden, and employment over 24 months, compared between usual care and the 2 interventions.

RESULTS

Relative to usual care, average health care costs increased $419 (11%) in QI-meds (P =.35) and $485 (13%) in QI-therapy (P =.28); estimated costs per QALY gained were between $15 331 and $36 467 for QI-meds and $9478 and $21 478 for QI-therapy; and patients had 25 (P =.19) and 47 (P =.01) fewer days with depression burden and were employed 17.9 (P =.07) and 20.9 (P =.03) more days during the study period.

CONCLUSIONS

Societal cost-effectiveness of practice-initiated QI efforts for depression is comparable with that of accepted medical interventions. The intervention effects on employment may be of particular interest to employers and other stakeholders.

The Quality Improvement for Depression collaboration: general analytic strategies for a coordinated study of quality improvement in depression care

It is difficult to evaluate the promise of primary care quality-improvement interventions for depression because published studies have evaluated diverse interventions by using different research designs in dissimilar populations. Preplanned meta-analysis provides an alternative to derive more precise and generalizable estimates of intervention effects; however, this approach requires the resolution of analytic challenges resulting from design differences that threaten internal and external validity. This paper describes the four-project Quality Improvement for Depression (QID) collaboration specifically designed for preplanned meta-analysis of intervention effects on outcomes. This paper summarizes the interventions the four projects tested, characterizes commonalities and heterogeneity in the research designs used to evaluate these interventions, and discusses the implications of this heterogeneity for preplanned meta-analysis.

Long-term effectiveness of disseminating quality improvement for depression in primary care

BACKGROUND

This article addresses whether dissemination of short-term quality improvement (QI) interventions for depression to primary care practices improves patients' clinical outcomes and health-related quality of life (HRQOL) over 2 years, relative to usual care (UC).

METHODS

The sample included 1299 patients with current depressive symptoms and 12-month, lifetime, or no depressive disorder from 46 primary care practices in 6 managed care organizations. Clinics were randomized to UC or 1 of 2 QI programs that included training local experts and nurse specialists to provide clinician and patient education, assessment, and treatment planning, plus either nurse care managers for medication follow-up (QI-meds) or access to trained psychotherapists (QI-therapy). Outcomes were assessed every 6 months for 2 years.

RESULTS

For most outcomes, differences between intervention and UC patients were not sustained for the full 2 years. However, QI-therapy reduced overall poor outcomes compared with UC by about 8 percentage points throughout 2 years, and by 10 percentage points compared with QI-meds at 24 months. Both interventions improved patients' clinical and role outcomes, relative to UC, over 12 months (eg, a 10-11 and 6-7 percentage point difference in probable depression at 6 and 12 months, respectively).

CONCLUSIONS

While most outcome improvements were not sustained over the full 2 study years, findings suggest that flexible dissemination of short-term, QI programs in managed primary care can improve patient outcomes well after program termination. Models that support integrated psychotherapy and medication-based treatment strategies in primary care have the potential for relatively long-term patient benefits.

Quality improvement for depression enhances long-term treatment knowledge for primary care clinicians

OBJECTIVE

We evaluated the effect of implementing quality improvement (QI) programs for depression, relative to usual care, on primary care clinicians' knowledge about treatment.

DESIGN AND METHODS

Matched primary care clinics (46) from seven managed care organizations were randomized to usual care (mailed written guidelines only) versus one of two QI interventions. Self-report surveys assessed clinicians' knowledge of depression treatments prior to full implementation (June 1996 to March 1997) and 18 months later. We used an intent-to-treat analysis to examine intervention effects on change in knowledge, controlling for clinician and practice characteristics, and the nested design.

PARTICIPANTS

One hundred eighty-one primary care clinicians.

INTERVENTIONS

The interventions included institutional commitment to QI, training local experts, clinician education, and training nurses for patient assessment and education. One intervention had resources for nurse follow-up on medication use (QI-meds) and the other had reduced copayment for therapy from trained, local therapists (QI-therapy).

RESULTS

Clinicians in the intervention group had greater increases compared with clinicians in the usual care group over 18 months in knowledge of psychotherapy (by 20% for QI-meds, P =.04 and by 33% for QI-therapy, P =.004), but there were no significant increases in medication knowledge. Significant increases in knowledge scores (P =.01) were demonstrated by QI-therapy clinicians but not clinicians in the QI-meds group. Clinicians were exposed to multiple intervention components.

CONCLUSIONS

Dissemination of QI programs for depression in managed, primary care practices improved clinicians' treatment knowledge over 18 months, but breadth of learning was somewhat greater for a program that also included active collaboration with local therapists.

Structured implicit review: a new method for monitoring nursing care quality

BACKGROUND

Nurses' independent decisions about assessment, treatment, and nursing interventions for hospitalized patients are important determinants of quality of care. Physician peer implicit review of medical records has been central to Medicare quality management and is considered the gold standard for reviewing physician care, but peer implicit review of nursing processes of care has not received similar attention.

OBJECTIVE

The objective of this study was to develop and evaluate nurse structured implicit review (SIR) methods.

RESEARCH DESIGN

We developed SIR instruments for rating the quality of inpatient nursing care for congestive heart failure (CHF) and cerebrovascular accident (CVA). Nurse reviewers used the SIR form to rate a nationally representative sample of randomly selected medical records for each disease from 297 acute care hospitals in 5 states (collected by the RAND-HCFA Prospective Payment System study).

SUBJECTS

The study subjects were elderly Medicare inpatients with CHF (n = 291) or CVA (n = 283).

MEASURES

We developed and tested scales reflecting domains of nursing process, evaluated interrater and interitem reliability, and assessed the extent to which items and scales predicted overall ratings of the quality of nursing care.

RESULTS

Interrater reliability for 14 of 16 scales (CHF) or 10 of 16 scales (CVA) was > or = 0.40. Interitem reliability was > 0.80 for all but 1 scale (both diseases). Functional Assessment, Physical Assessment, and Medication Tracking ratings were the strongest predictors of overall nursing quality ratings (P < 0.001 for each).

CONCLUSIONS

Nurse peer review with SIR has adequate interrater and excellent scale reliabilities and can be a valuable tool for assessing nurse performance.

Who is at risk of nondetection of mental health problems in primary care?

OBJECTIVE

To determine patient and provider characteristics associated with increased risk of nondetection of mental health problems by primary care physicians.

DESIGN

Cross-sectional patient and physician surveys conducted as part of the Medical Outcomes Study.

PARTICIPANTS

We studied 19,309 patients and 349 internists and family physicians.

MEASUREMENTS AND MAIN RESULTS

We counted "detection" of a mental health problem whenever physicians reported, in a postvisit survey, that they thought the patient had a mental health problem or that they had counseled or referred the patient for mental health. Key independent variables included patient self-reported demographic characteristics, health-related quality of life (HRQOL), depression diagnoses according to the Diagnostic and Statistical Manual of Mental Disorders, and physician demographics and proclivity to provide counseling for depression. Logistic regression analysis, adjusted for HRQOL, revealed physicians were less likely to detect mental health problems in African Americans (odds ratio [OR], 0.63; 95% confidence interval [CI], 0.46 to 0.86), men (OR, 0.64; 95% CI, 0.54 to 0.75), and patients younger than 35 years (OR, 0.61; 95% CI, 0.44 to 0.84), and more likely to detect them in patients with diabetes (OR, 1.4; 95% CI, 1.0 to 1.8) or hypertension (OR, 1.3; 95% CI, 1.1 to 1.6). In a model that included DSM-III diagnoses, odds of detection remained reduced for African Americans as well as for Hispanics (OR, 0.29; 95% CI, 0.11 to 0.71), and patients with more-severe DSM-III diagnoses were more likely to be detected. Physician proclivity toward providing counseling for depression influenced the likelihood of detection.

CONCLUSIONS

Patients' race, gender, and coexisting medical conditions affected physician awareness of mental health problems. Strategies to improve detection of mental health problems among African Americans, Hispanics, and men should be explored and evaluated.

From understanding health care provider behavior to improving health care: the QUERI framework for quality improvement. Quality Enhancement Research Initiative

Basic science and health care research provide the evidence base for the scientific practice of medicine. Over the past 2 decades, as increasingly refined tools for improving health and health care have been developed, the health care community has attempted to bridge the gap between available tools and actual health care practices. This gap can be bridged only by influencing health care provider behavior. The VA Quality Enhancement Research Initiative (QUERI) is a program designed to systematically translate research findings into better health care practices, and thus better health outcomes for enrolled veterans. Integrating provider behavior research considerations and findings into each step of the QUERI process will enhance the effectiveness of the initiative. This article presents a provider behavior research framework for planning, implementing, and evaluating quality improvement interventions within QUERI.

Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial

CONTEXT

Care of patients with depression in managed primary care settings often fails to meet guideline standards, but the long-term impact of quality improvement (QI) programs for depression care in such settings is unknown.

OBJECTIVE

To determine if QI programs in managed care practices for depressed primary care patients improve quality of care, health outcomes, and employment.

DESIGN

Randomized controlled trial initiated from June 1996 to March 1997.

SETTING

Forty-six primary care clinics in 6 US managed care organizations.

PARTICIPANTS

Of 27332 consecutively screened patients, 1356 with current depressive symptoms and either 12-month, lifetime, or no depressive disorder were enrolled.

INTERVENTIONS

Matched clinics were randomized to usual care (mailing of practice guidelines) or to 1 of 2 QI programs that involved institutional commitment to QI, training local experts and nurse specialists to provide clinician and patient education, identification of a pool of potentially depressed patients, and either nurses for medication follow-up or access to trained psychotherapists.

MAIN OUTCOME MEASURES

Process of care (use of antidepressant medication, mental health specialty counseling visits, medical visits for mental health problems, any medical visits), health outcomes (probable depression and health-related quality of life [HRQOL]), and employment at baseline and at 6- and 12-month follow-up.

RESULTS

Patients in QI (n = 913) and control (n = 443) clinics did not differ significantly at baseline in service use, HRQOL, or employment after nonresponse weighting. At 6 months, 50.9% of QI patients and 39.7% of controls had counseling or used antidepressant medication at an appropriate dosage (P<.001), with a similar pattern at 12 months (59.2% vs 50.1%; P = .006). There were no differences in probability of having any medical visit at any point (each P > or = .21). At 6 months, 47.5% of QI patients and 36.6% of controls had a medical visit for mental health problems (P = .001), and QI patients were more likely to see a mental health specialist at 6 months (39.8% vs 27.2%; P<.001) and at 12 months (29.1% vs 22.7%; P = .03). At 6 months, 39.9% of QI patients and 49.9% of controls still met criteria for probable depressive disorder (P = .001), with a similar pattern at 12 months (41.6% vs 51.2%; P = .005). Initially employed QI patients were more likely to be working at 12 months relative to controls (P = .05).

CONCLUSIONS

When these managed primary care practices implemented QI programs that improve opportunities for depression treatment without mandating it, quality of care, mental health outcomes, and retention of employment of depressed patients improved over a year, while medical visits did not increase overall.

Does what nurses do affect clinical outcomes for hospitalized patients? A review of the literature

OBJECTIVE

Through a review of the literature, to identify and describe (1) empirical studies of inpatient nursing care quality that evaluate links between nursing care processes and health-related patient outcomes, (2) nursing care processes for which process-outcome links have been established, and (3) important nursing care processes that have not yet been evaluated.

DATA SOURCES/STUDY SETTING

Published empirical studies of inpatient nursing care quality that evaluated links between processes of nursing care and health-related patient outcomes.

STUDY DESIGN/DATA COLLECTION/EXTRACTION METHODS

This literature review used a five-step article search and review method.

PRINCIPAL FINDINGS

Of 257 data-based studies of nursing care quality identified, 135 investigated a process-outcome link but only 17 met study inclusion criteria. The literature provides evidence that the quality of nursing care processes affects health-related patient outcomes during and after hospitalization. Gaps in the literature that evaluates nursing quality are identified.

CONCLUSIONS

Although some nursing care processes affect health-related patient outcomes, the full extent of nursing process-outcome links is relatively understudied. Further evaluation of the interrelationships between nursing care processes and outcomes is critical.

Quality of care for primary care patients with depression in managed care

OBJECTIVE

To evaluate the process and quality of care for primary care patients with depression under managed care organizations.

METHOD

Surveys of 1204 outpatients with depression at the time of and after a visit to 1 of 181 primary care clinicians from 46 primary care clinics in 7 managed care organizations. Patients had depressive symptoms in the previous 30 days, with or without a 12-month depressive disorder by diagnostic interview. Process indicators were depression counseling, mental health referral, or psychotropic medication management at index visit and the use of appropriate antidepressant medication during the last 6 months.

RESULTS

Of patients with depressive disorder and recent symptoms, 29% to 43% reported a depression-specific process of care in the index visit, and 35% to 42% used antidepressant medication in appropriate dosages in the prior 6 months. Patients with depressive disorders rather than symptoms only and those with comorbid anxiety had higher rates of depression-specific processes and quality of care (P < .005). Recurrent depression, suicidal ideation, and alcohol abuse were not uniquely associated with such rates. Patients visiting for old problems or checkups received more depression-specific care than those with new problems or unscheduled visits. The 7 managed care organizations varied by a factor of 2-fold in rates of depression counseling and appropriate anti-depressant use.

CONCLUSIONS

Rates of process and quality of care for depression as reported by patients are moderate to low in managed primary care practices. Such rates are higher for patients with more severe forms of depression or with comorbid anxiety, but not for those with severe but "silent" symptoms like suicide ideation. Visit context factors, such as whether the visit is scheduled, affect rates of depression-specific care. Rates of care for depression are highly variable among managed care organizations, emphasizing the need for process monitoring and quality improvement for depression at the organizational level.

Evidence-based care for depression in managed primary care practices

This paper evaluates whether externally designed, evidence-based interventions for improving care for depression can be locally implemented in managed care organizations. The interventions were carried out as part of a randomized trial involving forty-six practices within six diverse, nonacademic managed care plans. Based on evaluation of adherence to the intervention protocol, we determined that local practice leaders are able to implement predesigned interventions for improving depression care. Adherence rates for most key intervention activities were above 70 percent, and many were near 100 percent. Three intervention activities fell short of the goal of 70 percent implementation and should be targets for future improvement.

Health habit counseling amidst competing demands: effects of patient health habits and visit characteristics

OBJECTIVE

This study assesses the effects of competing demands, such as poor health habits or new medical problems, on health-habit counseling during a primary care visit.

METHODS

We surveyed a consecutive sample of 1,259 patients visiting primary care clinicians at an academic VA medical center. Before the visit, patients reported their health status, health habits, and sociodemographics; immediately after the visit, patients reported reasons for the visit and whether they had been counseled about specific health habits. We scored visit acuity ranging from visits for unscheduled walk-in care or new medical problems to scheduled visits for check-ups or old problems. We defined counseling "triggers" as clinical indications for counseling about particular health habits (e.g., smoking). We developed a logistic model predicting primary care provider counseling during a visit.

RESULTS

Over two-thirds of patients (68.9%) received some health habit counseling. Controlling for other independent variables, patients with more triggers were more likely to report being counseled. Counseling rates went up as visit acuity went down; patients with the lowest visit acuity having 67% greater odds of being counseled than patients with the highest visit acuity.

CONCLUSIONS

Physicians set priorities for health-habit counseling during a visit based on patients' health habit problems or triggers; whether the visit is scheduled or walk-in; and whether the patient has new or acute problems. Future research about primary care performance of health habit counseling should account for these patient and visit characteristics, and prevention-oriented health care organizations should ensure access to scheduled "check-up" visits.

Treating depression in staff-model versus network-model managed care organizations

OBJECTIVE

To compare primary care providers' depression-related knowledge, attitudes, and practices and to understand how these reports vary for providers in staff or group-model managed care organizations (MCOs) compared with network-model MCOs including independent practice associations and preferred provider organizations.

DESIGN

Survey of primary care providers' depression-related practices in 1996.

SETTING AND PARTICIPANTS

We surveyed 410 providers, from 80 outpatient clinics, in 11 MCOs participating in four studies designed to improve the quality of depression care in primary care.

MEASUREMENTS AND MAIN RESULTS

We measured knowledge based on depression guidelines, attitudes (beliefs about burden, skill, and barriers) related to depression, and reported behavior. Providers in both types of MCO are equally knowledgeable about treating depression (better knowledge of pharmacologic than psychotherapeutic treatments) and perceive equivalent skills in treating depression. However, compared with network-model providers, staff/group-model providers have stronger beliefs that treating depression is burdensome to their practice. While more staff/group-model providers reported time limitations as a barrier to optimal depression treatment, more network-model providers reported limited access to mental health specialty referral as a barrier. Accordingly, these staff/group-model providers are more likely to treat patients with major depression through referral (51% vs 38%) or to assess but not treat (17% vs 7%), and network-model providers are more likely to prescribe antidepressants (57% vs 6%) as first-line treatment.

CONCLUSIONS

Whereas the providers from staff/group-model MCOs had greater access to and relied more on referral, the providers from network-model organizations were more likely to treat depression themselves. Given varying attitudes and behaviors, improving primary care for the treatment of depression will require unique strategies beyond enhancing technical knowledge for the two types of MCOs.

Referrals by general internists and internal medicine trainees in an academic medicine practice

Patient referral from generalists to specialists is a critical clinic care process that has received relatively little scrutiny, especially in academic settings. This study describes the frequency with which patients enrolled in a prepaid health plan were referred to specialists by general internal medicine faculty members, general internal medicine track residents, and other internal medicine residents; the types of clinicians they were referred to; and the types of diagnoses with which they presented to their primary care physicians. Requested referrals for all 2,113 enrolled prepaid health plan patients during a 1-year period (1992-1993) were identified by computer search of the practice's administrative database. The plan was a full-risk contract without carve-out benefits. We assessed the referral request rate for the practice and the mean referral rate per physician. We also determined the percentage of patients with diagnoses based on the International Classification of Diseases, 9th revision, who were referred to specialists. The practice's referral request rate per 100 patient office visits for all referral types was 19.8. Primary care track residents referred at a higher rate than did nonprimary care track residents (mean 23.7 vs. 12.1; P < .001). The highest referral rate (2.0/100 visits) was to dermatology. Almost as many (1.7/100 visits) referrals were to other "expert" generalists within the practice. The condition most frequently associated with referral to a specialist was depression (42%). Most referrals were associated with common ambulatory care diagnoses that are often considered to be within the scope of generalist practice. To improve medical education about referrals, a better understanding of when and why faculty and trainees refer and don't refer is needed, so that better models for appropriate referral can be developed.

What is the role of timing in the surgical and rehabilitative care of community-dwelling older persons with acute hip fracture?

OBJECTIVE

To determine the relationship of surgical repair of acute hip fracture within 2 days of hospital admission, followed by more than 5 sessions per week of physical and occupational therapy (PT/OT), to outcomes after acute hip fracture.

DESIGN

Comparison of hip fracture outcomes via secondary analysis of data obtained by retrospective medical record review according to timing of surgical repair and frequency of PT/OT, adjusted for patient, medical care, and hospital characteristics.

SAMPLE

The study included the medical records of 1880 elderly Medicare recipients admitted from the community to 284 acute care hospitals in 5 states during 1981 and 1982 or 1985 and 1986 with a primary diagnosis of acute hip fracture who underwent surgical repair and received PT/OT.

INTERVENTIONS

None.

MAIN OUTCOME MEASURES

The postoperative day when ambulation first occurred, the length of hospital stay, and return to the community.

RESULTS

Earlier surgical repair was associated with a shorter length of hospital stay (5 fewer days, P < .001) without a statistically significant increase in medical complications. High frequency PT/OT was associated with earlier ambulation (odds ratio [OR], 1.76; 95% confidence limits [CL], 1.50, 2.07). Patients who ambulated earlier [corrected] had shorter lengths of stay (6.5 fewer days, P < .001), were more likely to return to the community (OR, 1.45; 95% CL, 1.16, 1.81), and had better 6-month survival (OR, 2.8; 95% CL, 2.06, 3.88), and patients younger than 85 years had fewer in-hospital complications (11% vs 4%, P < .001).

CONCLUSION

Surgical repair within the first 2 days of hospitalization and more than 5 PT/OT sessions per week were associated with better health outcomes in a nationally representative sample of elderly patients with hip fracture.

Racial differences in the utilization of inpatient rehabilitation services among elderly stroke patients

BACKGROUND AND PURPOSE

We undertook this study to ascertain whether elderly black and white patients who are hospitalized for stroke utilize inpatient physical and occupational therapy (PT/OT) services differently, adjusting for characteristics associated with use of these services.

METHODS

We retrospectively reviewed medical records regarding the care received by a nationally representative sample of 2497 black and white Medicare patients, aged 65 years of older, who were hospitalized at any of 297 acute-care hospitals located in 30 communities within five states.

RESULTS

Compared with whites, black stroke patients were younger and more likely to have Medicaid coverage, have an ischemic stroke, and have a motor deficit noted at the time of admission. There was no difference in either sex or level of consciousness on admission. Overall, a larger proportion of black stroke patients used inpatient PT/OT at some point during the hospitalization (66.3% versus 55.8%; P < .01). However, after adjustment for characteristics associated with use of PT/OT, there was no racial difference in either the likelihood of inpatient PT/OT use (adjusted relative risk, 1.06; 95% confidence limits, 0.89 to 1.27; P = .42) or time to initial contact (median: blacks, 6.6 days; whites, 7.4 days; P = .42). Adjusted analyses also indicated a similarity between the racial groups in the number of inpatient PT/OT days overall or as a proportion of the hospital stay.

CONCLUSIONS

Elderly black and white stroke patients who have Medicare coverage have similar patterns of use of inpatient PT/OT services.

Information content and clarity of radiologists' reports for chest radiography

RATIONALE AND OBJECTIVES

We systematically characterized the information provided by chest radiography reports on a nationally representative sample of 822 elderly patients hospitalized in 297 acute-care hospitals in five states who had an admission diagnosis of congestive heart failure, acute myocardial infarction, or pneumonia.

METHODS

We studied the content of radiography reports, including mention of the type or adequacy of radiography; the presence or absence of a prior radiograph; comments about bones, the aorta, the mediastinum, and pleura and notation of the laterality of findings; and the presence of diagnosis. Two physicians reviewed each patient's report, and a third assigned the final rating when they disagreed.

RESULTS

Our analysis found wide variation in content of chest radiography reports, extensive variation in terms used to identify the presence or absence of abnormal findings, and a large degree of uncertainty in what was found.

CONCLUSION

With most hospitals introducing new information systems in response to technological advances and the need to generate more formal hospitalwide reports, the time is right to improve the quality of chest radiography reporting.

The validity of a nursing assessment and monitoring of signs and symptoms scale in ICU and non-ICU patients

PURPOSE

This study examined the validity of medical-record-based nursing assessment and monitoring of signs and symptoms (nursing surveillance) in predicting patients who were admitted to ICUs and those admitted to non-ICUs. The association of this assessment and monitoring with differences in an intermediate patient outcome, instability at discharge, was also explored. Patients admitted to either setting with a diagnosis of acute myocardial infarction, cerebrovascular accident, congestive heart failure, or pneumonia, were included in the study.

METHOD

A secondary analysis was carried out using a subset of data originally collected for a quality-of-care study. Data from the medical records of 11,246 patients (52% female, 48% male) with a mean age of 76.4 years were used in the present study.

RESULTS

ICU patients (n = 3969) were found to have a longer length of stay and to be sicker on admission than non-ICU patients (n = 7277). Overall, patients in the ICU received significantly higher nursing assessment and monitoring of signs and symptoms scores than non-ICU patients. Nursing assessment and monitoring of signs and symptoms scores were lower for patients discharged with greater instability for three of the four diseases (cerebrovascular accidents, congestive heart failure, and pneumonia).

Evaluation of the VA's Pilot Program in Institutional Reorganization toward Primary and Ambulatory Care: Part I, Changes in process and outcomes of care

PURPOSE

To evaluate the impact of the reorganization of an academic Veterans Affairs medical center toward primary and ambulatory care--including the implementation of a medical-center-wide interdisciplinary firm system and ambulatory care training program--on the quality of primary ambulatory care.

METHOD

Randomly selected male veterans visiting the Veterans Affairs Medical Center in Sepulveda, California, were surveyed in 1992, early in the implementation of the program, and in 1993, after the program had been fully implemented. Two surveys were used: one before the veterans saw their primary care providers (practice-based survey) and the other immediately after patient visits (visit-based survey). Survey-participant data were then linked to computerized utilization and mortality data. Survey topics were mapped to the medical center's strategic plan and goals for ambulatory care, and focused on patients' reports about the care they had received in terms of continuity, access, preventive care, and other aspects of the biopsychosocial model of care. Administrative computer data were then used to evaluate effects on medical center workload. Statistical analyses included analysis of variance, analysis of covariance, chi-square, and logistic regression.

RESULTS

For practice-based comparisons, complete data were available for 1,262 veterans in 1992 and 1,373 in 1993. For visit-based comparisons, complete data were available for 1,407 veterans in 1992 and 643 in 1993. Results included statistically significant improvements in continuity of care and detection of depression as well as increased rates of preventive care counseling (smoking and exercise). The proportion of veterans reporting being seen by physicians increased, as did the proportion of patients seen for check-ups rather than for acute problems. Fewer patients were seen in subspecialty clinics than in general medicine clinics. Patient satisfaction increased, hospitalizations decreased, and death rates decreased. Alcohol counseling and access to care for acute symptoms declined. Workload shifted from subspecialists to generalists and from inpatient care to outpatient care.

CONCLUSION

The institutional reorganization toward primary and ambulatory care succeeded in substantially improving the quality of ambulatory care, reflecting improvements in the system of care and of health care provider training in ambulatory care.

Evaluation of the VA's Pilot Program in Institutional Reorganization Toward Primary and Ambulatory Care: Part II, A study of organizational stresses and dynamics

BACKGROUND

Many academically affiliated hospitals are moving from an inpatient, subspecialty orientation in their patient care and educational programs toward a greater emphasis on ambulatory and primary care. Few studies have focused on the organizational, staffing, and management issues involved in implementing these changes.

METHOD

The authors carried out a qualitative evaluation of the process of change in an academic Department of Veterans Affairs hospital during implementation of a major ambulatory primary care program. They interviewed four top managers individually and 59 top and middle managers, house officers, and patients in focus groups in the spring of 1992, nine months after implementation of the key components of the program. Four raters independently evaluated written transcripts of focus-group sessions and identified themes.

RESULTS

The main problems identified were difficulty with administrative integration between inpatient and outpatient services; need for training, retraining, and orientation; tensions due to changes in roles and organizational culture; and inefficiency due to the need for frequent negotiations in daily work life. These four problems reflected tensions associated with new demands imposed by matrix management, changing job descriptions, policies and procedures, and changing patterns of communication and record keeping.

CONCLUSION

During the process of implementation of a primary care focus throughout a medical center, extra demands upon staff are inevitable and should be anticipated and planned for. Twelve key factors for successful organizational change are discussed.