Compliance among pharmacies in California with a prescription-drug discount program for Medicare beneficiaries

Using a Secret Shopper to Evaluate Pharmacist Provision of Emergency Contraception

Introduction:

Commonly known as “the morning-after pill,” hormonal emergency contraception or the emergency contraceptive pill (ECP) is most effective if used within 72 hours of unprotected sex. In this paper we review a pilot project in Toronto, Ontario, that aimed to increase accessibility by allowing pharmacists to dispense ECP through a pharmacist-physician collaborative agreement, using a predefined protocol. Participating pharmacists received training in the pilot protocol and about ECP. To evaluate whether participating pharmacists were following the project protocol (i.e., giving accurate information to women requesting ECP and dispensing ECP appropriately), and to determine the quality of the pharmacist-patient encounter, we sent “secret shoppers” to participating pharmacies.

Method:

Five trained “secret shoppers,” using one of two predefined scripts (Script One, where ECP was clearly appropriate, and Script Two, where ECP was not appropriate) visited 34 participating pharmacies to request ECP. At the end of the visit, the secret shopper filled in a questionnaire about the encounter and provided comments. Percentages were calculated for all variables.

Results:

For Script One encounters (n=17), most pharmacists followed the protocol correctly to dispense ECP. For Script Two encounters (n=17), 71.4% provided alternatives to ECP, but three pharmacists did not follow protocol and provided ECP. For Script One, 52.9% of pharmacists and for Script Two, 71.4%, provided a community referral for follow-up care. The majority of pharmacists (97%) treated the shopper with respect and 85% communicated clearly. Most of the shoppers' comments were positive and the main negative comment about the encounter was lack of privacy.

Conclusions:

The use of a secret shopper allowed the examination of the pharmacist-customer interaction to delineate issues of importance to the pilot project and provide feedback on areas that may require improvement in the pharmacy provision of emergency contraception, namely, dealing with women who do not qualify for ECP and providing women with community referrals for sexually transmitted infections or ongoing contraception.

A systematic review of the use of simulated patients and pharmacy practice research

Objective

The use of simulated patients to assess current practice, or to derive outcome measures for pharmacy practice research, has received much attention in recent years. A simulated patient is an individual who is trained to visit a pharmacy to enact a scenario testing specific behaviour of the pharmacist or pharmacy staff. The aim of this study was to provide a definitive review of the use of simulated patients as a methodological tool for pharmacy practice research.

Method

A systematic review was undertaken to identify all pharmacy practice studies that had used simulated patient methodology. The electronic databases searched to identify relevant studies were MEDLINE, EMBASE and CINAHL. Articles fulfilling all the following criteria were considered for inclusion in the review: primary reports of trials conducted in community pharmacy and drug store settings which used simulated patients to derive outcome measures. The review was not restricted by language or by country. The review was restricted to publications from 1976 to May 2005.

Key findings

In total, 56 full publications were retrieved for further examination, of which 46 studies were included in the review, including: nine randomised controlled trials, three controlled trials, 30 cross-sectional, two time-series and two ‘other’ studies. Ten publications were excluded: seven reviews, one laboratory-based study, one telephone survey and one study presented only as an abstract.

Conclusions

There has been steady growth in the use of simulated patient methodology over the past 30 years. Although simulated patients have received negative attention in the pharmaceutical media, they can be a rigorous and robust method of measuring practice if used appropriately. This review demonstrates the range of activities for which this method can be used, including the assessment of counselling and advice provision, the treatment of minor and major illness, and the assessment of the public health activities of pharmacy and drug store staff. Simulated patient methodology has been used in developing countries to a similar, if not greater extent, than the developed world, demonstrating its versatility and applicability to pharmacy practice research globally.

Relative risks and confidence intervals were easily computed indirectly from multivariable logistic regression

OBJECTIVE

To assess alternative statistical methods for estimating relative risks and their confidence intervals from multivariable binary regression when outcomes are common.

STUDY DESIGN AND SETTING

We performed simulations on two hypothetical groups of patients in a single-center study, either randomized or cohort, and reanalyzed a published observational study. Outcomes of interest were the bias of relative risk estimates, coverage of 95% confidence intervals, and the Akaike information criterion.

RESULTS

According to simulations, a commonly used method of computing confidence intervals for relative risk substantially overstates statistical significance in typical applications when outcomes are common. Generalized linear models other than logistic regression sometimes failed to converge, or produced estimated risks that exceeded 1.0. Conditional or marginal standardization using logistic regression and bootstrap resampling estimated risks within the [0,1] bounds and relative risks with appropriate confidence intervals.

CONCLUSION

Especially when outcomes are common, relative risks and confidence intervals are easily computed indirectly from multivariable logistic regression. Log-linear regression models, by contrast, are problematic when outcomes are common.