Designing Human-Centered AI to Prevent Medication Dispensing Errors: Focus Group Study With Pharmacists

BACKGROUND

Medication errors, including dispensing errors, represent a substantial worldwide health risk with significant implications in terms of morbidity, mortality, and financial costs. Although pharmacists use methods like barcode scanning and double-checking for dispensing verification, these measures exhibit limitations. The application of artificial intelligence (AI) in pharmacy verification emerges as a potential solution, offering precision, rapid data analysis, and the ability to recognize medications through computer vision. For AI to be embraced, it must be designed with the end user in mind, fostering trust, clear communication, and seamless collaboration between AI and pharmacists.

OBJECTIVE

This study aimed to gather pharmacists' feedback in a focus group setting to help inform the initial design of the user interface and iterative designs of the AI prototype.

METHODS

A multidisciplinary research team engaged pharmacists in a 3-stage process to develop a human-centered AI system for medication dispensing verification. To design the AI model, we used a Bayesian neural network that predicts the dispensed pills' National Drug Code (NDC). Discussion scripts regarding how to design the system and feedback in focus groups were collected through audio recordings and professionally transcribed, followed by a content analysis guided by the Systems Engineering Initiative for Patient Safety and Human-Machine Teaming theoretical frameworks.

RESULTS

A total of 8 pharmacists participated in 3 rounds of focus groups to identify current challenges in medication dispensing verification, brainstorm solutions, and provide feedback on our AI prototype. Participants considered several teaming scenarios, generally favoring a hybrid teaming model where the AI assists in the verification process and a pharmacist intervenes based on medication risk level and the AI's confidence level. Pharmacists highlighted the need for improving the interpretability of AI systems, such as adding stepwise checkmarks, probability scores, and details about drugs the AI model frequently confuses with the target drug. Pharmacists emphasized the need for simplicity and accessibility. They favored displaying only essential information to prevent overwhelming users with excessive data. Specific design features, such as juxtaposing pill images with their packaging for quick comparisons, were requested. Pharmacists preferred accept, reject, or unsure options. The final prototype interface included (1) checkmarks to compare pill characteristics between the AI-predicted NDC and the prescription's expected NDC, (2) a histogram showing predicted probabilities for the AI-identified NDC, (3) an image of an AI-provided "confused" pill, and (4) an NDC match status (ie, match, unmatched, or unsure).

CONCLUSIONS

In partnership with pharmacists, we developed a human-centered AI prototype designed to enhance AI interpretability and foster trust. This initiative emphasized human-machine collaboration and positioned AI as an augmentative tool rather than a replacement. This study highlights the process of designing a human-centered AI for dispensing verification, emphasizing its interpretability, confidence visualization, and collaborative human-machine teaming styles.

Facilitators and barriers to blood pressure telemonitoring: A mixed-methods study

Background

Telemonitoring of blood pressure (BP) may improve BP control. However, many patients are not using BP telemonitoring due to personal, technological, and health system barriers. Individuals are required to have electronic health literacy (e-HL), defined as knowledge and skills to use technology services effectively, such as BP telemonitoring.

Objective

The objective was to determine the facilitators and barriers experienced by patients with hypertension in telemonitoring of BP using the e-HL framework (e-HLF).

Methods

This study was a prospective mixed-methods study using a convergent design. We recruited a convenience sample of 21 patients with hypertension. The qualitative section was online or phone individual in-depth interviews based on the e-HLF, which has seven domains. The quantitative section was an online survey consisting of demographics, an e-HL questionnaire, and patient-provider communication preferences. A joint display was used in the mixed-methods analysis.

Results

Five themes including knowledge, motivation, skills, systems, and behaviors along with 28 subthemes comprising facilitators or barriers of BP telemonitoring were identified. The mixed-methods results showed concordance between the participants' e-HL status and their experiences in the ability to actively engage with BP monitoring and managing digital services (domain 3) of the e-HLF. Other e-HL domains showed discordance.

Conclusion

Patients may engage with BP telemonitoring when they feel the usefulness of concurrent access to telemonitoring services that suit their needs.

Implementation outcomes of the Structured and Codified SIG format in electronic prescription directions

OBJECTIVE

To determine the extent of implementation, completeness, and accuracy of Structured and Codified SIG (S&C SIG) directions on electronic prescriptions (e-prescriptions).

MATERIALS AND METHODS

A retrospective analysis of a random sample of 3.8 million e-prescriptions sent from electronic prescribing (e-prescribing) software to outpatient pharmacies in the United States between 2019 and 2021. Natural language processing was used to identify direction components, including action verb, dose, frequency, route, duration, and indication from free-text directions and were compared to the S&C SIG format. Inductive qualitative analysis of S&C direction identified error types and frequencies for each component.

RESULTS

Implementation of the S&C SIG format in e-prescribing software resulted in 32.4% of e-prescriptions transmitted with these standardized directions. Directions using the S&C SIG format contained a greater percentage of each direction component compared to free-text directions, except for the indication component. Structured and codified directions contained quality issues in 10.3% of cases.

DISCUSSION

Expanding adoption of more diverse direction terminology for the S&C SIG formats can improve the coverage of directions using the S&C SIG format. Building out e-prescribing software interfaces to include more direction components can improve patient medication use and safety. Quality improvement efforts, such as improving the design of e-prescribing software and auditing for discrepancies, are needed to identify and eliminate implementation-related issues with direction information from the S&C SIG format so that e-prescription directions are always accurately represented.

CONCLUSION

Although directions using the S&C SIG format may result in more complete directions, greater adoption of the format and best practices for preventing its incorrect use are necessary.

Comparing the variability of ingredient, strength, and dose form information from electronic prescriptions with RxNorm drug product descriptions

OBJECTIVE

To determine the variability of ingredient, strength, and dose form information from drug product descriptions in real-world electronic prescription (e-prescription) data.

MATERIALS AND METHODS

A sample of 10 399 324 e-prescriptions from 2019 to 2021 were obtained. Drug product descriptions were analyzed with a named entity extraction model and National Drug Codes (NDCs) were used to get RxNorm Concept Unique Identifiers (RxCUI) via RxNorm. The number of drug product description variants for each RxCUI was determined. Variants identified were compared to RxNorm to determine the extent of matching terminology used.

RESULTS

A total of 353 002 unique pairs of drug product descriptions and NDCs were analyzed. The median (1st-3rd quartile) number of variants extracted for each standardized expression in RxNorm, was 3 (2-7) for ingredients, 4 (2-8) for strength, and 41 (11-122) for dosage forms. Of the pairs, 42.35% of ingredients (n = 328 032), 51.23% of strengths (n = 321 706), and 10.60% of dose forms (n = 326 653) used matching terminology, while 16.31%, 24.85%, and 13.05% contained nonmatching terminology, respectively.

DISCUSSION

A wide variety of drug product descriptions makes it difficult to determine whether 2 drug product descriptions describe the same drug product (eg, using abbreviations to describe an active ingredient or using different units to represent a concentration). This results in patient safety risks that lead to incorrect drug products being ordered, dispensed, and used by patients. Implementation and use of standardized terminology may reduce these risks.

CONCLUSION

Drug product descriptions on real-world e-prescriptions exhibit large variation resulting in unnecessary ambiguity and potential patient safety risks.

Predictors of Smartphone and Tablet Use Among Patients With Hypertension: Secondary Analysis of Health Information National Trends Survey Data

BACKGROUND

Uncontrolled hypertension leads to significant morbidity and mortality. The use of mobile health technology, such as smartphones, for remote blood pressure (BP) monitoring has improved BP control. An increase in BP control is more significant when patients can remotely communicate with their health care providers through technologies and receive feedback. Little is known about the predictors of remote BP monitoring among hypertensive populations.

OBJECTIVE

The objective of this study is to quantify the predictors of smartphone and tablet use in achieving health goals and communicating with health care providers via SMS text messaging among hypertensive patients in the United States.

METHODS

This study was a cross-sectional, secondary analysis of the 2017 and 2018 Health Information National Trends Survey 5, cycles 1 and 2 data. A total of 3045 respondents answered "Yes" to the question "Has a doctor or other healthcare provider ever told you that you had high blood pressure or hypertension?", which defined the subpopulation used in this study. We applied the Health Information National Trends Survey full sample weight to calculate the population estimates and 50 replicate weights to calculate the SEs of the estimates. We used design-adjusted descriptive statistics to describe the characteristics of respondents who are hypertensive based on relevant survey items. Design-adjusted multivariable logistic regression models were fitted to estimate predictors of achieving health goals with the help of smartphone or tablet and sending or receiving an SMS text message to or from a health care provider in the last 12 months.

RESULTS

An estimated 36.9%, SE 0.9% (183,285,150/497,278,883) of the weighted adult population in the United States had hypertension. The mean age of the hypertensive population was 58.3 (SE 0.48) years. Electronic communication with the doctor or doctor's office through email or internet (odds ratio 2.93, 95% CI 1.85-4.63; P<.001) and having a wellness app (odds ratio 1.82, 95% CI 1.16-2.86; P=.02) were significant predictors of using SMS text message communication with a health care professional, adjusting for other demographic and technology-related variables. The odds of achieving health-related goals with the help of a tablet or smartphone declined significantly with older age (P<.001) and ownership of basic cellphones (P=.04). However, they increased significantly with being a woman (P=.045) or with being married (P=.03), having a wellness app (P<.001), using devices other than smartphones or tablets to monitor health (P=.008), making health treatment decisions (P=.048), and discussing with a provider (P=.02) with the help of a tablet or smartphone.

CONCLUSIONS

Intervention measures accounting for age, gender, marital status, and the patient's technology-related health behaviors are required to increase smartphone and tablet use in self-care and SMS text message communication with health care providers.

Quality of Handoffs in Community Pharmacies

OBJECTIVES

The aims of the study were to characterize handoffs in community pharmacies and to examine factors that contribute to perceived handoff quality.

METHODS

A cross-sectional study of community pharmacists in a Midwest State of the United States. Self-administered questionnaires were used to collect information on participant and practice setting characteristics. Data were analyzed using descriptive statistics and multivariate logistic regression.

RESULTS

A total of 445 completed surveys were returned (response rate, 82%). In almost half of the time, handoffs that occur in a community pharmacy setting were inaccurate or incomplete. Nearly half of the time handoffs occur in environments full of interruptions and distractions. More than 90% of the respondents indicated that they have undergone no formal training on proper ways of handing off information. Nearly 40% of respondents reported that their pharmacy dispensing technology does not have adequate functionality to support handing off information and that at least 50% of the time, poor handoffs result in additional work to the pharmacist because of the need for complete information before providing patient care. Multivariate analysis showed that being very familiar with patients, lower daily prescription volume, not having a 24-hour operation, and larger percentage of handoffs occurring in a synchronous fashion are all associated with better handoff quality.

CONCLUSIONS

Handoffs occur frequently and are problematic in community pharmacies. Current pharmacy environments offer limited support to conduct good handoffs, and as a result, pharmacists report loss of information. This could present as a significant patient safety hazard. Future interventions should target facilitating better communication during shift changes.

Performance evaluation of a prescription medication image classification model: an observational cohort

Technology assistance of pharmacist verification tasks through the use of machine intelligence has the potential to detect dangerous and costly pharmacy dispensing errors. National Drug Codes (NDC) are unique numeric identifiers of prescription drug products for the United States Food and Drug Administration. The physical form of the medication, often tablets and capsules, captures the unique features of the NDC product to help ensure patients receive the same medication product inside their prescription bottle as is found on the label from a pharmacy. We report and evaluate using an automated check to predict the shape, color, and NDC for images showing a pile of pills inside a prescription bottle. In a test set containing 65,274 images of 345 NDC classes, overall macro-average precision was 98.5%. Patterns of incorrect NDC predictions based on similar colors, shapes, and imprints of pills were identified and recommendations to improve the model are provided.

Human versus machine editing of electronic prescription directions

BACKGROUND

Pharmacy staff are responsible for editing poor-quality and difficult-to-read electronic prescription (e-prescription) directions. Machine translation (MT) models are capable of translating free text from 1 sequence into another. However, the quality of MTs of e-prescriptions into pharmacy label directions is unknown.

OBJECTIVE

To determine the types and frequencies of e-prescription direction component errors made by an MT model, pharmacy staff, and prescribers.

METHODS

A prospective evaluation was conducted on a random sample of 300 patient directions in a test set of e-prescriptions from a mail-order pharmacy. Each row included directions produced by (1) prescribers on e-prescriptions, (2) pharmacy staff on prescription labels, and (3) an open neural MT model. Annotators labeled direction sets for missing direction components, use of abbreviations and medical jargon, and incorrect information (e.g., changing the number of tablets to be taken). The longest common subsequence (LCS) compared the amount of pharmacy staff editing with and without MT.

RESULTS

Out of 279 direction sets labeled, the MT model directions contained no quality issues in 196 (70.3%) samples compared with 187 (67.0%) and 83 (29.8%) samples for pharmacy staff directions and prescriber directions, respectively. The MT model directions contained more incorrect components (n = 23). Median LCS was greater without MT (30.0 vs. 18.5, P < 0.01, Wilcoxon signed-rank test), indicating more editing was needed.

CONCLUSION

MT could be used to improve the quality of e-prescription directions; however, MT makes high-risk mistakes such as incorrectly predicting the tapering regimen for prednisone. The use of semiautomated MT, where pharmacy staff can review model predictions to detect and resolve quality issues, should be considered to improve safety and decrease total work time compared with current practice. MT has strengths and weaknesses for improving the editing process of the patient directions compared with pharmacy staff alone.

Changes in Statin Use Among U.S. Adults With Diabetes: A Population-Based Analysis of NHANES 2011-2018

OBJECTIVE

To evaluate statin use in the U.S. before and after the 2015 American Diabetes Association position statement, which expanded statin therapy recommendations to include all adults 40-75 years old with diabetes.

RESEARCH DESIGN AND METHODS

The National Health and Nutrition Examination Survey (NHANES) was used to obtain a representative sample. The difference-in-differences technique determined the impact of the recommendation on the proportion of people with diabetes for whom statin therapy was newly recommended.

RESULTS

Among people with diabetes, the change in statin use in people without atherosclerotic cardiovascular disease (ASCVD) risk factors, controlling for change among people with ASCVD/risk factors, was 6.6% (P = 0.388). In the adjusted analysis, overt ASCVD, age, Black race, health insurance, a place for routine care, and total cholesterol were significantly associated with statin use (P < 0.05).

CONCLUSIONS

The most recent change in statin recommendations had minimal impact on the proportion of patients receiving a statin.

Evaluation of Patient Safety Culture in Community Pharmacies

OBJECTIVE

Medication errors are common in community pharmacies. Safety culture is considered a factor for medication safety but has not been measured in this setting. The objectives of this study were to describe safety culture measured using the Agency for Healthcare Research and Quality (AHRQ) Community Pharmacy Survey on Patient Safety Culture and to assess predictors of overall patient safety.

METHODS

This is a cross-sectional survey of community pharmacists practicing in Wisconsin measuring safety culture. Demographic variables collected included pharmacist and pharmacy characteristics. Data were analyzed using descriptive statistics, χ, and multivariate logistic regression analyses.

RESULTS

A total of 445 surveys were completed (response rate, 82%). Safety culture was positively associated with the following: an independent pharmacy (adjusted odds ratio [AOR], 1.69; 95% confidence interval [CI], 1.11-2.57), a health maintenance organization or clinic (AOR, 2.25; 95% CI, 1.34-3.78), being somewhat familiar with patients (AOR, 3.35; 95% CI, 1.82-6.19), or very/extremely familiar with patients (AOR, 8.8; 95% CI, 4.68-16.59). Five of the composite scores differed significantly from the results of the AHRQ pilot study (response to mistakes, communication openness, organizational learning-continuous improvement, communication about prescriptions across shifts, and overall patient safety). Consistent with the AHRQ pilot study, the composite describing staffing, work pressure, and pace had the lowest score (37.6%).

CONCLUSIONS

Understanding the safety culture of community pharmacies can help identify areas of strength and those that require improvement. Improvement efforts that focus on staffing, work pressure, and pace in community pharmacies may lead to better safety culture.

Work effort, readability and quality of pharmacy transcription of patient directions from electronic prescriptions: a retrospective observational cohort analysis

Background

Free-text directions generated by prescribers in electronic prescriptions can be difficult for patients to understand due to their variability, complexity and ambiguity. Pharmacy staff are responsible for transcribing these directions so that patients can take their medication as prescribed. However, little is known about the quality of these transcribed directions received by patients.

Methods

A retrospective observational analysis of 529 990 e-prescription directions processed at a mail-order pharmacy in the USA. We measured pharmacy staff editing of directions using string edit distance and execution time using the Keystroke-Level Model. Using the New Dale-Chall (NDC) readability formula, we calculated NDC cloze scores of the patient directions before and after transcription. We also evaluated the quality of directions (eg, included a dose, dose unit, frequency of administration) before and after transcription with a random sample of 966 patient directions.

Results

Pharmacy staff edited 83.8% of all e-prescription directions received with a median edit distance of 18 per e-prescription. We estimated a median of 6.64 s of transcribing each e-prescription. The median NDC score increased by 68.6% after transcription (26.12 vs 44.03, p<0.001), which indicated a significant readability improvement. In our sample, 51.4% of patient directions on e-prescriptions contained at least one pre-defined direction quality issue. Pharmacy staff corrected 79.5% of the quality issues.

Conclusion

Pharmacy staff put significant effort into transcribing e-prescription directions. Manual transcription removed the majority of quality issues; however, pharmacy staff still miss or introduce following their manual transcription processes. The development of tools and techniques such as a comprehensive set of structured direction components or machine learning–based natural language processing techniques may help produce clear directions.

Detecting Potential Medication Selection Errors During Outpatient Pharmacy Processing of Electronic Prescriptions With the RxNorm Application Programming Interface: Retrospective Observational Cohort Study

BACKGROUND

Medication errors are pervasive. Electronic prescriptions (e-prescriptions) convey secure and computer-readable prescriptions from clinics to outpatient pharmacies for dispensing. Once received, pharmacy staff perform a transcription task to select the medications needed to process e-prescriptions within their dispensing software. Later, pharmacists manually double-check medications selected to fulfill e-prescriptions before dispensing to the patient. Although pharmacist double-checks are mostly effective for catching medication selection mistakes, the cognitive process of medication selection in the computer is still prone to error because of heavy workload, inattention, and fatigue. Leveraging health information technology to identify and recover from medication selection errors can improve patient safety.

OBJECTIVE

This study aimed to determine the performance of an automated double-check of pharmacy prescription records to identify potential medication selection errors made in outpatient pharmacies with the RxNorm application programming interface (API).

METHODS

We conducted a retrospective observational analysis of 537,710 pairs of e-prescription and dispensing records from a mail-order pharmacy for the period January 2017 to October 2018. National Drug Codes (NDCs) for each pair were obtained from the National Library of Medicine's (NLM's) RxNorm API. The API returned RxNorm concept unique identifier (RxCUI) semantic clinical drug (SCD) identifiers associated with every NDC. The SCD identifiers returned for the e-prescription NDC were matched against the corresponding SCD identifiers from the pharmacy dispensing record NDC. An error matrix was created based on the hand-labeling of mismatched SCD pairs. Performance metrics were calculated for the e-prescription-to-dispensing record matching algorithm for both total pairs and unique pairs of NDCs in these data.

RESULTS

We analyzed 527,881 e-prescription and pharmacy dispensing record pairs. Four clinically significant cases of mismatched RxCUI identifiers were detected (ie, three different ingredient selections and one different strength selection). A total of 546 less significant cases of mismatched RxCUIs were found. Nearly all of the NDC pairs had matching RxCUIs (28,787/28,817, 99.90%-525,270/527,009, 99.67%). The RxNorm API had a sensitivity of 1, a false-positive rate of 0.00104 to 0.00312, specificity of 0.99896 to 0.99688, precision of 0.00727 to 0.04255, and F1 score of 0.01444 to 0.08163. We found 872 pairs of records without an RxCUI.

CONCLUSIONS

The NLM's RxNorm API can perform an independent and automatic double-check of correct medication selection to verify e-prescription processing at outpatient pharmacies. RxNorm has near-comprehensive coverage of prescribed medications and can be used to recover from medication selection errors. In the future, tools such as this may be able to perform automated verification of medication selection accurately enough to free pharmacists from having to perform manual double-checks of the medications selected within pharmacy dispensing software to fulfill e-prescriptions.

Effects of Race on Statin Prescribing for Primary Prevention With High Atherosclerotic Cardiovascular Disease Risk in a Large Healthcare System

Background

Although guidelines recommend statins with a high level of evidence for 4 primary prevention benefit groups, prescribing disparities still exist. The objective of this study was to evaluate the effects of race on statin prescribing for primary prevention.

Methods and Results

A retrospective cohort analysis of patients within a large academic health system was performed to investigate statin prescribing among primary prevention groups. The statin benefits groups were patients diagnosed with diabetes mellitus, with an low‐density lipoprotein ≥190 mg/dL, or with an atherosclerotic cardiovascular disease (ASCVD) 10‐year risk ≥7.5%. Statin prescribing was 20% in the ASCVD ≥7.5% group, followed by 37.8% in the low‐density lipoprotein ≥190 mg/dL group and 40.5% in the diabetes mellitus group. Blacks were less likely to be prescribed a statin compared with whites in the diabetes mellitus (odds ratio, 0.64; 95% CI, 0.49–0.82; P=0.001) and ASCVD ≥7.5% groups (odds ratio, 0.38; 95% CI, 0.26–0.54; P<0.0001). Blacks 60 to 69 years of age (odds ratio, 7.97; 95% CI, 3.14–20.2; P=0.003) and 70 to 79 years of age (odds ratio, 4.21; 95% CI, 1.81–9.79; P=0.008) were more likely to be prescribed a statin compared with blacks <60 years of age in the ASCVD ≥7.5% group.

Conclusions

Blacks are less likely to be prescribed statins in diabetes mellitus and ASCVD ≥7.5% groups compared with whites. Younger blacks with ASCVD risk ≥7.5% are less likely to be prescribed statins compared with older blacks. Future research should focus on tailored interventions to address statin prescribing disparities in blacks.

Medication Accuracy in Electronic Health Records for Microbial Keratitis

Importance

Electronic health records (EHRs) contain an abundance of health information. However, researchers need to understand data accuracy to ask appropriate research questions.

Objective

To investigate the concordance of the names of medications for microbial keratitis in the structured, formal EHR medication list and the text of clinicians' progress notes.

Design, Setting, and Participants

This cross-sectional study, conducted in the cornea section of an ophthalmology department in a tertiary care, referral academic medical center, examined the medications of 53 patients with microbial keratitis treated until disease resolution from July 1, 2015, to August 1, 2018. Documentation of medications was compared between the structured medication list extracted from the EHR server and medications written into the clinical progress note and transcribed by the study team.

Exposure

Medication treatment for microbial keratitis.

Main Outcomes and Measures

Medication mismatch frequency.

Results

The study sample included 24 men and 29 women, with a mean (SD) age of 51.8 (19.6) years. Of the 247 medications identified, 57 (23.1%) of prescribed medications differed between the progress notes and the formal EHR-based medication list. Reasons included medications not prescribed via the EHR ordering system (25 [43.9%]), outside medications not reconciled in the internal EHR medication list (23 [40.4%]), and medications prescribed via the EHR ordering system and in the formal list, but not described in the clinical note (9 [15.8%]). Fortified antimicrobials represented the largest category for medication mismatch between modalities (17 of 70 [24.3%]). Nearly one-third of patients (17 [32.1%]) had at least 1 medication mismatch in their record.

Conclusions and Relevance

Almost 1 in 4 medications were mismatched between the progress note and formal medication list in the EHR. These findings suggest that EHR data should be checked for internal consistency before use in research.

The Influence of a Community Pharmacy Automatic Prescription Refill Program on Medicare Part D Adherence Metrics

BACKGROUND

The Centers for Medicare & Medicaid Services (CMS) include measures of medication adherence within its Medicare Part D star ratings program. These adherence measures have motivated the development of new methods to improve patient adherence. Automatic prescription refill programs in community pharmacies are an intervention that has seen widespread adoption in recent years. These automatic refill programs anticipate and initiate prescription refills on a standardized, recurrent basis. As a result, prescription refills may be filled before a patient typically might initiate a refill. This study measures the effect of an automatic prescription refill program on 3 adherence metrics used by CMS within Medicare Part D star ratings.

OBJECTIVE

To compare the value of Medicare Part D adherence metrics for an automatic prescription refill program relative to standard prescription refills.

METHODS

Prescription dispensing data (January 1, 2014-December 31, 2014) from a chain of 29 pharmacies in a midwestern state were used to conduct this analysis. A post-only, quasi-experimental design separated patients into automatic and standard prescription refill cohorts. Refill adherence was calculated using proportion of days covered (PDC) for each of the 3 adherence metrics used by CMS for statins, renin angiotensin aldosterone system antagonists (RASA), and noninsulin diabetes medications. The adherence rate was defined as the proportion of patients with a PDC ± 80%. Inclusion criteria for patients followed the Pharmacy Quality Alliance technical specifications. Chi-square analysis and multiple logistic regression were used to examine differences in PDC > 80% between the 2 study cohorts.

RESULTS

There were 1,018, 1,006, and 368 patients for the automatic refill cohort and 3,928, 3,409, and 1,207 patients for the standard refill cohort in the statin, RASA, and diabetes adherence metrics, respectively. The mean age [SD] of patients was between 79.2 [±8.5] and 80.8 [±9.9] years across all cohorts. Patients in the automatic prescription refill program tended to take less than 1 additional chronic medication compared with the standard refill prescription cohort. The proportion of adherent patients ranged from 73.6% to 76.4% for standard refill cohorts and 77.5% to 83.6% for automatic refill cohorts. Differences between study cohorts were statistically significant for all the adherence metrics based on the chi-square test (P < 0.05). Patients enrolled in the automatic prescription refill program were more likely to be adherent to the statin (OR = 1.51, 95% CI = 1.26-1.82), RASA (OR = 1.20, 95% CI = 1.01-1.42), and diabetes (OR = 1.44, 95% CI = 1.06-1.96) metrics.

CONCLUSIONS

Patients enrolled in the automatic prescription refill program were more likely to be adherent to their medications. Enrollment in automatic prescription refill programs could be encouraged by health plans and pharmacists because of their potential effect on Medicare Part D star ratings.

DISCLOSURES

The project described was supported by the Clinical and Translational Science Award (CTSA) program through the NIH National Center for Advancing Translational Sciences (NCATS), grant UL1TR000427. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. Lester is employed as a pharmacist in the participating pharmacy chain. The authors report no other relevant conflict of interest. Study concept and design were primarily contributed by Lester, with assistance from the other authors. Lester took the lead in data collection, along with Chui, and data interpretation was performed by Lester, Mott, and Chui. The manuscript was written primarily by Lester, along with Mott, and revised by Lester, Mott, and Chui.

Is the Currently Used Prescription Adjudication Date a Good Proxy for Calculating Medication Refill Adherence?

BACKGROUND

The Centers for Medicare & Medicaid Services (CMS) adopted the proportion of days covered (PDC) calculation for use in their Five-Star Quality Rating System for Medicare Advantage and Prescription Drug Plans. This calculation uses the prescription adjudication date (i.e., date the prescription is billed to the benefits manager by a pharmacy) as a proxy for medication adherence. Adherence programs, such as automatic refill programs, have become commonplace in community pharmacy and have been identified by industry leaders as interfering with the ability to accurately measure adherence using PDC.

OBJECTIVE

To evaluate the prescription pickup date instead of the currently used adjudication date to calculate PDC in the presence of a community pharmacy automatic refill program.

METHODS

This study used a post-only quasi-experimental design with patients aged 65 years or older enrolled in automatic and manual refill programs in a 29-store community pharmacy chain during 2014. PDC was calculated using the prescription adjudication date and pickup date (i.e., date the patient brought the medication home) using pharmacy dispensing data for CMS adherence metrics medications, including statins, renin angiotensin aldosterone system antagonists (RASA), and noninsulin diabetes medications. Mann-Whitney U and effect size calculations evaluated differences in PDC between automatic and manual refill prescriptions for the adjudication date and pickup date, as well as the difference in PDC between adjudication and pickup date.

RESULTS

10,936 prescriptions were included with 21.9% enrolled in the automatic refill program. Mean (SD) adherence was 88.6 (17.6) and 86.4 (17.1) for automatic refills and 85.8 (19.0) and 85.0 (18.9) for manual refills, using the adjudication date and pickup date PDC, respectively. Significant difference existed between automatic and manual refill prescriptions using the adjudication date (P < 0.001) but not for the pickup date. The difference between adjudication and pickup date PDC ranged from 0% to 32.0% for automatic refills and 0% to 38.7% for manual refills. The difference between adjudication and pickup date PDC was significant when comparing automatic and manual refill prescriptions (P < 0.001).

CONCLUSIONS

The artificial inflation seen with adjudication date PDC indicates that the prescription pickup date is a more accurate reflection of patient medication taking. Automatic refills resulted in a less reliable PDC compared with manual refill prescriptions. Discussion about the continued use of the adjudication date to calculate PDC is needed.

DISCLOSURES

The project described was supported by the Clinical and Translational Science Award (CTSA) program through the NIH National Center for Advancing Translational Sciences (NCATS), grant UL1TR000427. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. Lester is employed as a pharmacist in the pharmacy chain that participated in this study. The authors report no other relevant conflict of interest. Study concept and design were contributed primarily by Lester, along with Look and Chui. Lester took the lead in data collection, along with Look, and data interpretation, along with Look and Chui. The manuscript was written and revised primarily by Lester, along with Look and Chui.

The prescription pickup lag, an automatic prescription refill program, and community pharmacy operations

OBJECTIVES

To determine the effect of an automatic prescription refill program on the prescription pickup lag in community pharmacy.

DESIGN

A post-only quasi-experimental design comparing automatic and manual refill prescription cohorts for each of the 3 Centers for Medicare and Medicaid medication adherence metrics.

SETTING

A 29-store community pharmacy chain in the Midwest.

PARTICIPANTS

Community-dwelling patients over the age of 65 years receiving prescription medications included in the statin, renin-angiotensin-aldosterone system antagonist, or non-insulin diabetes adherence metrics.

INTERVENTION

An automatic prescription refill program that initiated prescription refills on a standardized, recurrent basis, eliminating the need for patients to phone in or drop off prescription refills.

MAIN OUTCOME MEASURES

The prescription pickup lag, defined as the number of days between a prescription being adjudicated in the pharmacy and the prescription being picked up by the patient.

RESULTS

A total of 37,207 prescription fills were examined. There were 20.5%, 22.4%, and 23.3% of patients enrolled in the automatic prescription refill program for the statin, renin-angiotensin-aldosterone system antagonist, and diabetes adherence metrics, respectively. Prescriptions in the automatic prescription refill cohorts experienced a median pickup lag of 7 days compared with 1 day for the manual refill prescriptions. 35.2% of all manual refill prescriptions had a pickup lag of 0 days compared with 13% for automatic refills. However, 15.4% of automatic prescription refills had a pickup lag of greater than 14 days, compared with 4.8% of manual refills.

CONCLUSION

Prescriptions in the automatic prescription refill programs were associated with a significantly longer amount of time in the pharmacy before being picked up by the patient. This increased pickup lag may contribute positively by smoothing out workload demands of pharmacy staff, but may contribute negatively owing to an increased amount of rework and greater inventory requirements.

A preliminary examination of over-the-counter medication misuse rates in older adults

BACKGROUND

Older adults are the largest consumers of over the counter (OTC) medications. Of the older adults who are at risk of a major adverse drug event, more than 50% of these events involve an OTC medication.

OBJECTIVE

To explore how older adults select and hypothetically use OTC medications and if the selected medications would be considered safe for use.

METHODS

Walking interviews were conducted with 20 community-dwelling older adults in a community pharmacy. Each participant selected an OTC medication for a hypothetical pain and sleep scenario. Data were analyzed for four types of misuse: drug-drug interaction, drug-disease interaction, drug-age interaction, and excess usage.

RESULTS

At least one instance of potential misuse was found in 95% of participants. For sleep medications, drug-drug interactions and drug-age interactions were more common, affecting 50% and 65% of participants respectively. The most common type of misuse noted in the pain products selected was that of drug-drug interaction, with a total of 39 occurrences, affecting 60% of the participants.

CONCLUSIONS

OTC misuse is common among older adults, and it is important for older adults to seek out resources, such as a pharmacist, to help them make safe OTC decisions.

Using link analysis to explore the impact of the physical environment on pharmacist tasks

BACKGROUND

National community pharmacy organizations have been redesigning pharmacies to better facilitate direct patient care. However, evidence suggests that changing the physical layout of a pharmacy prior to understanding how the environment impacts pharmacists' work may not achieve the desired benefits. This study describes an objective method to understanding how the physical layout of the pharmacy may affect how pharmacists perform tasks.

METHOD

Link analysis is a systems engineering method used to describe the influence of the physical environment on task completion. This study used a secondary data set of field notes collected from 9 h of direct observation in one mass-merchandise community pharmacy in the U.S. State, Wisconsin. A node is an individual location in the environment. A link is the movement between two nodes. Tasks were inventoried and task themes identified. The mean, minimum, and maximum number of links needed to complete each task were then determined and used to construct a link table. A link diagram is a graphical display showing the links in conjunction with the physical layout of the pharmacy.

RESULTS

A total of 92 unique tasks were identified resulting in 221 links. Tasks were sorted into five themes: patient care activities, insurance issues, verifying prescriptions, filling prescriptions, and other. Insurance issues required the greatest number of links with a mean of 4.75. Verifying prescriptions and performing patient care were the most commonly performed tasks with 36 and 30 unique task occurrences, respectively.

CONCLUSION

Link analysis provides an objective method for identifying how a pharmacist interacts with the physical environment to complete tasks. This method provides designers with useful information to target interventions to improve the effectiveness of pharmacist work. Analysis beyond link analysis should be considered for large scale system redesign.

Psychometric properties of the AHRQ Community Pharmacy Survey on Patient Safety Culture: a factor analysis

BACKGROUND

The U.S. Agency for Healthcare Research and Quality (AHRQ) developed a hospital patient safety culture survey in 2004 and has adapted this survey to other healthcare settings, such as nursing homes and medical offices, and most recently, community pharmacies. However, it is unknown whether safety culture dimensions developed for hospitals can be transferred to community pharmacies. The aim of this study was to assess the psychometric properties of the Community Pharmacy Survey on Patient Safety Culture.

METHOD

The survey was administered to 543 community pharmacists in Wisconsin, USA. Confirmatory factor analysis was used to assess the fit of our data with the proposed AHRQ model. Exploratory factor analysis was used to determine the underlying factor structure. Internal consistency reliabilities were calculated.

RESULTS

A total of 433 usable surveys were returned (response rate 80%). Results from the confirmatory factor analysis showed inadequate model fit for the original 36 item, 11-factor structure. Exploratory factor analysis showed that a modified 27-item, four-factor structure better reflected the underlying safety culture dimensions in community pharmacies. The communication openness factor, with three items, dropped in its entirety while six items dropped from multiple factors. The remaining 27 items redistributed to form the four-factor structure: safety-related communication, staff training and work environment, organisational response to safety events, and staffing, work pressure and pace. Cronbach's α of 0.95 suggested good internal consistency.

CONCLUSIONS

Our findings suggest that validation studies need to be conducted before applying safety dimensions from other healthcare settings into community pharmacies.

Integrating Components of Medication Therapy Management Services into Community Pharmacy Workflow

Objective: The objective of this study was to develop and evaluate a process for integrating components of medication therapy management services into a community pharmacy workflow. Secondary objectives were to evaluate outcomes as well as patient and pharmacist satisfaction with this change. Methods: This prospective, 3-month observational study took place in a small, independent community pharmacy. This intervention included a redesigned work system that included a seated private desk area and focus on the pharmacist, rather than the technician, being the first contact when patients entered the pharmacy. Pharmacists participated in a focus group before and after the implementation of the new workflow to better understand the delivery of the intervention and assess satisfaction. Process outcomes included time spent with the patient, the number of medication-related problems identified and recommendations made, the type of disease education provided, type and number of immunizations administered, and health monitoring tests performed. Patient satisfaction surveys were distributed after completing the intervention during the third month of the study. Results: A total of 56 patients were enrolled in this study resulting in 82 encounters. Forty medication-related problems, including experiencing an adverse drug reaction and ineffective therapy, were identified with recommendations made to patients or prescribers. Disease education, such as goals of therapy, was provided 46 times. Health monitoring tests, such as blood pressure, were performed 16 times and eight immunizations were administered. The revised workflow incorporating components of MTM services was successful in that 39% of encounters were less than two minutes and 49% of encounters were between two and five minutes in length. Only 12% of encounters were greater than five minutes. Overall, patients were very satisfied with the intervention. Pharmacists responded positively, but expressed concern that the changes to the work system prevented them from overseeing technician functions. Conclusion: Pharmacists in community practice are able to provide components of medication therapy management services during a brief, face-to-face interaction with patients. Overall, patients and pharmacists were satisfied with the changes to the pharmacy work system and that additional work system changes are needed to further expand the role of the community pharmacist and facilitate patient-pharmacist interactions.   Type: Original Research

Lay CPR trainees: retraining, confidence and willingness to attempt resuscitation 4 years after training

Two independent samples of 800 lay CPR trainees from an original cohort of 7584 were surveyed postally 4 years after training. Only 2% of respondents had used CPR, but 92 had used other aspects of their life support training. Those who had retrained were more confident than those who had not and 89% of those who had not retrained were willing to do so. More than 80% expressed willingness to perform full CPR on casualties who were unknown to them, but this fell to 40% where facial blood was present and 48% where the victim was a gay man.

Evaluating CPR performance in basic life support: the VIDRAP protocol

This paper presents the second part of the validated Cardiff test for one rescuer basic life support skills, based on observation of video recording combined with the Recording Resusci Anne printout (VIDRAP). The authors believe that this is a robust evaluation tool which is capable of assessing the potential value to a casualty of a simulated resuscitation. The adoption of a widely accepted test methodology would facilitate comparison of research in different centres, which is not possible at present.

Assessing with CARE: an innovative method of testing the approach and casualty assessment components of basic life support, using video recording

The resuscitation community is now moving towards a set of basic life support guidelines but different countries and training centres have their own individual methods of instruction. It would be advantageous if a universal testing method were available to facilitate intercentre comparison. This could lead to an international course which had been rigorously assessed and evaluated. Taking this as a starting point, the Cardiff Assessment of Response and Evaluation (CARE) was developed. CARE is an innovative assessment technique using video recording for testing the preliminary steps of life support as outlined by the European Resuscitation Council. The assessment was validated by testing 67 members of the public who had been trained in cardiopulmonary resuscitation, 27 shortly after instruction and 40 between 6 and 18 months after instruction. All subjects were tested without prior warning and video recorded for independent scoring by two researchers and a paramedic training officer. Scores were compared using the k correlation which showed a high level of agreement between observers. Video recording and marking using the CARE schedule and guidelines is a reliable method for assessing the preliminary steps in life support.

Effectiveness of the BBC's 999 training roadshows on cardiopulmonary resuscitation: video performance of cohort of unforewarned participants at home six months afterwards

OBJECTIVE

To examine the competence of a cohort trained in cardiopulmonary resuscitation by the BBC's 999 training roadshows.

DESIGN

Descriptive cohort study applying an innovative testing procedure to a nationwide systematic sample. The test sample received an unsolicited home visit and without warning were required to perform cardiopulmonary resuscitation on a manikin while being videoed. The videos were then analysed for effectiveness and safety using the new test.

SETTING

Nine cities and surrounding areas in the United Kingdom.

SUBJECTS

280 people aged between 11 and 72.

RESULTS

Thirty three (12%) trainees were able to perform effective cardiopulmonary resuscitation, but of these 14 (5%) performed one or more elements in a way that was deemed to be potentially injurious. Thus only 19 (7%) trainees were able at six months to provide safe cardiopulmonary resuscitation. In addition, large numbers of subjects failed to shout for help, effectively assess the status of the patient, or alert an ambulance. Significantly better performances were recorded by those under 45 years old (31 (14%) v 2 (4%) gave effective performances respectively, P < 0.05), those who had attended a subsequent cardiopulmonary resuscitation course (8 (40%) v 25 (10%) gave effective performances respectively, P < 0.0001), and those confident in their initial ability (26 (20%) v 7 (6%) gave effective performances respectively, P < 0.005). Females were significantly less likely than males to perform procedures in a harmful way (117 (62%) v 10 (12%) performed safely respectively, P < 0.005).

CONCLUSION

Television is an effective means of generating large training cohorts. Volunteers will cooperate with unsolicited testing in their home, such testing being a realistic simulation of the stress and lack of forewarning that would surround a real event. Under such conditions the performance of cardiopulmonary resuscitation was disappointing. However, retraining greatly improves performance.

The need for wider dissemination of CPR skills: are schools the answer?

The value of instructing members of the public in CPR is now widely recognised, but community training schemes which rely largely on volunteers may fail to reach their targets. CPR training for lay people is often a once only activity and it has been shown that, without revision, skills deteriorate rapidly. By teaching CPR in secondary schools all social classes and ethnic groups could be reached, and retention of skills improved by regular revision. Health education has shown that it may be beneficial to use older pupils as instruction assistants.

Monitoring performance in the NHS. The district neural tube defect screening service

A small medical school team has developed a six item system (SIS) for monitoring the neural tube defect (NTD) screening service. SIS is discussed in relation to possible alternative monitoring systems and the advantages which led to its implementation are described. In July 1982 the system was introduced in three districts in South Wales and the first year's results are presented. These permit the local provision, written policies and clinical and management responsibility of the service to be examined and deficiencies in the relevant information systems to be identified. Of particular concern is the discovery that districts have no way of knowing the number of terminations for NTD, and thus their current NTD incidence. In view of these findings, it would seem advisable for all districts providing NTD screening to monitor their service. SIS provides a simple, cheap and effective monitoring system which could be easily implemented throughout England and Wales.