What works in medication reconciliation: an on-treatment and site analysis of the MARQUIS2 study

BACKGROUND

The second Multicenter Medication Reconciliation Quality Improvement Study demonstrated a marked reduction in medication discrepancies per patient. The aim of the current analysis was to determine the association of patient exposure to each system-level intervention and receipt of each patient-level intervention on these results.

METHODS

This study was conducted at 17 North American Hospitals, the study period was 18 months per site, and sites typically adopted interventions after 2-5 months of preintervention data collection. We conducted an on-treatment analysis (ie, an evaluation of outcomes based on patient exposure) of system-level interventions, both at the category level and at the individual component level, based on monthly surveys of implementation site leads at each site (response rate 65%). We then conducted a similar analysis of patient-level interventions, as determined by study pharmacist review of documented activities in the medical record. We analysed the association of each intervention on the adjusted number of medication discrepancies per patient in admission and discharge orders, based on a random sample of up to 22 patients per month per site, using mixed-effects Poisson regression with hospital site as a random effect. We then used a generalised linear mixed-effects model (GLMM) decision tree to determine which patient-level interventions explained the most variance in discrepancy rates.

RESULTS

Among 4947 patients, patient exposure to seven of the eight system-level component categories was associated with modest but significant reductions in discrepancy rates (adjusted rate ratios (ARR) 0.75-0.97), as were 15 of the 17 individual system-level intervention components, including hiring, reallocating and training personnel to take a best possible medication history (BPMH) and training personnel to perform discharge medication reconciliation and patient counselling. Receipt of five of seven patient-level interventions was independently associated with large reductions in discrepancy rates, including receipt of a BPMH in the emergency department (ED) by a trained clinician (ARR 0.40, 95% CI 0.37 to 0.43), admission medication reconciliation by a trained clinician (ARR 0.57, 95% CI 0.50 to 0.64) and discharge medication reconciliation by a trained clinician (ARR 0.64, 95% CI 0.57 to 0.73). In GLMM decision tree analyses, patients who received both a BPMH in the ED and discharge medication reconciliation by a trained clinician experienced the lowest discrepancy rates (0.08 per medication per patient).

CONCLUSION AND RELEVANCE

Patient-level interventions most associated with reductions in discrepancies were receipt of a BPMH of admitted patients in the ED and admission and discharge medication reconciliation by a trained clinician. System-level interventions were associated with modest reduction in discrepancies for the average patient but are likely important to support patient-level interventions and may reach more patients. These findings can be used to help hospitals and health systems prioritise interventions to improve medication safety during care transitions.

Safer Type 1 Diabetes Care at Home: SEIPS-based Process Mapping with Parents and Clinicians

Introduction

The limited data indicate that pediatric medical errors in the outpatient setting, including at home, are common. This study is the first step of our Ambulatory Pediatric Patient Safety Learning Lab to address medication errors and treatment delays among children with T1D in the outpatient setting. We aimed to identify failures and potential solutions associated with medication errors and treatment delays among outpatient children with T1D.

Methods

A transdisciplinary team of parents, safety researchers, and clinicians used Systems Engineering Initiative for Patient Safety (SEIPS) based process mapping of data we collected through in-home medication review, observation of administration, chart reviews, parent surveys, and failure modes and effects analysis (FMEA).

Results

Eight (57%) of the 14 children who had home visits experienced 18 errors (31 per 100 medications). Four errors in two children resulted in harm, and 13 had the potential for harm. Two injuries occurred when parents failed to treat severe hypoglycemia and lethargy, and two were due to repeated failures to administer insulin at home properly. In SEIPS-based process maps, high-risk errors occurred during communication between the clinic and home or in management at home. Two FMEAs identified interventions to better communicate with families and support home care, especially during evolving illness.

Conclusion

Using SEIPS-based process maps informed by multimodal methods to identify medication errors and treatment delays, we found errors were common. Better support for managing acute illness at home and improved communication between the clinic and home are potentially high-yield interventions.

Effects of a refined evidence-based toolkit and mentored implementation on medication reconciliation at 18 hospitals: results of the MARQUIS2 study

BACKGROUND

The first Multicenter Medication Reconciliation Quality Improvement (QI) Study (MARQUIS1) demonstrated that mentored implementation of a medication reconciliation best practices toolkit decreased total unintentional medication discrepancies in five hospitals, but results varied by site. The objective of this study was to determine the effects of a refined toolkit on a larger group of hospitals.

METHODS

We conducted a pragmatic quality improvement study (MARQUIS2) at 18 North American hospitals or hospital systems from 2016 to 2018. Incorporating lessons learnt from MARQUIS1, we implemented a refined toolkit, offering 17 system-level and 6 patient-level interventions. One of eight physician mentors coached each site via monthly calls and performed one to two site visits. The primary outcome was number of unintentional medication discrepancies in admission or discharge orders per patient. Time series analysis used multivariable Poisson regression.

RESULTS

A total of 4947 patients were sampled, including 1229 patients preimplementation and 3718 patients postimplementation. Both the number of system-level interventions adopted per site and the proportion of patients receiving patient-level interventions increased over time. During the intervention, patients experienced a steady decline in their medication discrepancy rate from 2.85 discrepancies per patient to 0.98 discrepancies per patient. An interrupted time series analysis of the 17 sites with sufficient data for analysis showed the intervention was associated with a 5% relative decrease in discrepancies per month over baseline temporal trends (adjusted incidence rate ratio: 0.95, 95% CI 0.93 to 0.97, p<0.001). Receipt of patient-level interventions was associated with decreased discrepancy rates, and these associations increased over time as sites adopted more system-level interventions.

CONCLUSION

A multicentre medication reconciliation QI initiative using mentored implementation of a refined best practices toolkit, including patient-level and system-level interventions, was associated with a substantial decrease in unintentional medication discrepancies over time. Future efforts should focus on sustainability and spread.

Medication Safety in Two Intensive Care Units of a Community Teaching Hospital After Electronic Health Record Implementation: Sociotechnical and Human Factors Engineering Considerations

OBJECTIVE

The aim of the study was to assess the impact of Electronic Health Record (EHR) implementation on medication safety in two intensive care units (ICUs).

METHODS

Using a prospective pre-post design, we assessed 1254 consecutive admissions to two ICUs before and after an EHR implementation. Each medication event was evaluated with regard to medication error (error type, medication-management stage) and impact on patient (severity of potential or actual harm).

RESULTS

We identified 4063 medication-related events either pre-implementation (2074 events) or post-implementation (1989 events). Although the overall potential for harm due to medication errors decreased post-implementation only 2 of the 3 error rates were significantly lower post-implementation. After EHR implementation, we observed reductions in rates of medication errors per admission at the stages of transcription (0.13-0, P < 0.001), dispensing (0.49-0.16, P < 0.001), and administration (0.83-0.56, P = 0.011). Within the ordering stage, 4 error types decreased post-implementation (orders with omitted information, error-prone abbreviations, illegible orders, failure to renew orders) and 4 error types increased post-implementation (orders of wrong drug, orders containing a wrong start or stop time, duplicate orders, orders with inappropriate or wrong information). Within the administration stage, we observed a reduction of late administrations and increases in omitted administrations and incorrect documentation.

CONCLUSIONS

Electronic Health Record implementation in two ICUs was associated with both improvement and worsening in rates of specific error types. Further safety improvements require a nuanced understanding of how various error types are influenced by the technology and the sociotechnical work system of the technology implementation. Recommendations based on human factors engineering principles are provided for reducing medication errors.

Remembering Ben-Tzion Karsh's scholarship, impact, and legacy

Dr. Ben-Tzion (Bentzi) Karsh was a mentor, collaborator, colleague, and friend who profoundly impacted the fields of human factors and ergonomics (HFE), medical informatics, patient safety, and primary care, among others. In this paper we honor his contributions by reflecting on his scholarship, impact, and legacy in three ways: first, through an updated simplified bibliometric analysis in 2020, highlighting the breadth of his scholarly impact from the perspective of the number and types of communities and collaborators with which and whom he engaged; second, through targeted reflections on the history and impact of Dr. Karsh's most cited works, commenting on the particular ways they impacted our academic community; and lastly, through quotes from collaborators and mentees, illustrating Dr. Karsh's long-lasting impact on his contemporaries and students.

It's time to bring human factors to primary care policy and practice

Primary health care is a complex, highly personal, and non-linear process. Care is often sub-optimal and professional burnout is high. Interventions intended to improve the situation have largely failed. This is due to a lack of a deep understanding of primary health care. Human Factors approaches and methods will aid in understanding the cognitive, social and technical needs of these specialties, and in designing and testing proposed innovations. In 2012, Ben-Tzion Karsh, Ph.D., conceived a transdisciplinary conference to frame the opportunities for research human factors and industrial engineering in primary care. In 2013, this conference brought together experts in primary care and human factors to outline areas where human factors methods can be applied. The results of this expert consensus panel highlighted four major research areas: Cognitive and social needs, patient engagement, care of community, and integration of care. Work in these areas can inform the design, implementation, and evaluation of innovations in Primary Care. We provide descriptions of these research areas, highlight examples and give suggestions for future research.

Impact of family-centered tailoring of pediatric diabetes self-management resources

BACKGROUND

The American Diabetes Association recommends a family-centered approach that addresses each family's specific type 1 diabetes self-management barriers.

OBJECTIVE

To assess an intervention that tailored delivery of self-management resources to families' specific self-management barriers.

SUBJECTS

At two sites, 214 children 8-16 years old with type 1 diabetes and their parent(s) were randomized to receive tailored self-management resources (intervention, n = 106) or usual care (n = 108).

METHODS

Our intervention (1) identified families' self-management barriers with a validated survey, (2) tailored self-management resources to identified barriers, and (3) delivered the resources as four group sessions coordinated with diabetes visits. Mixed effects models with repeated measures were fit to A1c as well as parent and child QOL during the intervention and 1 year thereafter.

RESULTS

Participants were 44% youth (8-12 years) and 56% teens (13-16 years). No intervention effect on A1c or QOL was shown, combining data from sites and age groups. Analyzing results by site and age group, post-intervention A1c for teens at one site declined by 0.06 more per month for intervention teens compared to usual care (P < 0.05). In this group, post-intervention A1c declined significantly when baseline A1c was >8.5 (-0.08, P < 0.05), with an even larger decline when baseline A1c was >10 (-0.19, P < 0.05). In addition, for these teens, the significant improvements in A1c resulted from addressing barriers related to motivation to self-manage. Also at this site, mean QOL increased by 0.61 points per month more during the intervention for parents of intervention youth than for usual care youth (P < 0.05).

CONCLUSIONS

Tailored self-management resources may improve outcomes among specific populations, suggesting the need to consider families' self-management barriers and patient characteristics before implementing self-management resources.

An On-Treatment Analysis of the MARQUIS Study: Interventions to Improve Inpatient Medication Reconciliation

It is unclear which medication reconciliation interventions are most effective at reducing inpatient medication discrepancies. Five United States hospitals' interdisciplinary quality improvement (QI) teams were virtually mentored by QI-trained physicians. Sites implemented one to seven evidence-based interventions in 791 patients during the 25-month implementation period. Three interventions were associated with significant decreases in potentially harmful discrepancy rates: (1) defining clinical roles and responsibilities, (2) training, and (3) hiring staff to perform discharge medication reconciliation. Two interventions were associated with significant increases in potentially harmful discrepancy rates: training staff to take medication histories and implementing a new electronic health record (EHR). Hospitals should focus first on hiring and training pharmacy staff to assist with medication reconciliation at discharge and delineating roles and responsibilities of clinical staff. We caution hospitals implementing a large vendor EHR, as medication discrepancies may increase. Finally, the effect of medication history training on discrepancies needs further study.

Effects of a multifaceted medication reconciliation quality improvement intervention on patient safety: final results of the MARQUIS study

BACKGROUND

Unintentional discrepancies across care settings are a common form of medication error and can contribute to patient harm. Medication reconciliation can reduce discrepancies; however, effective implementation in real-world settings is challenging.

METHODS

We conducted a pragmatic quality improvement (QI) study at five US hospitals, two of which included concurrent controls. The intervention consisted of local implementation of medication reconciliation best practices, utilising an evidence-based toolkit with 11 intervention components. Trained QI mentors conducted monthly site phone calls and two site visits during the intervention, which lasted from December 2011 through June 2014. The primary outcome was number of potentially harmful unintentional medication discrepancies per patient; secondary outcome was total discrepancies regardless of potential for harm. Time series analysis used multivariable Poisson regression.

RESULTS

Across five sites, 1648 patients were sampled: 613 during baseline and 1035 during the implementation period. Overall, potentially harmful discrepancies did not decrease over time beyond baseline temporal trends, adjusted incidence rate ratio (IRR) 0.97 per month (95% CI 0.86 to 1.08), p=0.53. The intervention was associated with a reduction in total medication discrepancies, IRR 0.92 per month (95% CI 0.87 to 0.97), p=0.002. Of the four sites that implemented interventions, three had reductions in potentially harmful discrepancies. The fourth site, which implemented interventions and installed a new electronic health record (EHR), saw an increase in discrepancies, as did the fifth site, which did not implement any interventions but also installed a new EHR.

CONCLUSIONS

Mentored implementation of a multifaceted medication reconciliation QI initiative was associated with a reduction in total, but not potentially harmful, medication discrepancies. The effect of EHR implementation on medication discrepancies warrants further study.

TRIAL REGISTRATION NUMBER

NCT01337063.

Meaningful use's benefits and burdens for US family physicians

Objective

The federal meaningful use (MU) program was aimed at improving adoption and use of electronic health records, but practicing physicians have criticized it. This study was aimed at quantifying the benefits (ie, usefulness) and burdens (ie, workload) of the MU program for practicing family physicians.

Materials and Methods

An interdisciplinary national panel of experts (physicians and engineers) identified the work associated with MU criteria during patient encounters. They conducted a national survey to assess each criterion's level of patient benefit and compliance burden.

Results

In 2015, 480 US family physicians responded to the survey. Their demographics were comparable to US norms. Eighteen of 31 MU criteria were perceived as useful for more than half of patient encounters, with 13 of those being useful for more than two-thirds. Thirteen criteria were useful for less than half of patient encounters. Four useful criteria were reported as having a high compliance burden.

Discussion

There was high variability in physicians' perceived benefits and burdens of MU criteria. MU Stage 1 criteria, which are more related to basic/routine care, were perceived as beneficial by most physicians. Stage 2 criteria, which are more related to complex and population care, were perceived as less beneficial and more burdensome to comply with.

Conclusion

MU was discontinued, but the merit-based incentive payment system within the Medicare Access and CHIP Reauthorization Act of 2015 adopted its criteria. For many physicians, MU created a significant practice burden without clear benefits to patient care. This study suggests that policymakers should not assess MU in aggregate, but as individual criteria for open discussion.

Design and baseline data from a PCORI-funded randomized controlled trial of family-centered tailoring of diabetes self-management resources

This article describes the methodology, recruitment, participant characteristics, and sustained, intensive stakeholder engagement for Project ACE (Achieving control, Connecting resources, Empowering families). Project ACE is a randomized controlled trial of children and youth ages 8-16 with type 1 diabetes evaluating the impact of tailored self-management resources on hemoglobin A1c (A1c) and quality of life (QOL). Despite strong evidence that controlling A1c reduces long-term complications, <25% of US youth with type 1 diabetes meet A1c targets. Many interventions are efficacious in improving A1c and QOL for these youth, whose families often struggle with the substantial demands of the treatment regimen. However, most such interventions are ineffective in the real world due to lack of uptake by families and limited healthcare system resources. Project ACE is a multi-site trial designed to improve diabetes outcomes by tailoring existing, evidence-based interventions to meet families' needs and preferences. We hypothesize that this family-centered approach will result in better A1c and QOL than usual care. Project ACE has recruited and randomized 214 eligible 8-16year old youth and their parents. The 9-month intervention consisted of 4 group sessions tailored to families' self-management barriers as identified by a validated instrument. Outcomes including A1c and QOL for parents and youth will be assessed for 1year after the intervention. Stakeholder engagement was used to enhance this trial's recruitment, retention and integration into routine clinical care. Findings will inform implementation and dissemination of family-centered approaches to address self-management barriers.

TRIAL REGISTRATION NUMBER

NCT02024750 Trial Registrar: Clinicaltrials.gov, https://clinicaltrials.gov/ct2/show/NCT02024750.

A Family-Centered Rounds Checklist, Family Engagement, and Patient Safety: A Randomized Trial

BACKGROUND AND OBJECTIVES

Family-centered rounds (FCRs) have become standard of care, despite the limited evaluation of FCRs' benefits or interventions to support high-quality FCR delivery. This work examines the impact of the FCR checklist intervention, a checklist and associated provider training, on performance of FCR elements, family engagement, and patient safety.

METHODS

This cluster randomized trial involved 298 families. Two hospital services were randomized to use the checklist; 2 others delivered usual care. We evaluated the performance of 8 FCR checklist elements and family engagement from 673 pre- and postintervention FCR videos and assessed the safety climate with the Children's Hospital Safety Climate Questionnaire. Random effects regression models were used to assess intervention impact.

RESULTS

The intervention significantly increased the number of FCR checklist elements performed (β = 1.2, P < .001). Intervention rounds were significantly more likely to include asking the family (odds ratio [OR] = 2.43, P < .05) or health care team (OR = 4.28, P = .002) for questions and reading back orders (OR = 12.43, P < .001). Intervention families' engagement and reports of safety climate were no different from usual care. However, performance of specific checklist elements was associated with changes in these outcomes. For example, order read-back was associated with significantly more family engagement. Asking families for questions was associated with significantly better ratings of staff's communication openness and safety of handoffs and transitions.

CONCLUSIONS

The performance of FCR checklist elements was enhanced by checklist implementation and associated with changes in family engagement and more positive perceptions of safety climate. Implementing the checklist improves delivery of FCRs, impacting quality and safety of care.

Healthcare Team Perceptions of a Portal for Parents of Hospitalized Children Before and After Implementation

BACKGROUND

Patient electronic health record (EHR) portals can enhance patient and family engagement by providing information and a way to communicate with their healthcare team (HCT). However, portal implementation has been limited to ambulatory settings and met with resistance from HCTs.

OBJECTIVE

We evaluated HCT perceptions before and 6-months after implementation of an inpatient EHR portal application on a tablet computer given to parents of hospitalized children.

METHODS

This repeated cross-sectional study was conducted with HCT members (nurses, physicians, ancillary staff) on a medical/surgical unit at a quaternary children's hospital. From December 2014-June 2015, parents of children <12 years old were given a portal application on a tablet computer. It provided real-time vitals, medications, lab results, schedules, education, HCT information and a way to send the HCT messages/requests. HCT members completed surveys pre- and post-implementation regarding their portal perceptions. Pre-post differences in HCT perceptions were compared using chi-squared, Mann-Whitney and Kruskall Wallis tests.

RESULTS

Pre-implementation, HCT respondents (N=94) were generally optimistic about the benefits of a portal for parents; however, all anticipated challenges to portal use. Over the next 6-months, 296 parents used the portal, sending 176 requests and 36 messages. Post-implementation, HCT respondent (N=70) perceptions of these challenges were significantly reduced (all p<0.001), including: parents (will) have too many questions (69 vs. 3%, pre-post), parents (will) know results before the HCT (65 vs. 1%), staff (would be/are) skeptical (43 vs. 21%) and there (will be/is) not enough technical support (28 vs. 1%).

CONCLUSIONS

All HCT respondents anticipated challenges in providing a portal to parents of hospitalized children; however, these concerns were minimized after implementation.

EHR-related medication errors in two ICUs

The objective of this study was to describe the frequency, potential harm, and nature of electronic health record (EHR)-related medication errors in intensive care units (ICUs). Using a secondary data analysis of a large database of medication safety events collected in a study on EHR technology in ICUs, we assessed the EHR relatedness of a total of 1622 potential preventable adverse drug events (ADEs) identified in a sample of 624 patients in 2 ICUs of a medical center. Thirty-four percent of the medication events were found to be EHR related. The EHR-related medication events had greater potential for more serious patient harm and occurred more frequently at the ordering stage as compared to non-EHR-related events. Examples of EHR-related events included orders with omitted information and duplicate orders. The list of EHR-related medication errors can be used by health care delivery organizations to monitor implementation and use of the technology and its impact on patient safety. Health information technology (IT) vendors can use the list to examine whether their technology can mitigate or reduce EHR-related medication errors.

The myth of standardized workflow in primary care

OBJECTIVE

Primary care efficiency and quality are essential for the nation's health. The demands on primary care physicians (PCPs) are increasing as healthcare becomes more complex. A more complete understanding of PCP workflow variation is needed to guide future healthcare redesigns.

METHODS

This analysis evaluates workflow variation in terms of the sequence of tasks performed during patient visits. Two patient visits from 10 PCPs from 10 different United States Midwestern primary care clinics were analyzed to determine physician workflow. Tasks and the progressive sequence of those tasks were observed, documented, and coded by task category using a PCP task list. Variations in the sequence and prevalence of tasks at each stage of the primary care visit were assessed considering the physician, the patient, the visit's progression, and the presence of an electronic health record (EHR) at the clinic.

RESULTS

PCP workflow during patient visits varies significantly, even for an individual physician, with no single or even common workflow pattern being present. The prevalence of specific tasks shifts significantly as primary care visits progress to their conclusion but, notably, PCPs collect patient information throughout the visit.

DISCUSSION

PCP workflows were unpredictable during face-to-face patient visits. Workflow emerges as the result of a "dance" between physician and patient as their separate agendas are addressed, a side effect of patient-centered practice.

CONCLUSIONS

Future healthcare redesigns should support a wide variety of task sequences to deliver high-quality primary care. The development of tools such as electronic health records must be based on the realities of primary care visits if they are to successfully support a PCP's mental and physical work, resulting in effective, safe, and efficient primary care.

A matter of priorities? Exploring the persistent gender pay gap in hospital medicine

BACKGROUND

Gender earnings disparities among physicians exist even after considering differences in specialty, part-time status, and practice type. Little is known about the role of job satisfaction priorities on earnings differences.

OBJECTIVE

To examine gender differences in work characteristics and job satisfaction priorities, and their relationship with gender earnings disparities among hospitalists.

DESIGN

Observational cross-sectional survey study.

PARTICIPANTS

US hospitalists in 2010.

MEASUREMENTS

Self-reported income, work characteristics, and priorities among job satisfaction domains.

RESULTS

On average, women compared to men hospitalists were younger, less likely to be leaders, worked fewer full-time equivalents, worked more nights, reported fewer daily billable encounters, more were pediatricians, worked in university settings, worked in the Western United States, and were divorced. More hospitalists of both genders prioritized optimal workload among the satisfaction domains. However, substantial pay ranked second in prevalence by men and fourth by women. Women hospitalists earned $14,581 less than their male peers in an analysis adjusting for these differences.

CONCLUSIONS

The gender earnings gap persists among hospitalists. A portion of the disparity is explained by the fewer women hospitalists compared to men who prioritize pay.

Application of participatory ergonomics to the redesign of the family-centred rounds process

Participatory ergonomics (PE) can promote the application of human factors and ergonomics (HFE) principles to healthcare system redesign. This study applied a PE approach to redesigning the family-centred rounds (FCR) process to improve family engagement. Various FCR stakeholders (e.g. patients and families, physicians, nurses, hospital management) were involved in different stages of the PE process. HFE principles were integrated in both the content (e.g. shared mental model, usability, workload consideration, systems approach) and process (e.g. top management commitment, stakeholder participation, communication and feedback, learning and training, project management) of FCR redesign. We describe activities of the PE process (e.g. formation and meetings of the redesign team, data collection activities, intervention development, intervention implementation) and present data on PE process evaluation. To demonstrate the value of PE-based FCR redesign, future research should document its impact on FCR process measures (e.g. family engagement, round efficiency) and patient outcome measures (e.g. patient satisfaction).

Impact of electronic health record technology on the work and workflow of physicians in the intensive care unit

OBJECTIVE

To assess the impact of EHR technology on the work and workflow of ICU physicians and compare time spent by ICU resident and attending physicians on various tasks before and after EHR implementation.

DESIGN

EHR technology with electronic order management (CPOE, medication administration and pharmacy system) and physician documentation was implemented in October 2007.

MEASUREMENT

We collected a total of 289 h of observation pre- and post-EHR implementation. We directly observed the work of residents in three ICUs (adult medical/surgical ICU, pediatric ICU and neonatal ICU) and attending physicians in one ICU (adult medical/surgical ICU).

RESULTS

EHR implementation had an impact on the time distribution of tasks as well as the temporal patterns of tasks. After EHR implementation, both residents and attending physicians spent more of their time on clinical review and documentation (40% and 55% increases, respectively). EHR implementation also affected the frequency of switching between tasks, which increased for residents (from 117 to 154 tasks per hour) but decreased for attendings (from 138 to 106 tasks per hour), and the temporal flow of tasks, in particular around what tasks occurred before and after clinical review and documentation. No changes in the time spent in conversational tasks or the physical care of the patient were observed.

CONCLUSIONS

The use of EHR technology has a major impact on ICU physician work (e.g., increased time spent on clinical review and documentation) and workflow (e.g., clinical review and documentation becoming the focal point of many other tasks). Further studies should evaluate the impact of changes in physician work on the quality of care provided.

Human factors systems approach to healthcare quality and patient safety

Human factors systems approaches are critical for improving healthcare quality and patient safety. The SEIPS (Systems Engineering Initiative for Patient Safety) model of work system and patient safety is a human factors systems approach that has been successfully applied in healthcare research and practice. Several research and practical applications of the SEIPS model are described. Important implications of the SEIPS model for healthcare system and process redesign are highlighted. Principles for redesigning healthcare systems using the SEIPS model are described. Balancing the work system and encouraging the active and adaptive role of workers are key principles for improving healthcare quality and patient safety.

Characterising the complexity of medication safety using a human factors approach: an observational study in two intensive care units

OBJECTIVE

To examine medication safety in two intensive care units (ICU), and to assess the complexity of medication errors and adverse drug events (ADE) in ICUs across the stages of the medication-management process.

METHODS

Four trained nurse data collectors gathered data on medication errors and ADEs between October 2006 and March 2007. Patient care documents (eg, medication order sheets, notes) and incident reports were used to identify medication errors and ADEs in a 24-bed adult medical/surgical ICU and an 18-bed cardiac ICU in a tertiary care, community teaching hospital. In this cross-sectional study, a total of 630 consecutive ICU patient admissions were assessed to produce data on the number, rates and types of potential and preventable ADEs across stages of the medication-management process.

RESULTS

An average of 2.9 preventable or potential ADEs occurred in each admission, that is, 0.4 events per patient-day. Preventable or potential ADEs occurred in 2.6% of the medication orders. The rate of potential ADEs per 1000 patient-days was 276, whereas the rate of preventable ADEs per 1000 patient-days was 9.2. Most medication errors occur at the ordering (32%) and administration stages (39%). In 16-24% of potential and preventable ADEs, clusters of errors occurred either as a sequence of errors (eg, delay in medication dispensing leading to delay in medication administration) or grouped errors (eg, route and frequency errors in the order for a medication). Many of the sequences led to administration errors that were caused by errors earlier in the medication-management process.

CONCLUSIONS

Understanding the complexity of the vulnerabilities of the medication-management process is important to devise solutions to improve patient safety. Electronic health record technology with computerised physician order entry may be one step necessary to improve medication safety in ICUs. Solutions that target multiple stages of the medication-management process are necessary to address sequential errors.

Macroergonomics in Healthcare Quality and Patient Safety

The US Institute of Medicine and healthcare experts have called for new approaches to manage healthcare quality problems. In this chapter, we focus on macroergonomics, a branch of human factors and ergonomics that is based on the systems approach and considers the organizational and sociotechnical context of work activities and processes. Selected macroergonomic approaches to healthcare quality and patient safety are described such as the SEIPS model of work system and patient safety and the model of healthcare professional performance. Focused reviews on job stress and burnout, workload, interruptions, patient-centered care, health IT and medical devices, violations, and care coordination provide examples of macroergonomics contributions to healthcare quality and patient safety. Healthcare systems and processes clearly need to be systematically redesigned; examples of macroergonomic approaches, principles and methods for healthcare system redesign are described. Further research linking macroergonomics and care processes/patient outcomes is needed. Other needs for macroergonomics research are highlighted, including understanding the link between worker outcomes (e.g., safety and well-being) and patient outcomes (e.g., patient safety), and macroergonomics of patient-centered care and care coordination.

Rationale and design of the Multicenter Medication Reconciliation Quality Improvement Study (MARQUIS)

Background

Unresolved medication discrepancies during hospitalization can contribute to adverse drug events, resulting in patient harm. Discrepancies can be reduced by performing medication reconciliation; however, effective implementation of medication reconciliation has proven to be challenging. The goals of the Multi-Center Medication Reconciliation Quality Improvement Study (MARQUIS) are to operationalize best practices for inpatient medication reconciliation, test their effect on potentially harmful unintentional medication discrepancies, and understand barriers and facilitators of successful implementation.

Methods

Six U.S. hospitals are participating in this quality improvement mentored implementation study. Each hospital has collected baseline data on the primary outcome: the number of potentially harmful unintentional medication discrepancies per patient, as determined by a trained on-site pharmacist taking a “gold standard” medication history. With the guidance of their mentors, each site has also begun to implement one or more of 11 best practices to improve medication reconciliation. To understand the effect of the implemented interventions on hospital staff and culture, we are performing mixed methods program evaluation including surveys, interviews, and focus groups of front line staff and hospital leaders.

Discussion

At baseline the number of unintentional medication discrepancies in admission and discharge orders per patient varies by site from 2.35 to 4.67 (mean=3.35). Most discrepancies are due to history errors (mean 2.12 per patient) as opposed to reconciliation errors (mean 1.23 per patient). Potentially harmful medication discrepancies averages 0.45 per patient and varies by site from 0.13 to 0.82 per patient. We discuss several barriers to implementation encountered thus far. In the end, we anticipate that MARQUIS tools and lessons learned have the potential to decrease medication discrepancies and improve patient outcomes.

Trial registration

Clinicaltrials.gov identifier NCT01337063

Changes in end-user satisfaction with Computerized Provider Order Entry over time among nurses and providers in intensive care units

BACKGROUND

Implementation of Computerized Provider Order Entry (CPOE) has many potential advantages. Despite the potential benefits of CPOE, several attempts to implement CPOE systems have failed or met with high levels of user resistance. Implementation of CPOE can fail or meet high levels of user resistance for a variety of reasons, including lack of attention to users' needs and the significant workflow changes required by CPOE. User satisfaction is a critical factor in information technology implementation. Little is known about how end-user satisfaction with CPOE changes over time.

OBJECTIVE

To examine ordering provider and nurse satisfaction with CPOE implementation over time.

METHODS

We conducted a repeated cross-sectional questionnaire survey in four intensive care units of a large hospital. We analyzed the questionnaire data as well as the responses to two open-ended questions about advantages and disadvantages of CPOE.

RESULTS

Users were moderately satisfied with CPOE and there were interesting differences between user groups: ordering providers and nurses. User satisfaction with CPOE did not change over time for providers, but it did improve significantly for nurses. Results also show that nurses and providers are satisfied with different aspects of CPOE.

Person-job fit: an exploratory cross-sectional analysis of hospitalists

BACKGROUND

Person-job fit is an organizational construct shown to impact the entry, performance, and retention of workers. Even as a growing number of physicians work under employed situations, little is known about how physicians select, develop, and perform in organizational settings.

OBJECTIVE

Our objective was to validate in the hospitalist physician workforce features of person-job fit observed in workers of other industries.

DESIGN

The design was a secondary survey data analysis from a national stratified sample of practicing US hospitalists.

MEASURES

The measures were person-job fit; likelihood of leaving practice or reducing workload; organizational climate; relationships with colleagues, staff, and patients; participation in suboptimal patient care activities.

RESULTS

Responses to the Hospital Medicine Physician Worklife Survey by 816 (sample response rate 26%) practicing hospitalists were analyzed. Job attrition and reselection improved job fit among hospitalists entering the job market. Better job fit was achieved through hospitalists engaging a variety of personal skills and abilities in their jobs. Job fit increased with time together with socialization and internalization of organizational values. Hospitalists with higher job fit felt they performed better in their jobs.

CONCLUSIONS

Features of person-job fit for hospitalists conformed to what have been observed in nonphysician workforces. Person-job fit may be a useful complementary survey measure related to job satisfaction but with a greater focus on function.

Impact of electronic order management on the timeliness of antibiotic administration in critical care patients

OBJECTIVE

To examine the effect of implementing electronic order management on the timely administration of antibiotics to critical-care patients.

METHODS

We used a prospective pre-post design, collecting data on first-dose IV antibiotic orders before and after the implementation of an integrated electronic medication-management system, which included computerized provider order entry (CPOE), pharmacy order processing and an electronic medication administration record (eMAR). The research was performed in a 24-bed adult medical/surgical ICU in a large, rural, tertiary medical center. Data on the time of ordering, pharmacy processing and administration were prospectively collected and time intervals for each stage and the overall process were calculated.

RESULTS

The overall turnaround time from ordering to administration significantly decreased from a median of 100 min before order management implementation to a median of 64 min after implementation. The first part of the medication use process, i.e., from order entry to pharmacy processing, improved significantly whereas no change was observed in the phase from pharmacy processing to medication administration.

DISCUSSION

The implementation of an electronic order-management system improved the timeliness of antibiotic administration to critical-care patients. Additional system changes are required to further decrease the turnaround time.

Conducting an efficient proactive risk assessment prior to CPOE implementation in an intensive care unit

PURPOSE

To develop, conduct, and evaluate a proactive risk assessment (PRA) of the design and implementation of CPOE in an ICU.

METHODS

We developed a PRA method based on issues identified from documented experience with conventional PRA methods and the constraints of an organization about to implement CPOE in an intensive care unit. The PRA method consists of three phases: planning (three months), team (one five-hour meeting), and evaluation (short- and long-term).

RESULTS

Sixteen unique relevant vulnerabilities were identified as a result of the PRA team's efforts. Negative consequences resulting from the vulnerabilities included potential patient safety and quality of care issues, non-compliance with regulatory requirements, increases in cognitive burden on CPOE users, and/or worker inconvenience or distress. Actions taken to address the vulnerabilities included redesign of the technology, process (workflow) redesign, user training, and/or ongoing monitoring. Verbal and written evaluation by the team members indicated that the PRA method was useful and that participants were willing to participate in future PRAs. Long-term evaluation was accomplished by monitoring an ongoing "issues list" of CPOE problems identified by or reported to IT staff. Vulnerabilities identified by the team were either resolved prior to CPOE implementation (n=7) or shortly thereafter (n=9). No other issues were identified beside those identified by the team.

CONCLUSIONS

Generally positive results from the various evaluations including a long-term evaluation demonstrate the value of developing an efficient PRA method that meets organizational and contextual requirements and constraints.

Job characteristics, satisfaction, and burnout across hospitalist practice models

BACKGROUND

Nearly two-thirds of hospitals in the United States are served by hospitalist physicians. How hospitalist work patterns and job satisfaction vary across various practice models is unknown.

METHODS

We administered the Hospitalist Worklife Survey to a randomized stratified sample of 3105 potential hospitalists and 662 hospitalist members of 3 multistate hospitalist companies. Details about respondents' hospitalist group characteristics, their work patterns, and satisfaction with 2 global and 11 domain measures were assessed. Factors influencing job satisfaction were also solicited. These factors, job characteristics, job satisfaction, and burnout were compared across predefined practice models.

RESULTS

The adjusted response rate was 25.6%. Among the respondents, 44% were employed by a hospital, 15% by a multispecialty physician group, 14% by a multistate hospitalist group, 14% by a university or medical school, 12% by a local hospitalist group, and 2% by other. Hospitalists of local groups reported more clinical shifts per month, and hospitalists of local and multistate groups reported more billable encounters per shift compared to other practice models. Academic hospitalists reported fewer night shifts, fewer billable encounters per shift, more nonclinical work hours, and lower earnings compared to other practice models. Differences in clinical and nonclinical responsibilities, and differences in factors most important to job satisfaction, were noted across the 5 models. Despite these differences, levels of global job satisfaction and burnout were similar across the practice models.

CONCLUSIONS

Work patterns, compensation, and hospitalists' priorities varied significantly across practice models. Overall job satisfaction and burnout were similar across models, despite these differences.

Information chaos in primary care: implications for physician performance and patient safety

PURPOSE

The purpose of this article is to explore the concept of information chaos as it applies to the issues of patient safety and physician workload in primary care and to propose a research agenda.

METHODS

We use a human factors engineering perspective to discuss the concept of information chaos in primary care and explore implications for its impact on physician performance and patient safety.

RESULTS

Information chaos is comprised of various combinations of information overload, information underload, information scatter, information conflict, and erroneous information. We provide a framework for understanding information chaos, its impact on physician mental workload and situation awareness, and its consequences, and we discuss possible solutions and suggest a research agenda that may lead to methods to reduce the problem.

CONCLUSIONS

Information chaos is experienced routinely by primary care physicians. This is not just inconvenient, annoying, and frustrating; it has implications for physician performance and patient safety. Additional research is needed to define methods to measure and eventually reduce information chaos.

Development of a primary care physician task list to evaluate clinic visit workflow

BACKGROUND

Interventions designed to improve the delivery of primary care, including Patient-Centered Medical Homes and electronic health records, require an understanding of clinical workflow to be successfully implemented. However, there is a lack of tools to describe and study primary care physician workflow. We developed a comprehensive list of primary care physician tasks that occur during a face-to-face patient visit.

METHODS

A validated list of tasks performed by primary care physicians during patient clinic visits was developed from a secondary data analysis of observation data from two studies evaluating primary care workflow. Thirty primary care physicians participated from a convenience sample of 17 internal medicine and family medicine clinics in Wisconsin and Iowa across rural and urban settings and community and academic settings.

RESULTS

The final task list has 12 major tasks, 189 subtasks, and 191 total tasks. The major tasks are: Enter Room, Gather Information from Patient, Review Patient Information, Document Patient Information, Perform, Recommend / Discuss Treatment Options, Look Up, Order, Communicate, Print / Give Patient (advice, instructions), Appointment Wrap-up, and Leave Room. Additional subcodes note use of paper or EHR and the presence of a caregiver or medical student.

CONCLUSIONS

The task list presented here is a tool that will help clinics study their workflows so they can plan for changes that will take place because of EHR implementation and/or transformation to a patient centered medical home.

Factors contributing to an increase in duplicate medication order errors after CPOE implementation

OBJECTIVE

To evaluate the incidence of duplicate medication orders before and after computerized provider order entry (CPOE) with clinical decision support (CDS) implementation and identify contributing factors.

DESIGN

CPOE with duplicate medication order alerts was implemented in a 400-bed Northeastern US community tertiary care teaching hospital. In a pre-implementation post-implementation design, trained nurses used chart review, computer-generated reports of medication orders, provider alerts, and staff reports to identify medication errors in two intensive care units (ICUs).

MEASUREMENT

Medication error data were adjudicated by a physician and a human factors engineer for error stage and type. A qualitative analysis of duplicate medication ordering errors was performed to identify contributing factors.

RESULTS

Data were collected for 4147 patient-days pre-implementation and 4013 patient-days post-implementation. Duplicate medication ordering errors increased after CPOE implementation (pre: 48 errors, 2.6% total; post: 167 errors, 8.1% total; p<0.0001). Most post-implementation duplicate orders were either for the identical order or the same medication. Contributing factors included: (1) provider ordering practices and computer availability, for example, two orders placed within minutes by different providers on rounds; (2) communication and hand-offs, for example, duplicate orders around shift change; (3) CDS and medication database design, for example confusing alert content, high false-positive alert rate, and CDS algorithms missing true duplicates; (4) CPOE data display, for example, difficulty reviewing existing orders; and (5) local CDS design, for example, medications in order sets defaulted as ordered.

CONCLUSIONS

Duplicate medication order errors increased with CPOE and CDS implementation. Many work system factors, including the CPOE, CDS, and medication database design, contributed to their occurrence.

ICU nurses' acceptance of electronic health records

OBJECTIVE

To assess intensive care unit (ICU) nurses' acceptance of electronic health records (EHR) technology and examine the relationship between EHR design, implementation factors, and nurse acceptance.

DESIGN

The authors analyzed data from two cross-sectional survey questionnaires distributed to nurses working in four ICUs at a northeastern US regional medical center, 3 months and 12 months after EHR implementation.

MEASUREMENTS

Survey items were drawn from established instruments used to measure EHR acceptance and usability, and the usefulness of three EHR functionalities, specifically computerized provider order entry (CPOE), the electronic medication administration record (eMAR), and a nursing documentation flowsheet.

RESULTS

On average, ICU nurses were more accepting of the EHR at 12 months as compared to 3&emsp14;months. They also perceived the EHR as being more usable and both CPOE and eMAR as being more useful. Multivariate hierarchical modeling indicated that EHR usability and CPOE usefulness predicted EHR acceptance at both 3 and 12 months. At 3 months postimplementation, eMAR usefulness predicted EHR acceptance, but its effect disappeared at 12 months. Nursing flowsheet usefulness predicted EHR acceptance but only at 12 months.

CONCLUSION

As the push toward implementation of EHR technology continues, more hospitals will face issues related to acceptance of EHR technology by staff caring for critically ill patients. This research suggests that factors related to technology design have strong effects on acceptance, even 1&emsp14;year following the EHR implementation.

Code Status Discussions at Hospital Admission Are Not Associated With Patient and Surrogate Satisfaction With Hospital Care: Results From the Multicenter Hospitalist Study

Background: Physicians may avoid code status discussions for fear of decreasing patient or surrogate satisfaction. Methods: Charts of patients admitted to medical services at 6 university hospitals were reviewed for documentation of a code status discussion in the first 24 hours of admission. Satisfaction with care provided during the hospitalization was assessed by telephone 1 month after discharge. Results: Of the 11 717 patients with 1-month follow-up, 1090 (9.3%) had a code status discussion documented. Patient or surrogate satisfaction did not differ by whether a discussion was documented. The lack of association persisted after adjusting for patient’s severity of illness and using propensity adjustment for likelihood of having a discussion. Conclusions: Discussing code status on admission to the inpatient setting did not affect patient or surrogate satisfaction.

Nurses' acceptance of Smart IV pump technology

BACKGROUND

"Smart" intravenous infusion pumps (Smart IV pumps) are increasingly being implemented in hospitals to reduce medication administration errors.

OBJECTIVES

This study examines nurses' experience with the implementation and use of a Smart IV pump in an academic hospital.

METHOD

Data were collected in three longitudinal surveys: (a) a pre-implementation survey, (b) a 6-week-post-implementation survey, and (c) a 1-year-post-implementation survey. We examined: (a) the technology implementation process, (b) technical performance of the pump, (c) usability of the pump, and (d) user acceptance of the pump.

RESULTS

Initially, nurses had a somewhat positive acceptance of the Smart IV pump technology that significantly increased one year after implementation. User experiences associated with the pump in general improved over time, especially perceptions of pump efficiency. However, user experience with the pump implementation process and pump technical performance did not consistently improve from the pre-implementation survey to the post-implementation survey. Several characteristics of pump technical performance and usability influenced user acceptance at the one-year post-implementation survey.

DISCUSSION

These data may be useful for other institutions to guide implementation and post-implementation follow-up of IV pump use; other institutions could use the survey instrument from this study to evaluate nurses' perceptions of the technology. Our study identified several characteristics of the implementation process that other institutions may need to pay attention to (e.g., sharing information about the implementation process with nurses).

Hospital readmission in general medicine patients: a prediction model

BACKGROUND

Previous studies of hospital readmission have focused on specific conditions or populations and generated complex prediction models.

OBJECTIVE

To identify predictors of early hospital readmission in a diverse patient population and derive and validate a simple model for identifying patients at high readmission risk.

DESIGN

Prospective observational cohort study.

PATIENTS

Participants encompassed 10,946 patients discharged home from general medicine services at six academic medical centers and were randomly divided into derivation (n = 7,287) and validation (n = 3,659) cohorts.

MEASUREMENTS

We identified readmissions from administrative data and 30-day post-discharge telephone follow-up. Patient-level factors were grouped into four categories: sociodemographic factors, social support, health condition, and healthcare utilization. We performed logistic regression analysis to identify significant predictors of unplanned readmission within 30 days of discharge and developed a scoring system for estimating readmission risk.

RESULTS

Approximately 17.5% of patients were readmitted in each cohort. Among patients in the derivation cohort, seven factors emerged as significant predictors of early readmission: insurance status, marital status, having a regular physician, Charlson comorbidity index, SF12 physical component score, >or=1 admission(s) within the last year, and current length of stay >2 days. A cumulative risk score of >or=25 points identified 5% of patients with a readmission risk of approximately 30% in each cohort. Model discrimination was fair with a c-statistic of 0.65 and 0.61 for the derivation and validation cohorts, respectively.

CONCLUSIONS

Select patient characteristics easily available shortly after admission can be used to identify a subset of patients at elevated risk of early readmission. This information may guide the efficient use of interventions to prevent readmission.

Do hospitalists affect clinical outcomes and efficiency for patients with acute upper gastrointestinal hemorrhage (UGIH)?

BACKGROUND

Care by hospitalists has been associated with improved/similar clinical outcomes and efficiency. However, less is known about their effect on conditions dependent upon specialists for procedures/treatment plans. Our objective was to compare care for upper gastrointestinal hemorrhage (UGIH) patients attended by academic hospitalists and nonhospitalists.

METHODS

The study included 450 UGIH patients admitted to general medical services of 6 teaching hospitals. Outcomes included in-hospital mortality and complications (ie, recurrent bleeding, intensive care unit [ICU] transfer, decompensation, transfusion, reendoscopy, 30-day readmission). Efficiency was measured by hospital costs and length of stay (LOS).

RESULTS

Of 450 patients, 40% (177) were cared for by hospitalists with no differences between groups by endoscopic diagnosis, performance of early esophagogastroduodenoscopy (EGD), Rockall risk score, or Charlson comorbidity index. Unadjusted clinical outcomes between hospitalists and nonhospitalists were similar except for 2 outcomes: patients cared for by hospitalists were more likely to receive a transfusion (74% vs. 63%; P = 0.02) or be readmitted within 30 days (7.3% vs. 3.3%; P = 0.05). However, differences in adverse outcomes between providers were not seen after multivariable adjustments. Median LOS was similar for hospitalists and nonhospitalists (4 days; P = 0.69), but patients cared for by hospitalists had higher median costs ($7,359 vs. $6,181; P < 0.01). In multivariable analyses, LOS was similar (5.2 vs. 4.7 days; P = 0.15) and costs remained higher for the hospitalist-led teams (P < 0.03).

CONCLUSIONS

Despite having similar overall outcomes and LOS, costs were higher in UGIH patients attended by hospitalists. These results suggest that the academic hospitalist model may be tempered in patients requiring specialists for procedures or management.

Association of communication between hospital-based physicians and primary care providers with patient outcomes

BACKGROUND

Patients admitted to general medicine inpatient services are increasingly cared for by hospital-based physicians rather than their primary care providers (PCPs). This separation of hospital and ambulatory care may result in important care discontinuities after discharge. We sought to determine whether communication between hospital-based physicians and PCPs influences patient outcomes.

METHODS

We approached consecutive patients admitted to general medicine services at six US academic centers from July 2001 to June 2003. A random sample of the PCPs for consented patients was contacted 2 weeks after patient discharge and surveyed about communication with the hospital medical team. Responses were linked with the 30-day composite patient outcomes of mortality, hospital readmission, and emergency department (ED) visits obtained through follow-up telephone survey and National Death Index search. We used hierarchical multi-variable logistic regression to model whether communication with the patient's PCP was associated with the 30-day composite outcome.

RESULTS

A total of 1,772 PCPs for 2,336 patients were surveyed with 908 PCPs responses and complete patient follow-up available for 1,078 patients. The PCPs for 834 patients (77%) were aware that their patient had been admitted to the hospital. Of these, direct communication between PCPs and inpatient physicians took place for 194 patients (23%), and a discharge summary was available within 2 weeks of discharge for 347 patients (42%). Within 30 days of discharge, 233 (22%) patients died, were readmitted to the hospital, or visited an ED. In adjusted analyses, no relationship was seen between the composite outcome and direct physician communication (adjusted odds ratio 0.87, 95% confidence interval 0.56 - 1.34), the presence of a discharge summary (0.84, 95% CI 0.57-1.22), or PCP awareness of the index hospitalization (1.08, 95% CI 0.73-1.59).

CONCLUSION

Analysis of communication between PCPs and inpatient medical teams revealed much room for improvement. Although communication during handoffs of care is important, we were not able to find a relationship between several aspects of communication and associated adverse clinical outcomes in this multi-center patient sample.

Do hospitalists or physicians with greater inpatient HIV experience improve HIV care in the era of highly active antiretroviral therapy? Results from a multicenter trial of academic hospitalists

BACKGROUND

Little is known about the effect of provider type and experience on outcomes, resource use, and processes of care of hospitalized patients with human immunodeficiency virus (HIV) infection. Hospitalists are caring for this population with increasing frequency.

METHODS

Data from a natural experiment in which patients were assigned to physicians on the basis of call cycle was used to study the effects of provider type-that is, hospitalist versus nonhospitalist-and HIV-specific inpatient experience on resource use, outcomes, and selected measures of processes of care at 6 academic institutions. Administrative data, inpatient interviews, 30-day follow-up interviews, and the National Death Index were used to measure outcomes.

RESULTS

A total of 1207 patients were included in the analysis. There were few differences in resource use, outcomes, and processes of care by provider type and experience with HIV-infected inpatients. Patients who received hospitalist care demonstrated a trend toward increased length of hospital stay compared with patients who did not receive hospitalist care (6.0 days vs. 5.2 days; P = .13). Inpatient providers with moderate experience with HIV-infected patients were more likely to coordinate care with outpatient providers (odds ratio, 2.40; P = .05) than were those with the least experience with HIV-infected patients, but this pattern did not extend to providers with the highest level of experience.

CONCLUSION

Provider type and attending physician experience with HIV-infected inpatients had minimal effect on the quality of care of HIV-infected inpatients. Approaches other than provider experience, such as the use of multidisciplinary inpatient teams, may be better targets for future studies of the outcomes, processes of care, and resource use of HIV-infected inpatients.

Guideline for low-cost antimicrobial use in the outpatient setting

In an effort to increase appropriate prescribing of low-cost antimicrobials in the outpatient setting, an evidence-based guideline was created to identify situations when low-cost medications can be used. A literature search identified relevant clinical trials describing the efficacy of antimicrobials used in the outpatient setting. These were analyzed to identify low-cost medications defined as $15 or less. The information was put into guideline format that includes the level of evidence for recommending the drug and information about cost. Sixteen common infections and their treatments were included in the guideline. The efficacy data were similar for the low-cost and higher-cost antimicrobials for all infections included. We created a low-cost antimicrobial guideline for common infections treated in the outpatient setting. The treatment options have similar efficacy to higher cost medications. This guideline will serve as an information source for providers to help them rapidly determine the low-cost treatments for common infections. In addition, it can serve as a template for the development of similar guidelines in other therapeutic classes. These guidelines should be customized before implementation at other health care organizations, with consideration of local resistance patterns, drug availability and patient factors. The effect of guideline implementation on future prescribing habits and providers' opinions about availability of cost information and subsequent conversations with patients and prescribers of medications deserves further study.

Using failure mode and effects analysis to plan implementation of smart i.v. pump technology

PURPOSE

Failure mode and effects analysis (FMEA) was used to evaluate a smart i.v. pump as it was implemented into a redesigned medication-use process.

SUMMARY

A multidisciplinary team conducted a FMEA to guide the implementation of a smart i.v. pump that was designed to prevent pump programming errors. The smart i.v. pump was equipped with a dose-error reduction system that included a pre-defined drug library in which dosage limits were set for each medication. Monitoring for potential failures and errors occurred for three months postimplementation of FMEA. Specific measures were used to determine the success of the actions that were implemented as a result of the FMEA. The FMEA process at the hospital identified key failure modes in the medication process with the use of the old and new pumps, and actions were taken to avoid errors and adverse events. I.V. pump software and hardware design changes were also recommended. Thirteen of the 18 failure modes reported in practice after pump implementation had been identified by the team. A beneficial outcome of FMEA was the development of a multidisciplinary team that provided the infrastructure for safe technology implementation and effective event investigation after implementation. With the continual updating of i.v. pump software and hardware after implementation, FMEA can be an important starting place for safe technology choice and implementation and can produce site experts to follow technology and process changes over time.

CONCLUSION

FMEA was useful in identifying potential problems in the medication-use process with the implementation of new smart i.v. pumps. Monitoring for system failures and errors after implementation remains necessary.

Effect of the inpatient general medicine rotation on student pursuit of a generalist career

BACKGROUND

Entry into general internal medicine (GIM) has declined. The effect of the inpatient general medicine rotation on medical student career choices is uncertain.

OBJECTIVE

To assess the effect of student satisfaction with the inpatient general medicine rotation on pursuit of a career in GIM.

DESIGN

Multicenter cohort study.

PARTICIPANTS

Third-year medical students between July 2001 and June 2003.

MEASUREMENTS

End-of-internal medicine clerkship survey assessed satisfaction with the rotation using a 5-point Likert scale. Pursuit of a career in GIM defined as: (1) response of "Very Likely" or "Certain" to the question "How likely are you to pursue a career in GIM?"; and (2) entry into an internal medicine residency using institutional match data.

RESULTS

Four hundred and two of 751 (54%) students responded. Of the student respondents, 307 (75%) matched in the 2 years following their rotations. Twenty-eight percent (87) of those that matched chose an internal medicine residency. Of these, 8% (25/307) were pursuing a career in GIM. Adjusting for site and preclerkship interest, overall satisfaction with the rotation predicted pursuit of a career in GIM (odds ratio [OR] 3.91, P<.001). Although satisfaction with individual items did not predict pursuit of a generalist career, factor analysis revealed 3 components of satisfaction (attending, resident, and teaching). Adjusting for preclerkship interest, 2 factors (attending and teaching) were associated with student pursuit of a career in GIM (P<.01).

CONCLUSIONS

Increased satisfaction with the inpatient general medicine rotation promotes pursuit of a career in GIM.

Using clinical practice guidelines to improve patient care

Clinical practice guidelines incorporate the best available evidence for the management of a disease or an aspect of disease treatment or prevention into a single document for health care providers. The quality of practice guidelines has improved by adopting standard approaches to the development of guidelines and reviewing their quality for use in patient care. Implementing guidelines into clinical practice can improve quality and efficiency of care and will likely benefit from a multidisciplinary, multifaceted approach.

Worklife and satisfaction of general internists

BACKGROUND

Prior studies have reported relatively low job satisfaction for general internists. We used data from a large US physician survey to assess correlates of satisfaction of general internists.

METHODS

The Physician Worklife Survey was mailed to a national random stratified sample of 5704 US physicians. General internists were assessed for their satisfaction, training, patient mix, work hours, the likelihood of recommending their specialty to medical students, and job stability. We then compared them with a specialist sample (internal medicine subspecialists [IMSSs]) and a primary care sample (family physicians [FPs]). Logistic regression was used to model predictors of satisfaction, stress, and medical student recruitment.

RESULTS

There were 2326 respondents (adjusted response rate, 52%): 450 (19%) were general internists; 502 (22%), FPs; and 438 (19%), IMSSs. General internists were less satisfied than were IMSSs with their relationships with colleagues and with patient care issues (P<.01 for both) and less satisfied than were FPs with community ties (P =.001). Global job, career, and specialty satisfaction were significantly lower for general internists vs FPs and IMSSs (P<.05). General internists spent proportionately more of their work week in the hospital than did FPs (20% vs 13%; P<.001) and more time providing outpatient care than did IMSSs (56% vs 42%; P<.001). General internists had more patients with complex medical and psychosocial problems than did FPs (P<.01) but fewer patients with complex medical problems than did IMSSs (P<.001). Higher satisfaction for general internists was associated with older physician age, less time pressure during office visits, fewer work hours, and fewer patients with complex psychosocial problems (P<.05 for all). General internists were less likely than were FPs to recommend their specialty to medical students (P<.001). Specialty satisfaction, female gender, and control of hassles predicted medical student recruitment by general internists.

CONCLUSIONS

General internists' role of caring for patients with complex problems is associated with lower levels of satisfaction than for IMSSs and FPs. Adjusting caseload for patient complexity, expanding time for office visits, and additional training in the care of patients with psychosocially complex problems may improve the job satisfaction of general internists and medical student recruitment into the specialty.