Appropriate antibiotic use reduces length of hospital stay

Criteria to achieve safe antimicrobial intravenous-to-oral switch in hospitalised adult populations: a systematic rapid review

OBJECTIVES

This rapid review aimed to assess and collate intravenous-to-oral switch (IVOS) criteria from the literature to achieve safe and effective antimicrobial IVOS in the hospital inpatient adult population.

DESIGN

The rapid review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement.

DATA SOURCES

OVID Embase and Medline databases.

ELIGIBILITY CRITERIA

Articles of adult populations published globally between 2017 and 2021 were included.

DATA EXTRACTION AND SYNTHESIS

An Excel spreadsheet was designed with specific column headings. IVOS criteria from UK hospital IVOS policies informed the framework synthesis.

RESULTS

IVOS criteria from 45/164 (27%) local IVOS policies were categorised into a five-section framework: (1) timing of IV antimicrobial review, (2) clinical signs and symptoms, (3) infection markers, (4) enteral route and (5) infection exclusions. The literature search identified 477 papers, of which 16 were included. The most common timing for review was 48-72 hours from initiation of intravenous antimicrobial (n=5, 30%). Nine studies (56%) stated clinical signs and symptoms must be improving. Temperature was the most frequently mentioned infection marker (n=14, 88%). Endocarditis had the highest mention as an infection exclusion (n=12, 75%). Overall, 33 IVOS criteria were identified to go forward into the Delphi process.

CONCLUSION

Through the rapid review, 33 IVOS criteria were collated and presented within five distinct and comprehensive sections. The literature highlighted the possibility of reviewing IVOS before 48-72 hours and of presenting heart rate, blood pressure and respiratory rate as a combination early warning score criterion. The criteria identified can serve as a starting point of IVOS criteria review for any institution globally, as no country or region limits were applied. Further research is required to achieve consensus on IVOS criteria from healthcare professionals that manage patients with infections.

PROSPERO REGISTRATION NUMBER

CRD42022320343.

Short and Concise Peer-to-Peer Teaching—Example of a Successful Antibiotic Stewardship Intervention to Increase Iv to Po Conversion

Antibiotic stewardship (ABS) programs aim to combine effective treatment with minimized antibiotic-related harms. Common ABS interventions are simple and effective, but their implementation in daily practice is often difficult. The aim of our study was to investigate if a single, short, peer-to-peer teaching intervention (junior doctor to junior doctor) during clinical routine can successfully improve antibiotic prescriptions. We performed a quasi-experimental before–after study on a regular care cardiology ward at a large academic medical center in Germany. We evaluated antibiotic use metrics retrospectively and calculated defined daily doses (DDD) with the anatomical therapeutic chemical/DDD classification system of the World Health Organization. We hypothesize that the over-representative use of intravenous administration is a potentially modifiable target, which can be proven by antibiotic use metrics analysis. After a single peer-to-peer teaching session with a focus on indications for iv to po conversion, the normalized percentage of intravenous compared to oral administration significantly decreased (from 86.5 ± 50.3% to 41.4 ± 70.3%). Moreover, after the intervention, antibiotics with high oral bioavailability were no longer administered intravenously at all during the following quarter. Our results indicate that even a single peer-to-peer training session is highly effective in improving the iv to po conversion rate in the short term.

Management of Children Admitted to Hospitals across Bangladesh with Suspected or Confirmed COVID-19 and the Implications for the Future: A Nationwide Cross-Sectional Study

There is an increasing focus on researching children admitted to hospital with new variants of COVID-19, combined with concerns with hyperinflammatory syndromes and the overuse of antimicrobials. Paediatric guidelines have been produced in Bangladesh to improve their care. Consequently, the objective is to document the management of children with COVID-19 among 24 hospitals in Bangladesh. Key outcome measures included the percentage prescribed different antimicrobials, adherence to paediatric guidelines and mortality rates using purposely developed report forms. The majority of 146 admitted children were aged 5 years or under (62.3%) and were boys (58.9%). Reasons for admission included fever, respiratory distress and coughing; 86.3% were prescribed antibiotics, typically parenterally, on the WHO ‘Watch’ list, and empirically (98.4%). There were no differences in antibiotic use whether hospitals followed paediatric guidance or not. There was no prescribing of antimalarials and limited prescribing of antivirals (5.5% of children) and antiparasitic medicines (0.7%). The majority of children (92.5%) made a full recovery. It was encouraging to see the low hospitalisation rates and limited use of antimalarials, antivirals and antiparasitic medicines. However, the high empiric use of antibiotics, alongside limited switching to oral formulations, is a concern that can be addressed by instigating the appropriate programmes.

A multicentre cluster-randomized clinical trial to improve antibiotic use and reduce length of stay in hospitals: comparison of three measurement and feedback methods

BACKGROUND

Various metrics of hospital antibiotic use might assist in guiding antimicrobial stewardship (AMS).

OBJECTIVES

To compare patient outcomes in association with three methods to measure and feedback information on hospital antibiotic use when used in developing an AMS intervention.

METHODS

Three methods were randomly allocated to 42 clusters from 21 Dutch hospitals: (1) feedback on quantity of antibiotic use [DDD, days-of-therapy (DOT) from hospital pharmacy data], versus feedback on (2) validated, or (3) non-validated quality indicators from point prevalence studies. Using this feedback together with an implementation tool, stewardship teams systematically developed and performed improvement strategies. The hospital length of stay (LOS) was the primary outcome and secondary outcomes included DOT, ICU stay and hospital mortality. Data were collected before (February-May 2015) and after (February-May 2017) the intervention period.

RESULTS

The geometric mean hospital LOS decreased from 9.5 days (95% CI 8.9-10.1, 4245 patients) at baseline to 9.0 days (95% CI 8.5-9.6, 4195 patients) after intervention (P < 0.001). No differences in effect on LOS or secondary outcomes were found between methods. Feedback on quality of antibiotic use was used more often to identify improvement targets and was preferred over feedback on quantity of use. Consistent use of the implementation tool seemed to increase effectiveness of the AMS intervention.

CONCLUSIONS

The decrease in LOS versus baseline likely reflects improvement in the quality of antibiotic use with the stewardship intervention. While the outcomes with the three methods were otherwise similar, stewardship teams preferred data on the quality over the quantity of antibiotic use.

Thermostable Heptaplex PCR Assay for the Detection of Six Respiratory Bacterial Pathogens

A thermostabilized, multiplex polymerase chain reaction (mPCR) assay was developed in this study for the detection of six respiratory bacterial pathogens. Specific primers were designed for an internal amplification control (IAC) and six target sequences from Klebsiella pneumoniae, Staphylococcus aureus, Streptococcus pneumoniae, Pseudomonas aeruginosa, Mycobacterium tuberculosis, and Haemophilus influenzae. The resultant seven-band positive amplification control (PAC) of this heptaplex PCR assay corresponded to 105 base pairs (bp) of IAC, 202 bp of K. pneumoniae, 293 bp of S. aureus, 349 bp of S. pneumoniae, 444 bp of P. aeruginosa, 505 bp of M. tuberculosis, and 582 bp of H. influenzae. Results found that 6% (w/v) of the stabilizer was optimum to preserve the functional conformation of Taq DNA polymerase enzyme. This assay was stable at ambient temperature for at least 6 months. The sensitivity and specificity of this assay were both 100% when testing on the intended target organisms (n = 119) and non-intended species (n = 57). The mPCR assay developed in this study enabled accurate, rapid, and simple detection of six respiratory bacteria.

Implementation of pharmacist-managed early switch from intravenous to oral therapy using electronic identification at a tertiary academic hospital

Overutilization of intravenous (IV) medications can result in drug shortages, which is one of the major health care crisis, in addition to increasing costs, length of hospital stays (LOS) and the associated complications. We hypothesized that IV therapy was overused at our hospital where oral (PO) was applicable, and that the implementation of IV-PO protocol could result in a cost-effective practice. Hence, we aimed at assessing impact and outcomes of implementing such a protocol. A single center, prospective quasi-interventional study conducted at tertiary academic hospital. A protocol was implemented targeting 17 medications, with educational sessions to medical staff during a 5-month phase. IV orders of 48 h or more, among adult patients at medical or surgical wards with no contraindication to PO route were eligible. Once eligible, pharmacists send interventions using hospital's computerized order entry system, and physicians' responses were monitored on daily basis. Efficacy was estimated by percentage of switch recommendations that resulted in effective switch to PO medication. Cost-minimization analysis was used for course cost between the control phase and intervention phase. Length of hospital stay (LOS), readmissions within 90 days and in-hospital mortality were analyzed as secondary outcomes. During intervention phase, 781 patients had at least one IV order switched to PO. Gastric acid-reducing agents (GARAs) accounted for the most IV prescriptions (50.4%), followed by antibiotics (39.6%). Pharmacists carried out 2677 interventions to which switch recommendations were issued in 1185 (44.3%). Primary switch recommendations (N = 677) led to effective switch in 60.7% cases. These included per protocol switch (8.9%), switch to another PO (2.5%), spontaneous switch by physician (17.6%) and IV discontinuation (31.8%). The overall efficacy was estimated as 62.8%. The intervention was associated with reduced IV consumption from 4,574-18,597 vials in control phase to 3,654-15,546 vials in intervention phase, which resulted in overall cost saving of 50,960.8 SAR ($13,589.5), with an average monthly cost saving of 10,192.2 SAR ($2,717.9). Pharmacist-managed early switch from IV-PO therapy, with physicians' education, showed significant reduction in IV medication use in our hospital. By reducing unnecessary IV use, this strategy enabled considerable cost savings, besides the potential advantages of convenience and safety.

Development of key quality indicators for appropriate antibiotic use in the Republic of Korea: results of a modified Delphi survey

Background

An effective antibiotic stewardship program relies on the measurement of appropriate antibiotic use, on which there is a lack of consensus. We aimed to develop a set of key quality indicators (QIs) for nationwide point surveillance in the Republic of Korea.

Methods

A systematic literature search of PubMed, EMBASE, and Cochrane Library (publications until 20th November 2019) was conducted. Potential key QIs were retrieved from the search and then evaluated by a multidisciplinary expert panel using a RAND-modified Delphi procedure comprising two online surveys and a face-to-face meeting.

Results

The 23 potential key QIs identified from 21 studies were submitted to 25 multidisciplinary expert panels, and 17 key QIs were retained, with a high level of agreement (13 QIs for inpatients, 7 for outpatients, and 3 for surgical prophylaxis). After adding up the importance score and applicability, six key QIs [6 QIs (Q 1–6) for inpatients and 3 (Q 1, 2, and 5) for outpatients] were selected. (1) Prescribe empirical antibiotic therapy according to guideline, (2) change empirical antibiotics to pathogen-directed therapy, (3) obtain culture samples from suspected infection sites, (4) obtain two blood cultures, (5) adapt antibiotic dosage to renal function, and (6) document antibiotic plan. In surgical prophylaxis, the QIs to prescribe antibiotics according to the guideline and initiate antibiotic therapy 1 h before incision were selected.

Conclusions

We identified key QIs to measure the appropriateness of antibiotic therapy to identify targets for improvement and to evaluate the effects of antibiotic stewardship intervention.

Variation in clinical outcomes and process of care measures in community acquired pneumonia: a systematic review

Background

Variation in outcomes of patients with community acquired pneumonia (CAP) has been reported in some, but not all, studies. Although some variation is expected, unwarranted variation in healthcare impacts patient outcomes and equity of care. The aim of this systematic review was to: i) summarise current evidence on regional and inter-hospital variation in the clinical outcomes and process of care measures of patients hospitalised with CAP and ii) assess the strength of this evidence.

Methods

Databases were systematically searched from inception to February 2018 for relevant studies and data independently extracted by two investigators in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. Included studies enrolled adults hospitalised with CAP and reported a measure of variation between two or more units in healthcare outcomes or process of care measures. Outcomes of interest were mortality, length of hospital stay (LOS) and re-admission rates. A structured synthesis of the studies was performed.

Results

Twenty-two studies were included in the analysis. The median number of units compared across studies was five (IQR 4–15). Evidence for variation in mortality between units was inconsistent; of eleven studies that performed statistical significance testing, five found significant variation. For LOS, of nine relevant studies, all found statistically significant variation. Four studies reported site of admission accounted for 1–24% of the total observed variation in LOS. A shorter LOS was not associated with increased mortality or readmission rates. For readmission, evidence was mixed; of seven studies, 4 found statistically significant variation. There was consistent evidence for variation in the use of intensive care, obtaining blood cultures on admission, receiving antibiotics within 8 h of admission and duration of intravenous antibiotics. Across all outcome measures, only one study accounted for natural variation between units in their analysis.

Conclusion

There is consistent evidence of moderate quality for significant variation in length of stay and process of care measures but not for in-patient mortality or hospital re-admission. Evidence linking variation in outcomes with variation in process of care measures was limited; where present no difference in mortality was detected despite POC variation. Adjustment for natural variation within studies was lacking; the proportion of observed variation due to chance is not quantified by existing evidence.

A Propensity Score Matched Study of the Positive Impact of Infectious Diseases Consultation on Antimicrobial Appropriateness in Hospitalized Patients with Antimicrobial Stewardship Oversight

Hospital-based antibiotic stewardship (AS) programs provide oversight and guidance for appropriate antimicrobial use in acute care settings. Infectious disease expertise is beneficial in the care of hospitalized patients with infections. The impact of infectious diseases consultation (IDC) on antimicrobial appropriateness in a large tertiary hospital with an established AS program was investigated. This was a cross-sectional study from October 2017 to March 2019 at a large academic hospital with an AS-directed prospective audit and feedback process and multiple IDC services. Antimicrobial appropriateness was adjudicated by an AS team member after antimicrobial start. Antimicrobial appropriateness was compared among antimicrobial orders with and without IDC using propensity score matching and multivariable logistic regression. Analyses were stratified by primary services caring for the patients. There were 10,508 antimicrobial orders from 6,165 unique patient encounters. Overall appropriateness was 92%, with higher appropriateness among patients with IDC versus without IDC (94% versus 84%; P < 0.0001). After propensity score matching and adjustment for certain antibiotics, organisms, syndromes, and locations, IDC was associated with a greater antimicrobial appropriateness odds ratio (OR) of 2.4 (95% confidence interval [CI], 1.9 to 3.0). Stratification by primary service showed an OR of 2.9 (95% CI, 2.1 to 3.8) for surgical specialties and an OR of 1.6 (95% CI, 1.1 to 2.2) for medical specialties. Even with a high overall antimicrobial appropriateness, patients with IDC had greater odds of antimicrobial appropriateness than those without IDC, and this impact was greater in surgical specialties. Infectious diseases consultation can be synergistic with antimicrobial stewardship programs.

Appropriate empirical antibiotic use in the emergency department: full compliance matters!

Background

Little is known about determinants of appropriate antibiotic use in the emergency department (ED). We measured appropriateness of antibiotic use for seven quality indicators (QIs) and studied patient-related factors that determine their variation.

Patients and methods

A retrospective analysis of 948 patients presumptively diagnosed as having an infection needing empirical antibiotic treatment in the ED was performed. Outcomes of seven previously validated QIs were calculated using computerized algorithms. We used logistic regression analysis to identify patient-related factors of QI performance and evaluated whether more appropriate antibiotic use in the ED results in better patient outcomes (length-of-stay, in-hospital mortality, 30 day readmission).

Results

QI performance ranged from 57.3% for guideline-adherent empirical therapy to 97.3% for appropriate route of administration in patients with sepsis. QI performance was positively associated with patients’ disease severity on admission (presence of fever, tachycardia and hypotension). Overall, the clinical diagnosis and thus the guidelines followed influenced QI performance. The difference in complexity between the guidelines was a possible explanation for the variation in QI performance. A QI performance sum score of 100% was associated with reduced in-hospital mortality. QI performance was not associated with readmission rates.

Conclusions

We gained insights into factors that determine quality of antibiotic prescription in the ED. Adherence to the full bundle of QIs was associated with reduced in-hospital mortality. These findings suggest that future stewardship interventions in the ED should focus on the entire process of antibiotic prescribing in the ED and not on a single metric only.

Increased Length of Stay Associated With Antibiotic Use in Older Adults With Advanced Cancer Transitioned to Comfort Measures

BACKGROUND

Antibiotic use may increase hospital length of stay (LOS) among older patients with advanced cancer who are transitioned to comfort measures.

METHODS

We studied a cohort of patients with advanced cancer aged ≥65 years who were transitioned to comfort measures during admission from July 1, 2014, through November 30, 2016. We evaluated the association between antibiotic exposure and LOS using a Poisson regression model adjusted for age, gender, cancer type, comorbidities, infection, and intensive care unit admission.

RESULTS

Among 461 patients with advanced cancer, median age was 74 years (range: 65-99), 49.0% (n = 226) were female, and 20.6% (n = 95) had liquid tumors. Overall, 82.9% (n = 382) received ≥1 antibiotic and 64.6% (n = 298) had ≥1 infection diagnosis during hospitalization. Infection diagnoses commonly included sepsis (35%, n = 161/461), pneumonia (25%, n = 117/461), and urinary tract infection (14%, n = 66/461). Among those receiving antibiotics, the most common choices included vancomycin (79%, n = 300/382), cephalosporins (63%, n = 241/382), and penicillins (45%, n = 172/382). In a multivariable Poisson regression model, LOS was 34% longer (count ratio = 1.34, [95% confidence interval: 1.20-1.51]) among those exposed versus unexposed to antibiotics.

CONCLUSIONS

Antibiotic use among patients with advanced cancer who are transitioned to comfort measures is associated with longer LOS. These data illustrate the importance of tradeoffs associated with antibiotic use, such as unintended increased LOS, when striving for goal-concordant care near the end of life.

Barriers and facilitators and the need for a clinical guideline for microbiological diagnostic testing in the hospital: a qualitative and quantitative study

The appropriate use of microbiological investigations is an important cornerstone of antibiotic stewardship programmes, but receives relatively limited attention. This study aimed to identify influencing factors in performing microbiological diagnostic tests and to assess the need for a clinical guideline. We performed a qualitative (focus group) and quantitative (online questionnaire survey) study among medical specialists and residents to identify physicians' considerations in performing microbiological diagnostic tests and to assess the need for a diagnostic guideline. The questionnaire consisted of 14 statements, divided into three categories: knowledge, influencing factors and presence of guidelines. The questionnaire was sent to physicians of the departments of internal medicine, intensive care, paediatrics and pulmonology in five hospitals in the Netherlands. Sub-analyses for medical specialists versus residents and for paediatric versus non-paediatric departments were performed. We included 187 completed questionnaires in our analyses. The physicians reported having adequate knowledge on methods, time-to-result and accuracy, but inadequate knowledge on costs of the tests. Patients' clinical condition, comorbidity, local guidelines and accuracy of tests were appraised as the four most important influencing factors to perform tests. Over 70% (132/187) of physicians reported being interested in a guideline for microbiological diagnostic testing. Fifteen physicians (8.0%) provided additional comments. This study identifies the influencing factors to microbiological testing and shows the demand for a clinical guideline among physicians. IMPORTANCE: Microbiological diagnostic tests are an important cornerstone within antibiotic stewardship programmes [1-5]. These programmes aim to ameliorate the appropriate use of antibiotics and thus improve clinical outcomes of infectious diseases, whilst reducing the emergence of antimicrobial resistance [6]. However, inappropriate microbiological testing is a widely recognised problem [7-12], and influencing factors to testing have not been studied in the past. Our research shows the demand for a clinical guideline among physicians, and it identifies their influencing factors to testing. These results can be used to create a clinical guideline for microbiological diagnostic testing, thus supporting antibiotic stewardship programmes and reducing antimicrobial resistance.

Assessment of Quality Indicators for Appropriate Antibiotic Use

One of the critical elements of antimicrobial stewardship programs is the ability to measure the quality of antibiotic prescriptions. The aims of the present study were to evaluate the performance properties of a set of previously developed quality indicators (QIs) and to identify the potential room for improvement in antibiotic use in our setting. A monthly cross-sectional point prevalence survey was conducted in a 400-bed acute care teaching hospital, from June to November 2015. All adult patients treated for ≥24 hours with antibiotic therapy for a suspected hospital- or community-acquired bacterial infection were included. Performance scores (adherence, room for improvement, interobserver reliability, and applicability) were calculated for 8 QIs. A total of 362 patients were evaluated. Adherence to the whole set of QIs was accomplished for 14.1% of evaluable patients. The QIs with greater room for improvement were adequate request for blood cultures (60.6%), therapeutic drug monitoring (TDM) (59.1%), sequential antibiotic therapy within 72 hours (48.2%), and empirical antibiotic therapy according to local guidelines (30.4%). The percentage of patients receiving unnecessary antibiotic treatment in the absence of clinical or microbiological evidence of infection after 5 days was 12.2%. All indicators scored kappa values of ≥0.6, suggesting good interobserver reliability. Low applicability (6.1% of reviewed patients) was found only for the TDM QI. The QIs analyzed were found to be applicable, showed good interobserver reliability, and were useful tools to identify areas with potential room for improvement in antibiotic use.

The antibiotic checklist: an observational study of the discrepancy between reported and actually performed checklist items

Background

Checklists are increasingly used to measure quality of care. Recently we implemented an antibiotic checklist in nine Dutch hospitals and showed that use of the checklist resulted in more appropriate antibiotic use. While more appropriate antibiotic use was associated with a reduction in length of stay, use of the checklist in itself was not. In the current study we explored discrepancies between reported and actually performed checklist items at the patient level to test the validity of checklist answers, to evaluate whether discrepancies between reported and actually performed checklist items could explain the lack of effect of checklist use on length of stay, and to identify missed opportunities for performance per checklist item.

Methods

Checklist answers represented reported performance. Actual performance was assessed by data from the patients’ medical files. Reported and actually performed checklist items could be ‘both YES’; ‘both NO’; ‘YES reported, NOT actually performed’; or ‘NO reported, YES actually performed’. We determined an overall ‘both YES’ score per checklist, and used mixed models to evaluate whether an association existed between this overall score and patient’s length of hospital stay. Finally, we analysed whether the items that were not actually performed, could have been performed.

Results

Between January and October 2015 physicians filled in 1207 checklists. In total 7881 items were checked. Most items were ‘both YES’ (3392/7881, 43.0%) or ‘both NO’ (2601/7881, 33.0%). The number of ‘YES reported, NOT actually performed’ items was 1628/7881 (20.7%) compared to 260/7881 (3.3%) ‘NO reported, YES actually performed’ items. The level of discrepancy between reported and actually performed items differed per checklist item. The item ‘prescribe antibiotic treatment according to the local guideline’ had the highest percentage of ‘YES reported, NOT actually performed’ items, namely 45.1%. A higher overall ‘both YES’ score of the checklist was significantly associated with a shorter length of hospital stay. Of all checklist items 21.8% were not performed while they could have been performed.

Conclusions

Checklist answers do not accurately assess actual provided care. As actual performance of the antibiotic checklist items is associated with length of stay, efforts to increase actual performance appear to be justified.

Electronic supplementary material

The online version of this article (10.1186/s12879-017-2878-7) contains supplementary material, which is available to authorized users.

Effect of an antibiotic checklist on length of hospital stay and appropriate antibiotic use in adult patients treated with intravenous antibiotics: a stepped wedge cluster randomized trial

OBJECTIVES

Quality indicators (QIs) have been developed to define appropriate antibiotic use in hospitalized patients. We evaluated whether a checklist based on these QIs affects appropriate antibiotic use and length of hospital stay.

METHODS

An antibiotic checklist for patients treated with intravenous antibiotics was introduced in nine Dutch hospitals in a stepped wedge cluster randomized trial. Prophylaxis was excluded. We included a random sample before (baseline), and all eligible patients after (intervention) checklist introduction. Baseline and intervention outcomes were compared. Primary endpoint was length of stay (LOS), analysed by intention to treat. Secondary endpoints, including QI performances, QI sum score (performance on all QIs per patient), and quality of checklist use, were analysed per protocol.

RESULTS

Between 1 November 2014 and 1 October 2015 we included 853 baseline and 5354 intervention patients, of whom 993 (19%) had a completed checklist. The LOS did not change (baseline geometric mean 10.0 days (95% CI 8.6-11.5) versus intervention 10.1 days (95% CI 8.9-11.5), p 0.8). QI performances increased between +3.0% and +23.9% per QI, and the percentage of patients with a QI sum score above 50% increased significantly (OR 2.4 (95% CI 2.0-3.0), p<0.001). Higher QI sum scores were significantly associated with shorter LOS. Discordance existed between checklist-answers and actual performance.

CONCLUSIONS

Use of an antibiotic checklist resulted in a significant increase in appropriateness of antibiotic use, but not in a reduction of LOS. Low overall checklist completion rates and discordance between checklist-answers and actual provided care might have attenuated the impact of the checklist.