Developing a reporting item checklist for studies of HIV drug resistance prevalence or incidence: a mixed methods study

BACKGROUND

Adequate surveillance of HIV drug resistance prevalence is challenged by heterogenous and inadequate data reporting. To address this issue, we recently published reporting guidance documentation for studies of HIV drug resistance prevalence and incidence.

OBJECTIVES

In this study, we describe the methods used to develop this reporting guidance.

DESIGN

We used a mixed-methods sequential explanatory design involving authors and users of studies of HIV drug resistance prevalence. In the quantitative phase, we conducted a cross-sectional electronic survey (n=51). Survey participants rated various reporting items on whether they are essential to report. Validity ratios were computed to determine the items to discuss in the qualitative phase. In the qualitative phase, two focus group discussions (n=9 in total) discussed this draft item checklist, providing a justification and examples for each item. We conducted a descriptive qualitative analysis of the group discussions to identify emergent themes regarding the qualities of an essential reporting item.

RESULTS

We identified 38 potential reporting items that better characterise the study participants, improve the interpretability of study results and clarify the methods used for HIV resistance testing. These items were synthesised to create the reporting item checklist. Qualitative insights formed the basis of the explanation, elaboration, and rationale components of the guidance document.

CONCLUSIONS

We generated a list of reporting items for studies on the incidence or prevalence of HIV drug resistance along with an explanation of why researchers believe these items are important. Mixed methods allowed for the simultaneous generation and integration of the item list and qualitative insights. The integrated findings were then further developed to become the subsequently published reporting guidance.

A robust approach for endotracheal tube localization in chest radiographs

Precise detection and localization of the Endotracheal tube (ETT) is essential for patients receiving chest radiographs. A robust deep learning model based on U-Net++ architecture is presented for accurate segmentation and localization of the ETT. Different types of loss functions related to distribution and region-based loss functions are evaluated in this paper. Then, various integrations of distribution and region-based loss functions (compound loss function) have been applied to obtain the best intersection over union (IOU) for ETT segmentation. The main purpose of the presented study is to maximize IOU for ETT segmentation, and also minimize the error range that needs to be considered during calculation of distance between the real and predicted ETT by obtaining the best integration of the distribution and region loss functions (compound loss function) for training the U-Net++ model. We analyzed the performance of our model using chest radiograph from the Dalin Tzu Chi Hospital in Taiwan. The results of applying the integration of distribution-based and region-based loss functions on the Dalin Tzu Chi Hospital dataset show enhanced segmentation performance compared to other single loss functions. Moreover, according to the obtained results, the combination of Matthews Correlation Coefficient (MCC) and Tversky loss functions, which is a hybrid loss function, has shown the best performance on ETT segmentation based on its ground truth with an IOU value of 0.8683.

Use of Delphi in health sciences research: A narrative review

The use of the Delphi technique is prevalent across health sciences research, and it is used to identify priorities, reach consensus on issues of importance and establish clinical guidelines. Thus, as a form of expert opinion research, it can address fundamental questions present in healthcare. However, there is little guidance on how to conduct them, resulting in heterogenous Delphi studies and methodological confusion. Therefore, the purpose of this review is to introduce the use of the Delphi method, assess the application of the Delphi technique within health sciences research, discuss areas of methodological uncertainty and propose recommendations. Advantages of the use of Delphi include anonymity, controlled feedback, flexibility for the choice of statistical analysis, and the ability to gather participants from geographically diverse areas. Areas of methodological uncertainty worthy of further discussion broadly include experts and data management. For experts, the definition and number of participants remain issues of contention, while there are ongoing difficulties with expert selection and retention. For data management, there are issues with data collection, defining consensus and methods of data analysis, such as percent agreement, central tendency, measures of dispersion, and inferential statistics. Overall, the use of Delphi addresses important issues present in health sciences research, but methodological issues remain. It is likely that the aggregation of future Delphi studies will eventually pave the way for more comprehensive reporting guidelines and subsequent methodological clarity.

The Contribution of Chest X-Ray to Predict Extubation Failure in Mechanically Ventilated Patients Using Machine Learning-Based Algorithms

To evaluate the contribution of a preextubation chest X-ray (CXR) to identify the risk of extubation failure in mechanically ventilated patients.

Evaluation of the Daily Change in PaO2/FiO2 Ratio as a Predictor of Abnormal Chest X-rays in Intensive Care Unit Patients Post Mechanical Ventilation Weaning: A Retrospective Cohort Study

Background and Objectives: The routine daily chest X-ray (CXR) strategy is no longer recommended in intensive care unit (ICU) patients. However, it is difficult for intensivists to collectively accept the on-demand CXR strategy because of the ambiguous clinical criteria for conducting CXRs. This study evaluated the predictive value of the change in PaO₂/FiO₂ (PF ratio) for abnormal CXR findings in ICU patients after mechanical ventilation (MV). Materials and Methods: A retrospective cohort study was conducted between January 2016 and March 2021 on ICU patients with MV who had at least 48 h of MV, and stayed at least 72 h in the ICU post-MV. Routine daily CXRs and daily changes in the PF ratios were investigated during the three days post-MV. Results: The 186 patients included in the study had a median age of 77 years (interquartile range: 65–82), and 116 (62.4%) were men. One hundred and eight (58.1%) patients had abnormal CXR findings, defined as one or more abnormal CXRs among the daily CXRs during the three days post-extubation. The reintubation rate was higher in the abnormal CXR group (p = 0.01). Of the 558 CXRs (normal = 418, abnormal = 140) and PF ratios, the daily change in PF ratio had a significant predictive accuracy for abnormal CXR findings (AUROC = 0.741, p < 0.01). Conclusions: The change in PF ratio (the Youden index point: ≤−23) had a sensitivity of 65.7%, and a specificity of 79.9%. Based on these results, the daily change in the PF ratio could be utilized as a predictive indicator of abnormal CXRs in ICU patients after MV treatment.

Pharmacotherapy in paediatric heart failure: a Delphi process

BACKGROUND

Little evidence exists to support pharmacotherapeutic strategies for heart failure management in paediatrics. A recent Europe-wide survey suggests that this translates into substantial variability in clinical practice.

OBJECTIVE

To conduct a formal discussion among an expert group of paediatric cardiology physicians on controversial aspects regarding the pharmacotherapy of children heart failure, facilitate consensus, and highlight areas of agreement and disagreement.

METHODS

A two-round modified Delphi process was conducted between July and August 2015. Topics addressed were predominantly selected from the results of a previous Europe-wide survey. Fourteen statements were presented for discussion grouped under three categories; Angiotensin-converting-enzyme-inhibitors: Considerations for optimal dosage; Angiotensin-converting-enzyme-inhibitors for the management of CHDs; Neurohumoral antagonists for the management of dilated cardiomyopathy-related heart failure.

RESULTS

A total of 13 paediatricians dedicated to cardiology from across Europe and the United States of America completed the study; of them, 92% had a working experience in the field of more than 10 years and were working in a specific paediatric cardiology unit. Agreement on the acceptance/rejection of 11 statements was achieved. Results show agreement on the importance of a set of topics relevant to the standardisation of the therapy as well as consensus upon specific therapeutic attitudes.

CONCLUSIONS

We have found areas of common thinking and motivation, which can provide a means of triggering scientific collaboration. Our results might also contribute to disseminate available paediatric evidence and promote reducing unjustified variability in everyday practice. Until solid evidence is available, other research methods can contribute to advancing the goal of safe and effective paediatric heart failure pharmacotherapy.

Trends in Use of Daily Chest Radiographs Among US Adults Receiving Mechanical Ventilation

IMPORTANCE

Guidelines from December 2011 recommended against obtaining daily chest radiographs (CXRs) for patients requiring mechanical ventilation (MV). Daily CXR use for patients receiving MV in US hospitals is unknown and, if high, may represent an opportunity to reduce low-value care and unnecessary radiation.

OBJECTIVES

To determine frequency of daily CXR use for US patients receiving MV, assess variability across hospitals, and evaluate whether use has decreased over time.

DESIGN, SETTING, AND PARTICIPANTS

Retrospective cohort study of hospitalized adults (aged ≥18 years) receiving MV for 3 days or longer. Mechanical ventilation was defined by having an International Classification of Diseases, Ninth Revision, Clinical Modification code of 96.7x and an MV charge on more than 1 hospital day. Hospital discharges in the Premier Perspectives database were examined from July 1, 2008, to December 31, 2014. Data analysis was conducted from July 28, 2017, to December 13, 2017.

EXPOSURES

Hospital discharge date (quarter of the year) and hospital in which patients received MV.

MAIN OUTCOMES AND MEASURES

The outcome was daily CXR use (up to 7 days) during MV. We used standard statistics to describe CXR use, multilevel multivariable regression modeling with adjusted median odds ratio (OR) to evaluate variability by hospital, and multivariable piecewise regression (breakpoint: fourth quarter of 2011) with adjusted OR to evaluate time trends and response to guideline recommendations.

RESULTS

The primary cohort included 512 518 patients receiving MV (mean [SD] age, 63.0 [16.1] years; 46% female) in 416 hospitals, of whom 321 093 (63%) received daily CXRs. Wide variability was seen across hospitals; hospitals performed daily CXRs on a median of 66% of patients (interquartile range, 50%-77%; full range, 12%-97%). The adjusted median OR was 2.43 (95% CI, 2.29-2.59), suggesting the same patient had 2.43-fold higher odds of receiving a daily CXR if admitted to a higher- vs lower-use hospital; the odds of receiving daily CXRs were unchanged through quarter 3 of 2011 (adjusted OR, 1.00; 95% CI, 0.99-1.01), after which there was a 3% relative reduction in the odds of daily CXR use per quarter (adjusted OR, 0.97; 95% CI, 0.96-0.98).

CONCLUSIONS AND RELEVANCE

Three-fifths of US patients receiving MV also received daily CXRs from 2008 to 2014, although use declined slowly after new guidelines were published. The hospital at which a patient received care was associated with the odds of daily CXR receipt.

Daily routine versus on-demand chest radiograph policy and practice in adult ICU patients- clinicians' perspective

Background

Chest radiographs are taken daily as a part of routine investigations in Intensive care unit (ICU) patients. They are less effective and unlikely to alter the management of the majority of these patients compared to the radiographs obtained when indicated. According to the American College of Radiology (ACR) Appropriateness criteria, only selective ordering of chest radiographs is recommended, including elderly or high risk patients. The aim of this study was to identify and assess the clinician’s perspective in abandoning the current practice of daily routine chest radiograph and replacing with the on-demand radiograph in Saudi hospitals.

Methods

This was a cross-sectional study. A valid self-administered questionnaire was distributed to all clinical staff members working in ICUs in the major tertiary hospitals in Saudi Arabia. The study population was primarily the ICU intensivists (physicians), nurses and respiratory therapists (RT). The data collected were statistically processed using SPSS version 20.0; descriptive and inferential analyses were done.

Results

Out of 730 questionnaires sent, we received only 495 completed questionnaires with a response rate of 67.8%. Majority of them (n = 351) are working at academic hospitals. About half of the respondents (n = 247) are working in an open-format ICUs. Findings showed that the daily routine chest X-ray was performed in almost 96.8% of ICUs patients, which the majority of the clinical staff members (73%) thought that this current daily routine CXR protocol in the ICUs should be replaced with the on-demand CXR policy. Interestingly, the differences in demographic and work-related characteristics had no significant impact on the clinician’s view and supported moving to on-demand CXR policy and practice.

Conclusions

The daily routine CXR is still a common practice in most of the Saudi hospitals ICUs although enough empirical evidence shows that it can be avoided. We observed that intensivists support the change of the current practice and recommend an on-demand CXR policy likely to be followed in intensive care management.

Electronic supplementary material

The online version of this article (10.1186/s12880-018-0248-6) contains supplementary material, which is available to authorized users.

Usefulness of radiological signs of pulmonary congestion in predicting failed spontaneous breathing trials

Objective:

Inspiratory fall in intrathoracic pressure during a spontaneous breathing trial (SBT) may precipitate cardiac dysfunction and acute pulmonary edema. We aimed to determine the relationship between radiological signs of pulmonary congestion prior to an SBT and weaning outcomes.

Methods:

This was a post hoc analysis of a prospective cohort study involving patients in an adult medical-surgical ICU. All enrolled individuals met the eligibility criteria for liberation from mechanical ventilation. Tracheostomized subjects were excluded. The primary endpoint was SBT failure, defined as the inability to tolerate a T-piece trial for 30-120 min. An attending radiologist applied a radiological score on interpretation of digital chest X-rays performed before the SBT.

Results:

A total of 170 T-piece trials were carried out; SBT failure occurred in 28 trials (16.4%), and 133 subjects (78.3%) were extubated at first attempt. Radiological scores were similar between SBT-failure and SBT-success groups (median [interquartile range] = 3 [2-4] points vs. 3 [2-4] points; p = 0.15), which, according to the score criteria, represented interstitial lung congestion. The analysis of ROC curves demonstrated poor accuracy (area under the curve = 0.58) of chest x-rays findings of congestion prior to the SBT for discriminating between SBT failure and SBT success. No correlation was found between fluid balance in the 48 h preceding the SBT and radiological score results (ρ = −0.13).

Conclusions:

Radiological findings of pulmonary congestion should not delay SBT indication, given that they did not predict weaning failure in the medical-surgical critically ill population.

(ClinicalTrials.gov identifier: NCT02022839 [http://www.clinicaltrials.gov/])

A web-based delphi study for eliciting helpful criteria in the positive diagnosis of hemophagocytic syndrome in adult patients

The diagnosis of the reactive form of hemophagocytic syndrome in adults remains particularly difficult since none of the clinical or laboratory manifestations are specific. We undertook a study in order to elicit which features constitute helpful criteria for a positive diagnosis. In this Delphi study, the features investigated in the questionnaire and the experts invited to participate in the survey were issued from a bibliographic search. The questionnaire was iteratively proposed to experts via a web-based application with a feedback of the results observed at the preceding Delphi round. Experts were asked to label each investigated criterion in one of the following categories: absolutely required, important, of minor interest, or not assessable in the routine practice environment. A positive consensus was a priori defined as at least 75% answers observed in the categories absolutely required and important. The questionnaire investigated 26 criteria and 24 experts originating from 13 countries participated in the second and final Delphi round. A positive consensus was reached for the nine following criteria: unilineage cytopenia, bicytopenia, pancytopenia, presence of hemophagocytosis pictures on a bone marrow aspirate or on a tissue biopsy, high ferritin level, fever, organomegaly, presence of a predisposing underlying disease, and high level of lactate dehydrogenase. A negative consensus was reached for 13 criteria, and an absence of consensus was observed for 4 criteria. The study constitutes the first initiative to date for defining international guidelines devoted to the positive diagnosis of the reactive form of hemophagocytic syndrome.

Significant changes in the practice of chest radiography in Dutch intensive care units: a web-based survey

Background

ICU patients frequently undergo chest radiographs (CXRs). The diagnostic and therapeutic efficacy of routine CXRs are now known to be low, but the discussion regarding specific indications for CXRs in critically ill patients and the safety of abandoning routine CXRs is still ongoing. We performed a survey of Dutch intensivists on the current practice of chest radiography in their departments.

Methods

Web-based questionnaires, containing questions regarding ICU characteristics, ICU patients, daily CXR strategies, indications for routine CXRs and the practice of radiologic evaluation, were sent to the medical directors of all adult ICUs in the Netherlands. CXR strategies were compared between all academic and non-academic hospitals and between ICUs of different sizes. A comparison was made between the survey results obtained in 2006 and 2013.

Results

Of the 83 ICUs that were contacted, 69 (83%) responded to the survey. Only 7% of responding ICUs were currently performing daily routine CXRs for all patients, and 61% of the responding ICUs were said never to perform CXRs on a routine basis. A daily meeting with a radiologist is an established practice in 72% of the responding ICUs and is judged to be important or even essential by those ICUs. The therapeutic efficacy of routine CXRs was assumed by intensivists to be lower than 10% or to be between 10 and 20%. The efficacy of ‘on-demand’ CXRs was assumed to be between 10 and 60%. There is a consensus between intensivists to perform a routine CXR after endotracheal intubation, chest tube placement or central venous catheterization.

Conclusion

The strategy of daily routine CXRs for critically ill and mechanically ventilated patients has turned from being a common practice in 2006 to a rare current practice. Other routine strategies and an ‘on-demand only’ strategy have become more popular. Intensivists still assume the value of CXRs to be higher than the efficacy that is reported in the literature.

Determination of French influenza outbreaks periods between 1985 and 2011 through a web-based Delphi method

BACKGROUND

Assessing the accuracy of influenza epidemic periods determined by statistical models is important to improve the performance of algorithms used in real-time syndromic surveillance systems. This is a difficult problem to address in the absence of a reliable gold standard. The objective of this study is to establish an expert-based determination of the start and the end of influenza epidemics in France.

METHODS

A three-round international web-based Delphi survey was proposed to 288 eligible influenza experts. Fifty-seven (20%) experts completed the three-rounds of the study. The experts were invited to indicate the starting and the ending week of influenza epidemics, on 32 time-series graphs of influenza seasons drawn using data from the French Sentinelles Network (Influenza-like illness incidence rates) and virological data from the WHO-FluNet. Twenty-six of 32 time-series graphs proposed corresponded to each of the French influenza seasons observed between 1985 and 2011. Six influenza seasons were proposed twice at each round to measure variation among expert responses.

RESULTS

We obtained consensual results for 88% (23/26) of the epidemic periods. In two or three rounds (depending on the season) answers gathered around modes, and the internal control demonstrated a good reproducibility of the answers. Virological data did not appear to have a significant impact on the answers or the level of consensus, except for a season with a major mismatch between virological and incidence data timings.

CONCLUSIONS

Thanks to this international web-based Delphi survey, we obtained reproducible, stable and consensual results for the majority of the French influenza epidemic curves analysed. The detailed curves together with the estimates from the Delphi study could be a helpful tool for assessing the performance of statistical outbreak detection methods, in order to optimize them.

Agreement among healthcare professionals in ten European countries in diagnosing case-vignettes of surgical-site infections

OBJECTIVE

Although surgical-site infection (SSI) rates are advocated as a major evaluation criterion, the reproducibility of SSI diagnosis is unknown. We assessed agreement in diagnosing SSI among specialists involved in SSI surveillance in Europe.

METHODS

Twelve case-vignettes based on suspected SSI were submitted to 100 infection-control physicians (ICPs) and 86 surgeons in 10 European countries. Each participant scored eight randomly-assigned case-vignettes on a secure online relational database. The intra-class correlation coefficient (ICC) was used to assess agreement for SSI diagnosis on a 7-point Likert scale and the kappa coefficient to assess agreement for SSI depth on a three-point scale.

RESULTS

Intra-specialty agreement for SSI diagnosis ranged across countries and specialties from 0.00 (95%CI, 0.00-0.35) to 0.65 (0.45-0.82). Inter-specialty agreement varied from 0.04 (0.00-0.62) in to 0.55 (0.37-0.74) in Germany. For all countries pooled, intra-specialty agreement was poor for surgeons (0.24, 0.14-0.42) and good for ICPs (0.41, 0.28-0.61). Reading SSI definitions improved agreement among ICPs (0.57) but not surgeons (0.09). Intra-specialty agreement for SSI depth ranged across countries and specialties from 0.05 (0.00-0.10) to 0.50 (0.45-0.55) and was not improved by reading SSI definition.

CONCLUSION

Among ICPs and surgeons evaluating case-vignettes of suspected SSI, considerable disagreement occurred regarding the diagnosis, with variations across specialties and countries.

Routine chest x-rays in intensive care units: a systematic review and meta-analysis

Introduction

Chest x-rays (CXRs) are the most frequent radiological tests performed in the intensive care unit (ICU). However, the utility of performing daily routine CXRs is unclear.

Methods

We searched Medline and Embase (1948 to March 2011) for randomized and quasi-randomized controlled trials (RCTs) and before-after observational studies comparing a strategy of routine CXRs to a more restrictive approach with CXRs performed to investigate clinical changes among critically ill adults or children. In duplicate, we extracted data on the CXR strategy, study quality and clinical outcomes (ICU and hospital mortality; duration of mechanical ventilation and ICU and hospital stay).

Results

Nine studies (39,358 CXRs; 9,611 patients) were included in the meta-analysis. Three trials (N = 870) of moderate to good quality provided information on the safety of a restrictive routine CXR strategy; only one trial systematically assessed for missed findings. Pooled data from trials showed no evidence of effect of a restrictive approach on ICU mortality (risk ratio [RR] 1.04, 95% confidence interval [CI] 0.84 to 1.28, P = 0.72; two trials, N = 776), hospital mortality (RR 0.98, 95% CI 0.68 to 1.41, P = 0.91; two trials, N = 259), ICU length of stay (weighted mean difference [WMD] -0.86 days, 95% CI -2.38 to 0.66 days, P = 0.27; three trials, N = 870), hospital length of stay (WMD -2.50 days, 95% CI -6.62 to 1.61 days, P = 0.23; two trials, N = 259), or duration of mechanical ventilation (WMD -0.30 days, 95% CI -1.48 to 0.89 days, P = 0.62; three trials, N = 705). Adding data from six observational studies, one of which systematically screened for missed findings, gave similar results.

Conclusions

This meta-analysis did not detect any harm associated with a restrictive chest radiograph strategy. However, confidence intervals were wide and harm was not rigorously assessed. Therefore, the safety of abandoning routine CXRs in patients admitted to the ICU remains uncertain.

Chest radiographs in 104 French ICUs: current prescription strategies and clinical value (the RadioDay study)

OBJECTIVE

To analyze the current practices of chest radiograph (CXR) prescription and their clinical impact.

DESIGN

Prospective snapshot observational study (on RadioDay) combined with a survey.

PATIENTS

Patients who were given a CXR on RadioDay.

SETTING

One hundred four French intensive care units (ICUs).

RESULTS

On RadioDay, 854 CXRs (in 804 patients) were ordered. For the "CXRs morning round," the prescription policy was declared to be "on-demand" (in 63 % of the ICUs), "daily routine only in mechanically ventilated patients (MV)" (30 %) or, less frequently, "daily routine in all patients" (7 %). When analyzing the two main local policies, as compared with "daily routine only in MV" ICUs, in "on-demand" ICUs: (1) fewer CXRs were ordered (0.6 ± 0.3 vs. 0.9 ± 0.2 CXRs/patient, p < 0.001) with no increase in the rate of unscheduled CXRs (i.e., CXRs performed outside the morning round), and (2) individual CXRs were more often followed by a therapeutic intervention (which would not have occurred without the CXR): 34 vs. 25 % of the CXRs (p < 0.05). Last, in case of severe respiratory disease (low PaO(2)/FiO(2) ratio), it is noteworthy that the clinical value of "on-demand" individual CXRs was still markedly higher than that of "daily routine" CXRs.

CONCLUSION

Nearly two-thirds of the participating ICUs adopted the "on-demand" strategy of prescription, which was associated with a lower rate of CXRs with no increase in unscheduled CXRs and was of higher clinical value than a "daily routine in MV" strategy. Importantly, the study design did not allow assessing if the "on-demand" strategy had missed or delayed some diagnoses.

A short-term, multicomponent infection control program in nursing homes: a cluster randomized controlled trial

OBJECTIVES

To assess the impact of a hygiene-encouragement program on reducing infection rates (primary end point) by 5%.

DESIGN

A cluster randomized study was carried out over a 5-month period.

SETTINGS AND PARTICIPANTS

Fifty nursing homes (NHs) with 4345 beds in France were randomly assigned by stratified-block randomization to either a multicomponent intervention (25 NHs) or an assessment only (25 NHs).

INTERVENTION

The multicomponent intervention was targeted to caregivers and consisted of implementing a bundle of infection prevention consensual measures. Interactive educational meetings using a slideshow were organized at the intervention NHs. The NHs were also provided with color posters emphasizing hand hygiene and a kit that included hygienic products such as alcoholic-based hand sanitizers. Knowledge surveys were performed periodically and served as reminders.

MEASUREMENTS

The primary end point was the total infection rate (urinary, respiratory, and gastrointestinal infections) in those infection cases classified either as definite or probable. Analyses corresponded to the underlying design and were performed according to the intention-to-treat principle. This study was registered (#NCT01069497).

RESULTS

Forty-seven NHs (4515 residents) were included and followed. The incidence rate of the first episode of infection was 2.11 per 1000 resident-days in the interventional group and 2.15 per 1000 resident-days in the control group; however, the difference between the groups did not reach statistical significance in either the unadjusted (Hazard Ratio [HR] = 1.00 [95% confidence interval (CI) 0.89-1.13]; P = .93]) or the adjusted (HR = 0.99 [95% CI 0.87-1.12]; P = .86]) analysis.

CONCLUSION

Disentangling the impact of this type of intervention involving behavioral change in routine practice in caregivers from the prevailing environmental and contextual determinants is often complicated and confusing to interpret the results.

Agreement among health care professionals in diagnosing case Vignette-based surgical site infections

OBJECTIVE

To assess agreement in diagnosing surgical site infection (SSI) among healthcare professionals involved in SSI surveillance.

METHODS

Case-vignette study done in 2009 in 140 healthcare professionals from seven specialties (20 in each specialty, Anesthesiologists, Surgeons, Public health specialists, Infection control physicians, Infection control nurses, Infectious diseases specialists, Microbiologists) in 29 University and 36 non-University hospitals in France. We developed 40 case-vignettes based on cardiac and gastrointestinal surgery patients with suspected SSI. Each participant scored six randomly assigned case-vignettes before and after reading the SSI definition on an online secure relational database. The intraclass correlation coefficient (ICC) was used to assess agreement regarding SSI diagnosis on a seven-point Likert scale and the kappa coefficient to assess agreement for superficial or deep SSI on a three-point scale.

RESULTS

Based on a consensus, SSI was present in 21 of 40 vignettes (52.5%). Intraspecialty agreement for SSI diagnosis ranged across specialties from 0.15 (95% confidence interval, 0.00-0.59) (anesthesiologists and infection control nurses) to 0.73 (0.32-0.90) (infectious diseases specialists). Reading the SSI definition improved agreement in the specialties with poor initial agreement. Intraspecialty agreement for superficial or deep SSI ranged from 0.10 (-0.19-0.38) to 0.54 (0.25-0.83) (surgeons) and increased after reading the SSI definition only among the infection control nurses from 0.10 (-0.19-0.38) to 0.41 (-0.09-0.72). Interspecialty agreement for SSI diagnosis was 0.36 (0.22-0.54) and increased to 0.47 (0.31-0.64) after reading the SSI definition.

CONCLUSION

Among healthcare professionals evaluating case-vignettes for possible surgical site infection, there was large disagreement in diagnosis that varied both between and within specialties.

Criteria to determine readiness for hospital discharge following colorectal surgery: an international consensus using the Delphi technique

BACKGROUND

Standardized discharge criteria are considered valuable to reduce the risk of premature discharge and avoid unnecessary hospital stays. The most appropriate criteria to indicate readiness for discharge after colorectal surgery are unknown.

OBJECTIVE

The aim of this study is to achieve an international consensus on hospital discharge criteria for patients undergoing colorectal surgery.

DESIGN

Fifteen experts from different countries participated in a 3-round Delphi process. In round 1, experts determined which criteria best indicate readiness for discharge and described specific end points for each criterion. In rounds 2 and 3, experts rated their agreement with the use of a 5-point Likert scale.

MAIN OUTCOME MEASURES

Consensus was defined when criteria and end points were rated as agree or strongly agree by at least 75% of the experts in round 3.

RESULTS

Experts reached consensus that patients should be considered ready for hospital discharge when there is tolerance of oral intake, recovery of lower gastrointestinal function, adequate pain control with oral analgesia, ability to mobilize and self-care, and no evidence of complications or untreated medical problems. Specific end points were defined for each of the criteria. Experts also agreed that after these criteria are achieved, discharge may take place as soon as the patient has adequate postdischarge support and is willing to leave the hospital. If a stoma was constructed, the patient or the patient's family should have received training on stoma care or had outpatient training arranged.

LIMITATIONS

The panel comprised mostly experts from developed countries. This may restrict the applicability of these discharge criteria in countries where there are dissimilar health care resources.

CONCLUSION

This Delphi study has provided substantial consensus on discharge criteria for patients undergoing colorectal surgery. We recommend that these criteria be used in clinical practice to guide decisions regarding patient discharge and applied in future research to increase the comparability of study results.

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review

OBJECTIVE

Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice.

METHODOLOGY AND MAIN FINDING

Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility.

CONCLUSION

The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.

An integrated approach for prescribing fewer chest x-rays in the ICU

Chest x-rays (CXRs) are the main imaging tool in intensive care units (ICUs). CXRs also are associated with concerns inherent to their use, considering both healthcare organization and patient perspectives. In recent years, several studies have focussed on the feasibility of lowering the number of bedside CXRs performed in the ICU. Such a decrease may result from two independent and complementary processes: a raw reduction of CXRs due to the elimination of unnecessary investigations, and replacement of the CXR by an alternative technique. The goal of this review is to outline emblematic examples corresponding to these two processes. The first part of the review concerns the accumulation of evidence-based data for abandoning daily routine CXRs in mechanically ventilated patients and adopting an on-demand prescription strategy. The second part of the review addresses the use of alternative techniques to CXRs. This part begins with the presentation of ultrasonography or capnography combined with epigastric auscultation for ensuring the correct position of enteral feeding tubes. Ultrasonography is then also presented as an alternative to CXR for diagnosing and monitoring pneumothoraces, as well as a valuable post-procedural technique after central venous catheter insertion. The combination of the emblematic examples presented in this review supports an integrated global approach for decreasing the number of CXRs ordered in the ICU.

Selection of intensive care unit admission criteria for patients aged 80 years and over and compliance of emergency and intensive care unit physicians with the selected criteria: An observational, multicenter, prospective study

OBJECTIVE

To describe intensive care unit referral decisions by emergency room physicians in patients aged > or =80 yrs.

DESIGN

Prospective, observational cohort study of patients aged > or =80 yrs who were triaged in the emergency room, using a list of intensive care unit admission criteria selected by emergency physicians among 76 preliminary criteria adapted from the 1999 Society of Critical Care Medicine guidelines. The Delphi method was used to select the criteria.

SETTING

Fifteen French hospitals.

PATIENTS

A total of 2646 patients aged > or =80 yrs with at least one criterion.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

In the Delphi process, level of agreement was assessed as follows: when all answers fell within a single interval (7-9 = definite admission criteria; 4-6 = equivocal admission criteria or 1-3 = inappropriate admission), agreement was strong; when answers spanned two intervals, agreement was fair; and when answers spanned all three intervals, agreement was poor. Of the 76 preliminary criteria, two were removed; 44 were selected as definite intensive care unit admission criteria; and 30 were selected as equivocal intensive care unit admission criteria. Of the 1426 patients meeting definite admission criteria, 441 (30.9%) were referred for intensive care unit admission and 231 of 441 (52.4%) were admitted to the intensive care unit. Of the 1041 patients with equivocal admission criteria, 181 (17.3%) were referred for intensive care unit admission; and, of these, 79 (43.6%) were admitted to the intensive care unit. Factors associated independently with no intensive care unit referral were age odds ratio [OR], 1.04; 95% confidence interval [CI], 1.04-1.07), active cancer (OR, 1.61; 95% CI, 1.09-1.38), unknown hospitalization status (OR, 1.53; 95% CI, 1.11-2.11), unknown living arrangements (OR, 1.69; 95% CI, 1.19-2.42), regular psychotropic medications (OR, 1.42; 95% CI, 1.10-1.81), low severity at referral (OR, 0.60; 95% CI, 0.53-0.68), low activity in daily living score (OR, 0.93; 95% CI, 0.88-0.99).

CONCLUSIONS

Emergency and intensive care unit physicians were extremely reluctant to consider intensive care unit admission of patients aged > or =80 yrs, despite the presence of criteria indicating that intensive care unit admission was certainly or possibly appropriate.

Comparison of routine and on-demand prescription of chest radiographs in mechanically ventilated adults: a multicentre, cluster-randomised, two-period crossover study

BACKGROUND

Present guidelines recommend routine daily chest radiographs for mechanically ventilated patients in intensive care units. However, some units use an on-demand strategy, in which chest radiographs are done only if warranted by the patient's clinical status. By comparison between routine and on-demand strategies, we aimed to establish which strategy was more efficient and effective for optimum patient care.

METHODS

In a cluster-randomised, open-label crossover study, we randomly assigned 21 intensive care units at 18 hospitals in France to use a routine or an on-demand strategy for prescription of chest radiographs during the first of two treatment periods. Units used the alternative strategy in the second period. Each treatment period lasted for the time taken for enrolment and study of 20 consecutive patients per intensive care unit; patients were monitored until discharge from the unit or for up to 30 days' mechanical ventilation, whichever was first. Units enrolled 967 patients, but 118 were excluded because they had been receiving mechanical ventilation for less than 2 days. The primary outcome measure was the mean number of chest radiographs per patient-day of mechanical ventilation. Analysis was by intention to treat. This study is registered with ClinicalTrials.gov, number NCT00893672.

FINDINGS

11 intensive care units were randomly allocated to use a routine strategy to order chest radiographs in the first treatment period, and 10 units to use an on-demand strategy. Overall, 424 patients had 4607 routine chest radiographs (mean per patient-day of mechanical ventilation 1.09, 95% CI 1.05-1.14), and 425 had 3148 on-demand chest radiographs (mean 0.75, 0.67-0.83), which corresponded to a reduction of 32% (95% CI 25-38) with the on-demand strategy (p<0.0001).

INTERPRETATION

Our results strongly support adoption of an on-demand strategy in preference to a routine strategy to decrease use of chest radiographs in mechanically ventilated patients without a reduction in patients' quality of care or safety.

FUNDING

Assistance Publique-Hôpitaux de Paris (Direction Régionale de la Recherche Clinique Ile de France).