A matched-pair cluster design study protocol to evaluate implementation of the Canadian C-spine rule in hospital emergency departments: Phase III

Wilderness Medical Society Clinical Practice Guidelines for Spinal Cord Protection: 2024 Update

The Wilderness Medical Society reconvened an expert panel to update best practice guidelines for spinal cord protection during trauma management. This panel, with membership updated in 2023, was charged with the development of evidence-based guidelines for management of the injured or potentially injured spine in wilderness environments. Recommendations are made regarding several parameters related to spinal cord protection. These recommendations are graded based on the quality of supporting evidence and balance the benefits and risks/burdens for each parameter according to American College of Chest Physicians methodology. Key recommendations include the concept that interventions should be goal-oriented (spinal cord/column protection in the context of overall patient and provider safety) rather than technique-oriented (immobilization). An evidence-based, goal-oriented approach excludes the immobilization of suspected spinal injuries via rigid collars or backboards.

Mobile Clinical Decision Tools Among Emergency Department Clinicians: Web-Based Survey and Analytic Data for Evaluation of The Ottawa Rules App

BACKGROUND

The Canadian CT Head Rule (CCHR), the Canadian Transient Ischemic Attack (TIA) Score, and the Subarachnoid Hemorrhage (SAH) Rule have all previously demonstrated the potential to significantly standardize care and improve the management of patients in emergency departments (EDs). On the basis of user feedback, we believe that the addition of these rules to the Ottawa Rules App has the potential to increase the app's usability and user acceptability.

OBJECTIVE

This study aimed to evaluate the perceived usefulness, acceptability, and uptake of the enhanced Ottawa Rules App (which now includes CCHR, TIA, and SAH Rules) among ED clinicians (medical students, residents, nurses, and physicians).

METHODS

The enhanced Ottawa Rules App was publicly released for free on iOS and Android operating systems in November 2018. This study was conducted across 2 tertiary EDs in Ottawa, Canada. Posters, direct enrollment, snowball sampling, and emails were used for study recruitment. A 24-question Web-based survey was administered to participants via email, and this was used to determine user acceptability of the app and Technology Readiness Index (TRI) scores. In-app user analytics were collected to track user behavior, such as the number of app sessions, length of app sessions, frequency of rule use, and the date app was first opened.

RESULTS

A total of 77 ED clinicians completed the study, including 34 nurses, 12 residents, 14 physicians, and 17 medical students completing ED rotations. The median TRI score for this group was 3.38, indicating a higher than average propensity to embrace and adopt new technologies to accomplish goals in their work or daily lives. The majority of respondents agreed or strongly agreed that the app helped participants accurately carry out the clinical rules (56/77, 73%) and that they would recommend this app to their colleagues (64/77, 83%). Feedback from study participants suggested further expansion of the app-more clinical decision rules (CDRs) and different versions of the app tailored to the clinician role. Analysis and comparison of Google Analytics data and in-app data revealed similar usage behavior among study-enrolled users and all app users globally.

CONCLUSIONS

This study provides evidence that using the Ottawa Rules App (version 3.0.2) to improve and guide patient care would be feasible and widely accepted. The ability to verify self-reported user data (via a Web-based survey) against server analytics data is a notable strength of this study. Participants' continued app use and request for the addition of more CDRs warrant the further development of this app and call for additional studies to evaluate its feasibility and usability in different settings as well as assessment of clinical impact.

Acceptability of a Mobile Clinical Decision Tool Among Emergency Department Clinicians: Development and Evaluation of The Ottawa Rules App

Background

The Ottawa Ankle Rules, Ottawa Knee Rule, and Canadian C-Spine Rule—together known as The Ottawa Rules—are a set of internationally validated clinical decision rules developed to decrease unnecessary diagnostic imaging in the emergency department. In this study, we sought to develop and evaluate the use of a mobile app version of The Ottawa Rules.

Objective

The primary objective of this study was to determine acceptability of The Ottawa Rules app among emergency department clinicians. The secondary objective was to evaluate the effect of publicity efforts on uptake of The Ottawa Rules app.

Methods

The Ottawa Rules app was developed and publicly released for free on iOS and Android operating systems in April 2016. Local and national news and academic media coverage coincided with app release. This study was conducted at a large tertiary trauma care center in Ottawa, Canada. The study was advertised through posters and electronically by email. Emergency department clinicians were approached in person to enroll via in-app consent for a 1-month study during which time they were encouraged to use the app when evaluating patients with suspected knee, foot, or neck injuries. A 23-question survey was administered at the end of the study period via email to determine self-reported frequency, perceived ease of use of the app, and participant Technology Readiness Index scores.

Results

A total of 108 emergency department clinicians completed the study including 42 nurses, 33 residents, 20 attending physicians, and 13 medical students completing emergency department rotations. The median Technology Readiness Index for this group was 3.56, indicating a moderate degree of openness for technological adoption. The majority of survey respondents indicated favorable receptivity to the app including finding it helpful to applying the rules (73/108, 67.6%), that they would recommend the app to colleagues (81/108, 75.0%), and that they would continue using the app (73/108, 67.6%). Feedback from study participants highlighted a desire for access to more clinical decision rules and a higher degree of interactivity of the app. Between April 21, 2016, and June 1, 2017, The Ottawa Rules app was downloaded approximately 4000 times across 89 countries.

Conclusions

We have found The Ottawa Rules app to be an effective means to disseminate the Ottawa Ankle Rules, Ottawa Knee Rule, and Canadian C-Spine Rule among all levels of emergency department clinicians. We have been successful in monitoring uptake and access of the rules in the app as a result of our publicity efforts. Mobile technology can be leveraged to improve the accessibility of clinical decision tools to health professionals.

Theory of planned behaviour can help understand processes underlying the use of two emergency medicine diagnostic imaging rules

Background

Clinical decision rules (CDRs) can be an effective tool for knowledge translation in emergency medicine, but their implementation is often a challenge. This study examined whether the Theory of Planned Behaviour (TPB) could help explain the inconsistent results between the successful Canadian C-Spine Rule (CCR) implementation study and unsuccessful Canadian CT Head Rule (CCHR) implementation study. Both rules are aimed at improving the accuracy and efficiency of emergency department radiography use in clinical contexts that exhibit enormous inefficiency at the present time. The rules were prospectively derived and validated using the same methodology demonstrating high sensitivity and reliability. The rules subsequently underwent parallel implementations at 12 Canadian hospitals, yet only the CCR was observed to significantly reduce radiography ordering rates, while the CCHR failed to have any significant impact at all. The drastically different results are unlikely to be the result of differences in implementation strategies or the decision rules.

Methods

Physicians at the 12 participating Canadian hospitals were randomized to CCR or CCHR TPB surveys that were administered during the baseline phases of the implementation studies, before any intervention had taken place. The collected baseline survey data were linked to concurrent baseline physician and patient-specific imaging data, and subsequently analyzed using mixed effects linear and logistic models.

Results

A total of 223 of the 378 eligible physicians randomized to a TPB survey completed their assigned baseline survey (CCR: 122 of 181; CCHR: 101 of 197). Attitudes were significantly associated with intention in both settings (CCR: ß = 0.40; CCHR: ß = 0.30), as were subjective norms (CCR: ß = 0.26; CCHR: ß = 0.73). Intention was significantly associated with actual image ordering for CCR (OR = 1.79), but not CCHR.

Conclusions

The TPB can be used to better understand processes underlying use of CDRs. TPB constructs were significantly associated with intention to perform both imaging behaviours, but intention was only associated with actual behaviour for CCR, suggesting that constructs outside of the TPB framework may need to be considered when seeking to understand use of CDRs.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-014-0088-x) contains supplementary material, which is available to authorized users.

Effect of the Low Risk Ankle Rule on the frequency of radiography in children with ankle injuries

BACKGROUND

The Low Risk Ankle Rule is a validated clinical decision rule that has the potential to safely reduce radiography in children with acute ankle injuries. We performed a phased implementation of the Low Risk Ankle Rule and evaluated its effectiveness in reducing the frequency of radiography in children with ankle injuries.

METHODS

Six Canadian emergency departments participated in the study from Jan. 1, 2009, to Aug. 31, 2011. At the 3 intervention sites, there were 3 consecutive 26-week phases. In phase 1, no interventions were implemented. In phase 2, we activated strategies to implement the ankle rule, including physician education, reminders and a computerized decision support system. In phase 3, we included only the decision support system. No interventions were introduced at the 3 pair-matched control sites. We examined the management of ankle injuries among children aged 3-16 years. The primary outcome was the proportion of children undergoing radiography.

RESULTS

We enrolled 2151 children with ankle injuries, 1055 at intervention and 1096 at control hospitals. During phase 1, the baseline frequency of pediatric ankle radiography at intervention and control sites was 96.5% and 90.2%, respectively. During phase 2, the frequency of ankle radiography decreased significantly at intervention sites relative to control sites (between-group difference -21.9% [95% confidence interval [CI] -28.6% to -15.2%]), without significant differences in patient or physician satisfaction. All effects were sustained in phase 3. The sensitivity of the Low Risk Ankle Rule during implementation was 100% (95% CI 85.4% to 100%), and the specificity was 53.1% (95% CI 48.1% to 58.1%).

INTERPRETATION

Implementation of the Low Risk Ankle Rule in several different emergency department settings reduced the rate of pediatric ankle radiography significantly and safely, without an accompanying change in physician or patient satisfaction.

TRIAL REGISTRATION

ClinicalTrials.gov, no. NCT00785876.

Wilderness Medical Society practice guidelines for spine immobilization in the austere environment

In an effort to produce best-practice guidelines for spine immobilization in the austere environment, the Wilderness Medical Society convened an expert panel charged with the development of evidence-based guidelines for management of the injured or potentially injured spine in an austere (dangerous or compromised) environment. Recommendations are made regarding several factors related to spinal immobilization. These recommendations are graded based on the quality of supporting evidence and balance between the benefits and risks or burdens for each factor according to the methodology stipulated by the American College of Chest Physicians. A treatment algorithm based on the guidelines is presented.

Understanding the Canadian adult CT head rule trial: use of the theoretical domains framework for process evaluation

BACKGROUND

The Canadian CT Head Rule was prospectively derived and validated to assist clinicians with diagnostic decision-making regarding the use of computed tomography (CT) in adult patients with minor head injury. A recent intervention trial failed to demonstrate a decrease in the rate of head CTs following implementation of the rule in Canadian emergency departments. Yet, the same intervention, which included a one-hour educational session and reminders at the point of requisition, was successful in reducing cervical spine imaging rates in the same emergency departments. The reason for the varied effect of the intervention across these two behaviours is unclear. There is an increasing appreciation for the use of theory to conduct process evaluations to better understand how strategies are linked with outcomes in implementation trials. The Theoretical Domains Framework (TDF) has been used to explore health professional behaviour and to design behaviour change interventions but, to date, has not been used to guide a theory-based process evaluation. In this proof of concept study, we explored whether the TDF could be used to guide a retrospective process evaluation to better understand emergency physicians' responses to the interventions employed in the Canadian CT Head Rule trial.

METHODS

A semi-structured interview guide, based on the 12 domains from the TDF, was used to conduct telephone interviews with project leads and physician participants from the intervention sites in the Canadian CT Head Rule trial. Two reviewers independently coded the anonymised interview transcripts using the TDF as a coding framework. Relevant domains were identified by: the presence of conflicting beliefs within a domain; the frequency of beliefs; and the likely strength of the impact of a belief on the behaviour.

RESULTS

Eight physicians from four of the intervention sites in the Canadian CT Head Rule trial participated in the interviews. Barriers likely to assist with understanding physicians' responses to the intervention in the trial were identified in six of the theoretical domains: beliefs about consequences; beliefs about capabilities; behavioural regulation; memory, attention and decision processes; environmental context and resources; and social influences. Despite knowledge that the Canadian CT Head Rule was highly sensitive and reliable for identifying clinically important brain injuries and strong beliefs about the benefits for using the rule, a number of barriers were identified that may have prevented physicians from consistently applying the rule.

CONCLUSION

This proof of concept study demonstrates the use of the TDF as a guiding framework to design a retrospective theory-based process evaluation. There is a need for further development and testing of methods for using the TDF to guide theory-based process evaluations running alongside behaviour change intervention trials.

Implementation of the Canadian C-Spine Rule: prospective 12 centre cluster randomised trial

OBJECTIVE

To evaluate the effectiveness of an active strategy to implement the validated Canadian C-Spine Rule into multiple emergency departments.

DESIGN

Matched pair cluster randomised trial.

SETTING

University and community emergency departments in Canada. Participants 11 824 alert and stable adults presenting with blunt trauma to the head or neck at one of 12 hospitals.

INTERVENTIONS

Six hospitals were randomly allocated to the intervention and six to the control. At the intervention sites, active strategies were used to implement the Canadian C-Spine Rule, including education, policy, and real time reminders on radiology requisitions. No specific intervention was introduced to alter the behaviour of doctors requesting cervical spine imaging at the control sites.

MAIN OUTCOME MEASURE

Diagnostic imaging rate of the cervical spine during two 12 month before and after periods.

RESULTS

Patients were balanced between control and intervention sites. From the before to the after periods, the intervention group showed a relative reduction in cervical spine imaging of 12.8% (95% confidence interval 9% to 16%; 61.7% v 53.3%; P=0.01) and the control group a relative increase of 12.5% (7% to 18%; 52.8% v 58.9%; P=0.03). These changes were significant when both groups were compared (P<0.001). No fractures were missed and no adverse outcomes occurred.

CONCLUSIONS

Implementation of the Canadian C-Spine Rule led to a significant decrease in imaging without injuries being missed or patient morbidity. Final imaging rates were much lower at intervention sites than at most US hospitals. Widespread implementation of this rule could lead to reduced healthcare costs and more efficient patient flow in busy emergency departments worldwide.

TRIAL REGISTRATION

Clinical trials NCT00290875.

Assessing the sensibility of two clinical decision support systems

Clinicians in Emergency Medicine (EM) are increasingly exposed to guidelines and treatment recommendations. To help access and recall these recommendations, electronic Clinical Decision Support Systems (CDSS) have been developed. This study examined the use and sensibility of two CDSS designed for emergency physicians. CDDS for community acquired pneumonia (CAP) and neutropenic fever (NF) were developed by multidisciplinary teams and have been accessed via an intranet-based homepage (eCPG) for several years. Sensibility is a term coined by Feinstein that describes common sense aspects of a survey instrument. It was modified by emergency researchers to include four main headings: (1) Appropriateness; (2) Objectivity; (3) Content; and (4) Discriminative Power. Sensibility surveys were developed using an iterative approach for both the CAP and NF CDSS and distributed to all 25 emergency physicians at one Canadian site. The overall response rate was 88%. Respondents were 88% male and 83% were less than 40; all were attending EM physicians with specialty designations. A number reported never having used the CAP (21%) or NF (33%) CDSS; 54% (CAP) and 21% (NF) of respondents had used the respective CDSS less than 10 times. Overall, both CDSS were rated highly by users with a mean response of 4.95 (SD 0.56) for CAP and 5.62 (SD 0.62) for NF on a seven-point Likert scale. The majority or respondents (CAP 59%, NF 80%) felt that the NF CDSS was more likely than the CAP CDSS to decrease the chances of making a medical error in medication dose, antibiotic choice or patient disposition (4.61 vs. 5.81, p=0.008). Despite being in place for several years, CDSS for CAP and NF are not used by all EM clinicians. Users were generally satisfied with the CDSS and felt that the NF was more likely than the CAP CDSS to decrease medical errors. Additional research is required to determine the barriers to CDSS use.

A survey of attitudes and factors associated with successful cardiopulmonary resuscitation (CPR) knowledge transfer in an older population most likely to witness cardiac arrest: design and methodology

BACKGROUND

Overall survival rates for out-of-hospital cardiac arrest rarely exceed 5%. While bystander cardiopulmonary resuscitation (CPR) can increase survival for cardiac arrest victims by up to four times, bystander CPR rates remain low in Canada (15%). Most cardiac arrest victims are men in their sixties, they usually collapse in their own home (85%) and the event is witnessed 50% of the time. These statistics would appear to support a strategy of targeted CPR training for an older population that is most likely to witness a cardiac arrest event. However, interest in CPR training appears to decrease with advancing age. Behaviour surrounding CPR training and performance has never been studied using well validated behavioural theories.

METHODS/DESIGN

The overall goal of this study is to conduct a survey to better understand the behavioural factors influencing CPR training and performance in men and women 55 years of age and older. The study will proceed in three phases. In phase one, semi-structured qualitative interviews will be conducted and recorded to identify common categories and themes regarding seeking CPR training and providing CPR to a cardiac arrest victim. The themes identified in the first phase will be used in phase two to develop, pilot-test, and refine a survey instrument based upon the Theory of Planned Behaviour. In the third phase of the project, the final survey will be administered to a sample of the study population over the telephone. Analyses will include measures of sampling bias, reliability of the measures, construct validity, as well as multiple regression analyses to identify constructs and beliefs most salient to seniors' decisions about whether to attend CPR classes or perform CPR on a cardiac arrest victim.

DISCUSSION

The results of this survey will provide valuable insight into factors influencing the interest in CPR training and performance among a targeted group of individuals most susceptible to witnessing a victim in cardiac arrest. The findings can then be applied to the design of trials of various interventions designed to promote attendance at CPR classes and improve CPR performance.

TRIAL REGISTRATION

ClinicalTrials.gov NCT00665288.