Emergency department image interpretation accuracy: The influence of immediate reporting by radiology

Evaluating the impact of artificial intelligence-assisted image analysis on the diagnostic accuracy of front-line clinicians in detecting fractures on plain X-rays (FRACT-AI): protocol for a prospective observational study

INTRODUCTION

Missed fractures are the most frequent diagnostic error attributed to clinicians in UK emergency departments and a significant cause of patient morbidity. Recently, advances in computer vision have led to artificial intelligence (AI)-enhanced model developments, which can support clinicians in the detection of fractures. Previous research has shown these models to have promising effects on diagnostic performance, but their impact on the diagnostic accuracy of clinicians in the National Health Service (NHS) setting has not yet been fully evaluated.

METHODS AND ANALYSIS

A dataset of 500 plain radiographs derived from Oxford University Hospitals (OUH) NHS Foundation Trust will be collated to include all bones except the skull, facial bones and cervical spine. The dataset will be split evenly between radiographs showing one or more fractures and those without. The reference ground truth for each image will be established through independent review by two senior musculoskeletal radiologists. A third senior radiologist will resolve disagreements between two primary radiologists. The dataset will be analysed by a commercially available AI tool, BoneView (Gleamer, Paris, France), and its accuracy for detecting fractures will be determined with reference to the ground truth diagnosis. We will undertake a multiple case multiple reader study in which clinicians interpret all images without AI support, then repeat the process with access to AI algorithm output following a 4-week washout. 18 clinicians will be recruited as readers from four hospitals in England, from six distinct clinical groups, each with three levels of seniority (early-stage, mid-stage and later-stage career). Changes in the accuracy, confidence and speed of reporting will be compared with and without AI support. Readers will use a secure web-based DICOM (Digital Imaging and Communications in Medicine) viewer (www.raiqc.com), allowing radiograph viewing and abnormality identification. Pooled analyses will be reported for overall reader performance as well as for subgroups including clinical role, level of seniority, pathological finding and difficulty of image.

ETHICS AND DISSEMINATION

The study has been approved by the UK Healthcare Research Authority (IRAS 310995, approved on 13 December 2022). The use of anonymised retrospective radiographs has been authorised by OUH NHS Foundation Trust. The results will be presented at relevant conferences and published in a peer-reviewed journal.

TRIAL REGISTRATION NUMBERS

This study is registered with ISRCTN (ISRCTN19562541) and ClinicalTrials.gov (NCT06130397). The paper reports the results of a substudy of STEDI2 (Simulation Training for Emergency Department Imaging Phase 2).

Formalising written preliminary image evaluation by Australian radiographers: a review of practice value

The Medical Radiation Practice Board of Australia (MRPBA) minimum competency framework requires all Australian radiographers to identify significant pathology in radiological images and take appropriate action to alert these urgent findings and ensure patient safety. Despite professional bodies endorsing the provision of preliminary image evaluations (PIE) in written format, radiographer image interpretation often remains inconsistent, informal, or undocumented. The purpose of this narrative review was to assess the literature to determine if PIE in the form of written radiographer comments is of value to the Australian healthcare system. A structured search was completed using four health research databases: CINAHL, Medline, Scopus and Web of Science. Studies have suggested that there is a contextual need for commenting due to increased imaging service pressures, radiologist shortages and subsequent reporting delays. Radiographers appear well placed and willing to provide accurate initial input with evidence that this would be valued and appreciated within the multidisciplinary team. Radiographer commenting has also been shown to reduce diagnostic and communicative errors with the potential to improve patient management. Finally, it was shown that participation in image interpretation practices can enhance recruitment, retention and job satisfaction among radiographers. Therefore, the current literature supports implementation of radiographer commenting within the Australian healthcare system.

Nurse practitioners' use of diagnostic imaging: A scoping review

AIM

To explore the nature and extent of peer-reviewed literature related to the use of diagnostic imaging by nurse practitioners (NPs) to inform future practice and research.

BACKGROUND

Nurse practitioners undertake advanced assessment, diagnosis, and management of patients, including requesting and interpretation of diagnostic imaging. It is unclear what evidence exists related to the quality use of radiological investigations by NPs in recent years.

DESIGN

A scoping review based on the steps suggested by the Joanna Briggs Institute.

METHODS

A structured review of the databases Medline, CINAHL and Embase was undertaken using the keywords and MESH terms 'nurse practitioner', 'medical imaging', 'diagnostic imaging', 'scan' and 'radiography'. Only English language articles were included, and no date limit was applied. Database review was completed on 30 May 2021.

RESULTS

Eight themes were identified-country and clinical context, requesting diagnostic imaging, performing diagnostic imaging, image-guided interventions, interpreting diagnostic imaging, training education and knowledge, impact on resource usage and comparison with medical practitioners. There were more studies across a greater breadth of clinical specialties and imaging modalities in the United States than in other countries. Nurse practitioner practice is frequently benchmarked against that of medical colleagues. There is a paucity of studies focusing on educational preparation and the lack of relevant university curricula for NPs around diagnostic imaging.

CONCLUSION

There are significant gaps in the evidence outside of the United States across several of the identified themes. Further studies are needed to explore NP access to and use of diagnostic imaging and to understand the barriers and facilitators to this.

RELEVANCE TO CLINICAL PRACTICE

Studies from four countries were included in this review. The evidence suggests that, where studied, nurse practitioners (NPs) can safely and appropriately request and interpret plain x-rays in the emergency and minor injuries setting. Further research is needed to evaluate the educational needs of NPs in relation to diagnostic imaging and their use of advanced imaging techniques, particularly outside of the United States.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

Australian radiographer roles in the emergency department; evidence of regulatory compliance to improve patient safety - A narrative review

OBJECTIVES

Using a narrative approach, this paper aims to determine the extent of Australian radiographers' regulatory compliance to improve patient safety when performing appendicular X-ray and non-contrast brain computed tomography (CT) in the Emergency Department (ED).

KEY FINDINGS

A narrative review explored relevant literature and key regulatory policy. Ten documents were identified, three main themes were developed related to the radiographer roles in X-ray request justification, dose optimisation and preliminary image evaluation (PIE). Radiographers were equally aware of justification and optimisation pre and post the introduction of a Medical Code of Practice. The collective PIE accuracy of radiographers remained unaffected by changes in mode of PIE delivery and regulatory factors but varied based on the anatomical region.

CONCLUSION

While current Australian regulations mandate radiographer request justification, dose optimisation and PIE, the degree of compliance by Australian radiographers remains uncertain. Current literature provides evidence that radiographers can improve patient care and safety through justification, optimisation, and PIE delivery. Change in workplace practice, supported by key stakeholders including radiologists, is essential to integrate radiographers' functions into routine ED clinical practice. Further research is required to audit radiographers' regulatory compliance to improve patient safety.

IMPLICATIONS FOR PRACTICE

Patient safety in ED can be improved with timely and accurate diagnosis provided by radiographers. Radiographers have a professional obligation to adhere to the capabilities and standards for safe medical radiation practice defined by Australian regulations. Therefore, radiographers must justify the X-ray request, optimise the radiation dose where appropriate and communicate urgent or unexpected findings to the referrer.

Assessing the barriers and enablers to the implementation of the diagnostic radiographer musculoskeletal X-ray reporting service within the NHS in England: a systematic literature review

INTRODUCTION

The United Kingdom (UK) government's healthcare policy in the early 1990s paved the way adoption of the skills mix development and implementation of diagnostic radiographers' X-ray reporting service. Current clinical practice within the public UK healthcare system reflects the same pressures of increased demand in patient imaging and limited capacity of the reporting workforce (radiographers and radiologists) as in the 1990s. This study aimed to identify, define and assess the longitudinal macro, meso, and micro barriers and enablers to the implementation of the diagnostic radiographer musculoskeletal X-ray reporting service in the National Healthcare System (NHS) in England.

METHODS

Multiple independent databases were searched, including PubMed, Ovid MEDLINE; Embase; CINAHL, and Google Scholar, as well as journal databases (Scopus, Wiley), healthcare databases (NHS Evidence Database; Cochrane Library) and grey literature databases (OpenGrey, GreyNet International, and the British Library EthOS depository) and recorded in a PRISMA flow chart. A combination of keywords, Boolean logic, truncation, parentheses and wildcards with inclusion/exclusion criteria and a time frame of 1995-2022 was applied. The literature was assessed against Joanna Briggs Institute's critical appraisal checklists. With meta-aggregation to synthesize each paper, and coded using NVivo, with context grouped into macro, meso, and micro-level sources and categorised into subgroups of enablers and barriers.

RESULTS

The wide and diverse range of data (n = 241 papers) identified barriers and enablers of implementation, which were categorised into measures of macro, meso, and micro levels, and thematic categories of context, culture, environment, and leadership.

CONCLUSION

The literature since 1995 has reframed the debates on implementation of the radiographer reporting role and has been instrumental in shaping clinical practice. There has been clear influence upon both meso (professional body) and macro-level (governmental/health service) policies and guidance, that have shaped change at micro-level NHS Trust organisations. There is evidence of a shift in culturally intrenched legacy perspectives within and between different meso-level professional bodies around skills mix acceptance and role boundaries. This has helped shape capacity building of the reporting workforce. All of which have contributed to conceptual understandings of the skills mix workforce within modern radiology services.

Medical imaging consultation practices and challenges at public hospitals in the Amhara regional state, Northwest Ethiopia: a descriptive phenomenological study

BACKGROUND

Medical imaging plays a vital role in the accurate diagnosis, treatment and outcome prediction of many diseases and injuries. However, in many African countries, deserving populations do not have access to the proper medical imaging specialists' services. As a result, clinicians continue to struggle to provide medical imaging via consultation. However, little is known about conventional referral consultation practices and their challenges. This study, therefore, aimed to explore the practice and challenges of medical imaging service consultation among health professionals and patients in the context of the Ethiopian public healthcare delivery system.

METHODS

Descriptive phenomenological study was employed to explore the practice of medical imaging service consultation among health professionals and patients in public hospitals of Amhara region from October 12, 2021 to December 29, 2021. Semi-structured interview guides were prepared separately for key-informant and in-depth interviews. A total of 21 participants (6 hospital managers, 4 medical directors, 4 department heads, 3 medical imaging coordinators and 4 patients) were selected using the maximum variation sampling technique. All interviews were audio-recorded, transcribed verbatim and subjected to inductive thematic analysis using Open Code 4.02 software.

RESULTS

Six major themes emerged following the thematic analysis: (1) medical image service delivery practices; (2) medical imaging consultation modalities; (3) benefits and drawbacks of the consultation modalities; (4) challenges; (5) challenge mitigation strategies; and (6) future recommendations. Image films, compact disks, and telegram apps were the consultation modalities used by the referring clinicians to send the medical images to radiologists. Frequent failure of imaging machines, delayed equipment maintenance, inadequate infrastructure, shortage of budget, lack of radiologists, and low-quality of printed image films were among the challenges influencing the medical imaging consultation service.

CONCLUSIONS

This research explored onsite and referral imaging consultation practices. However, there are many challenges encountered by the referring clinicians and the radiologists during the consultation process. These challenges could potentially affect clinicians' ability to provide timely diagnosis and treatment services which would ultimately affects patient health status and service delivery. Virtual consultation via teleradiology and enhancing clinicians' competence through long-term and short-term trainings are recommended to improve the referral consultation practice.

Assessing Referrals to a Trauma and Orthopaedic Department: Evaluation of a Traffic Light System for Virtual Fracture Clinic in the Emergency Department and Urgent Care

Background The Trauma and Orthopaedic (T&O) on-call service receives referrals from the emergency department (ED), general practice (GP) and urgent treatment centres (UTCs) and requests for inpatient reviews. The virtual fracture clinic (VFC) pathway allows ED and UTC clinicians to assess, discharge and refer when necessary. For VFC, the on-call orthopaedic consultant reviews the cases the next working day and makes an appropriate plan. This pathway consists of a traffic light system, in which practitioners can either safely discharge with written advice (green), refer to the VFC (yellow) or refer to the on-call team (red). Method The aim of this study was to assess how the VFC pathway was being utilised. All referrals to the T&O on-call team over three weeks were evaluated retrospectively. The following referrals were excluded: fractured femur, head injury, trauma calls and back pain pathway. The following data were collected: patient details, diagnosis, referral source, reason for referral, plan, double booking with VFC and appropriateness. Results A total of 191 referrals were analysed. Most referrals are from the ED (51%) and UTC (23%). Of the referrals, 39% were deemed to be inappropriate. Of the inappropriate referrals, 35% should have been referred directly to the VFC rather than the on-call team. A significant minority (7%) of inappropriate referrals were referred to the on-call team and VFC. Conclusion Education and collaboration are required with the ED and UTC to ensure the proper use of the VFC pathway. Immediate radiograph reporting may also be beneficial.

A Mixed-Methods Systematic Review of the Effectiveness and Experiences of Quality Improvement Interventions in Radiology

OBJECTIVE

This study aimed to compile and synthesize evidence regarding the effectiveness of quality improvement interventions in radiology and the experiences and perspectives of staff and patients.

METHODS

Databases searched for both published and unpublished studies were as follows: EMBASE, MEDLINE, CINAHL, Joanna Briggs Institute, Cochrane Central Register of Controlled Trials, PsycINFO, Scopus, Web of Science, Mednar, Trove, Google Gray, OCLC WorldCat, and Dissertations and Theses. This review included both qualitative and quantitative studies of patients undergoing radiological examinations and/or medical imaging health care professionals; a broad range of quality improvement interventions including introduction of health information technology, effects of training and education, improved reporting, safety programs, and medical devices; the experiences and perspectives of staff and patients; context of radiological setting; a broad range of outcomes including patient safety; and a result-based convergent synthesis design.

RESULTS

Eighteen studies were selected from 4846 identified by a systematic literature search. Five groups of interventions were identified: health information technology (n = 6), training and education (n = 6), immediate and critical reporting (n = 3), safety programs (n = 2), and the introduction of mobile radiography (n = 1), with demonstrated improvements in outcomes, such as improved operational and workflow efficiency, report turnaround time, and teamwork and communication.

CONCLUSIONS

The findings were constrained by the limited range of interventions and outcome measures. Further research should be conducted with study designs that might produce findings that are more generalizable, examine the other dimensions of quality, and address the issues of cost and risk versus benefit.

Advanced paramedics and nurses can deliver safe and effective pre-hospital and in-hospital emergency care: An integrative review

AIM

To explore and present an overview of scope of practice among registered nurses and paramedics with an advanced level of education in pre-hospital and in-hospital emergency care.

DESIGN

An integrative literature review.

METHOD

Studies published between 2006 and 2018 were retrieved by searching the databases CINAHL, PubMed, Scopus and Web of Science. Studies were selected by three independent researchers, and data were synthesized using thematic analysis.

RESULTS

The 25 studies identified focused on in-hospital (n = 15) and pre-hospital emergency care (n = 10) and included 13 professional titles originated from seven countries. The thematic analysis disclosed four themes; "Versatile care," "Safe care based on precision and accuracy," "Autonomous performance within boundaries" and "Beneficial towards patients and society." Advanced paramedics' and advanced nurses' services are characterized as safe, of high quality and of public benefit. Their services are being used in everyday practice as well as directed to certain categories of patients.

Reporting Discrepancy Resolved by Findings and Time in 2947 Emergency Department Ankle X-rays

AIMS

To identify common errors in ankle X-ray reporting between initial interpretation and final assessment at the virtual fracture clinic. Also, to assess time of initial reporting as a causative factor for discrepancy.

METHODS

Two thousand nine hundred forty-seven final reports were reviewed by standard of agreement to the initial interpretation. Where discrepancy was found, it was classified and collated by specific finding. Comparison was made between reports with discrepancy and the complete dataset, allowing rates of error by finding to be established. The reports containing discrepancy were further classified by time period, this was compared against an expected value to establish if initial reporting outside of routine working hours was as accurate as that conducted within routine working hours.

RESULTS

94.4% of reports were in agreement with the initial interpretation, 2.9% contained minor discrepancy, and 2.7% major discrepancy. In 45.6% of reports there was no radiologically observable injury. 16.4% of reports contained a lateral malleolar fracture, most commonly Weber type B. 40.0% of all navicular fractures, and 33.3% of all cuboidal fractures were not commented upon in the initial reporting. Lower rates of more frequently observed findings were missed with 2.5% of Weber type B fractures not commented upon. An increased proportion of major discrepancy reports were generated from 00:00 to 07:59 (expected = 15.0%, observed = 22.2%; p = 0.07908). Similarly, a greater than expected number of minor discrepancy reports were found between 20:00 and 23:59 (expected = 18.0%, observed = 34.1%, p = 0.00025).

CONCLUSIONS

The initial reporting of ankle X-rays in the emergency department is performed to a high standard, however serious missed findings emphasise the need for timely senior review. Reporters should increase their awareness of navicular, cuboid, talar, and Weber A fractures which were missed at disproportionate rates. This study also finds evidence to support increased rates of error in initial reporting of ankle X-rays outside of normal working hours (17:00-07:59), particularly with a significantly increased rate of minor discrepancy seen from 20:00 to 23:59.

Skeletal trauma reporting; perceptions and experiences of radiographer practitioners exposed to the reporting role

INTRODUCTION

Increased demand for diagnostic imaging and professional body directives have resulted in radiographer reporting which requires postgraduate education due to the associated high degree of autonomy and complex decision making. Little research has focused on the transition from practitioner to the skeletal trauma reporting role.

METHODS

Two-phase, qualitative research using Interpretative Phenomenological Analysis (IPA) explored perceptions and experiences. Phase 2, one-one, semi-structured interviews (n = 6) were recorded, transcribed verbatim and reviewed using the IPA six stage thematic analysis, generating three super-ordinate themes. Researcher reflexivity, ethics and quality assessment were considered.

RESULTS

This paper reflects the IPA generated from Super-ordinate Theme 2; Exposure to the reporting role. Participant reflections indicated positive opinion with agreement that combining the reporting role with the diagnostic radiographer role enhanced practice and increased job satisfaction. Potential for stress associated with increased responsibility and accountability was described but there was recognition that skeletal trauma reporting was what they had chosen and been educated to do.

CONCLUSION

The interpretative approach and IPA for Super-ordinate Theme 2, fills a gap in existing knowledge, providing a unique and valuable insight into perceptions and experiences of practitioners as they became exposed to the skeletal reporting role.

IMPLICATIONS FOR PRACTICE

Participants were on their journey to advanced practice with plans to further develop their role. Excellent clinical practice had been demonstrated as well as facilitating learning with others. If there is expectation to achieve all domains associated with advanced practitioner status then time, commitment and support is essential from employers and management.