Pathway map development for medical device event reporting in operating theatres: a human factors approach to improving the existing system

Objectives

This study aimed to develop the actual pathway to reporting and information transfer in operating theatres in relation to medical technology malfunction/failure. This with the aim of understanding the differences with the pathway published by NHS Improvement and identification of points for improvement.

Design

This is a qualitative study involving stakeholder interviews with doctors, nurses, manufacturers, medical device safety officer and Medicines and Healthcare products Regulatory Agency.

Setting

Data were collected on reporting pathway used in operating theatres. Clinical staff who took part worked in different trusts throughout UK while manufacturers provided devices in UK and EU/USA.

Participants

Semistructured interviews were completed with 15 clinicians and 13 manufacturers. Surveys were completed by 38 clinicians and 5 manufacturers. Recognised methods of pathway development were used. The Lean Six Sigma principles adapted to healthcare were used to develop suggestions for improvement.

Main outcome measures

To identify the differences between the set pathway to reporting and information transfer to what is occurring on a day-to-day basis as reported by staff. Identify points in the pathway where improvements could be applied.

Results

The developed pathway demonstrated great complexity of the current reporting system for medical devices. It identified numerous areas that give rise to problems and multiple biases in decision making. This highlighted the core issues leading to under-reporting and lack of knowledge on device performance and patient risk. Suggestions for improvement were deduced based on end user requirements and identified problems.

Conclusions

This study has provided a detailed understanding of the key problem areas that exist within the current reporting system for medical devices and technology. The developed pathway sets to address the key problems to improve reporting outcomes. The identification of pathway differences between 'work as done' and 'work as imagined' can lead to development of quality improvements that could be systematically applied.

Perceived feasibility, facilitators and barriers to incorporating point-of-care testing for SARS-CoV-2 into emergency medical services by ambulance service staff: a survey-based approach

OBJECTIVES

This body of work aimed to elicit ambulance service staff's perceptions on the barriers and facilitators to adoption, and clinical utility of incorporating rapid SARS-CoV-2 testing during ambulance assessments.

DESIGN

A mixed-methods survey-based project using a framework analysis method to organise qualitative data.

SETTING

Emergency and non-emergency care ambulatory services in the UK were approached to take part.

PARTICIPANTS

Current, practising members of the UK ambulance service (paramedics, technicians, assistants and other staff) were included in this body of work.

RESULTS

Survey 1: 226 responses were collected between 3 December 2020 and 11 January 2021, 179 (79.2%) of which were completed in full. While the majority of respondents indicated that an ambulance-based testing strategy was feasible in concept (143/190, 75.3%), major barriers to adoption were noted. Many open-ended responses cited concerns regarding misuse of the service by the general public and other healthcare services, timing and conveyance issues, and increased workloads, alongside training and safety concerns. Survey 2: 26 responses were received between 8 February 2021 and 22 February 2021 to this follow-up survey. Survey 2 revealed conveyance decision-making, and risk stratification to be the most frequently prioritised use cases among ambulance service staff. Optimal test characteristics for clinical adoption according to respondents were; accuracy (above 90% sensitivity and specificity), rapidity (<30 min time to results) and ease of sample acquisition.

CONCLUSIONS

The majority of commercially available lateral flow devices are unlikely to be supported by paramedics as their duty of care requires both rapid and accurate results that can inform clinical decision making in an emergency situation. Further investigation is needed to define acceptable test characteristics and criteria required for ambulance service staff to be confident and supportive of deployment of a SARS-CoV-2 test in an emergency care setting.

Point of care testing using rapid automated antigen testing for SARS-COV-2 in care homes – an exploratory safety, usability and diagnostic agreement evaluation

Introduction

Successful adoption of POCTs (Point-of-Care tests) for COVID-19 in care homes requires the identification of ideal use cases and a full understanding of the contextual and usability factors that affect test results and minimise biosafety risks. This paper presents a scoping-usability and test performance study of a microfluidic immunofluorescence assay for COVID-19 in care homes.

Methods

A mixed-methods evaluation was conducted in four UK care homes to scope usability and to assess the agreement with qRT-PCR. A dry run with luminescent dye was conducted to explore biosafety issues.

Results

The agreement analysis was conducted on 227 asymptomatic participants (159 staff and 68 residents) and 14 symptomatic participants (5 staff and 9 residents). Asymptomatic specimens showed 50% (95% CI:1.3%−98.7%) positive agreement and 96% (95% CI: 92.5%−98.1%) negative agreement with overall prevalence and bias-adjusted Kappa (PABAK) of 0.911 (95% CI: 0.857−0.965). Symptomatic specimens showed 83.3% (95% CI: 35.9%−99.6%) positive agreement and 100% (95% CI: 63.1%−100%) negative agreement with overall prevalence and bias-adjusted Kappa (PABAK) of 0.857 (95% CI: 0.549−1). The dry run highlighted four main sources of contamination that led to the modification of the standard operating procedures. Simulation post-modification showed no further evidence of contamination.

Conclusion

Careful consideration of biosafety issues and contextual factors associated with care home are mandatory for safe use the POCT. Whilst POCT may have some utility for ruling out COVID-19, further diagnostic accuracy evaluations are needed to promote effective adoption.

Enhanced lateral flow testing strategies in care homes are associated with poor adherence and were insufficient to prevent COVID-19 outbreaks: results from a mixed methods implementation study

Introduction

Care homes have been severely affected by the SARS-CoV-2 pandemic. Rapid antigen testing could identify most SARS-CoV-2 infected staff and visitors before they enter homes. We explored implementation of staff and visitor testing protocols using lateral flow devices (LFDs).

Methods

An evaluation of a SARS-CoV-2 LFD-based testing protocol in 11 care homes in Liverpool, UK, including staff and visitor testing, plus a qualitative exploratory study in nine of these homes. The proportion of pilot homes with outbreaks, and outbreak size, were compared to non-pilot homes in Liverpool. Adherence to testing protocols was evaluated. Fifteen staff were interviewed, and transcript data were thematically coded using an iterative analysis to identify and categorize factors influencing testing implementation.

Results

In total, 1,638 LFD rapid tests were performed on 407 staff. Protocol adherence was poor with 8.6% of staff achieving >75% protocol adherence, and 25.3% achieving \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}$\ge$\end{document}50%. Six care homes had outbreaks during the study. Compared to non-pilot care homes, there was no evidence of significant difference in the proportion of homes with outbreaks, or the size of outbreaks. Qualitative data showed difficulty implementing testing strategies due to excessive work burden. Factors influencing adherence related to test integration and procedural factors, socio-economic factors, cognitive overload and the emotional value of testing.

Conclusion

Implementation of staff and visitor care home LFD testing protocols was poorly adhered to and consequently did not reduce the number or scale of COVID-19 outbreaks. More focus is needed on the contextual and behavioural factors that influence protocol adherence.

Implementing lateral flow devices in long-term care facilities: experiences from the Liverpool COVID-19 community testing pilot in care homes- a qualitative study

Introduction

Antigen-based lateral flow devices (LFDs) offer the potential of widespread rapid testing. The scientific literature has primarily focused on mathematical modelling of their use and test performance characteristics. For these tests to be implemented successfully, an understanding of the real-world contextual factors that allow them to be integrated into the workplace is vital. To address this gap in knowledge, we aimed to explore staff’s experiences of integrating LFDs into routine practice for visitors and staff testing with a view to understand implementation facilitators and barriers.

Methods

Semi-structured interviews and thematic analysis.

Results

We identified two main themes and five subthemes. The main themes included: visitor-related testing factors and staff-related testing factors. Subthemes included: restoring a sense of normality, visitor-related testing challenges, staff-related testing challenges, and pre-pilot antecedent factors.

Conclusion

Our study demonstrates that the real-world implementation of LFDs to test visitors and staff faces significant challenges as a result of several contextual factors negatively affecting the work practice and environment. More comprehensive studies are needed to identify and inform effective implementation strategies to ensure that LFDs can be adopted in an agile way that better supports an already exhausted and morally depleted workforce.

COVID-19 point-of-care testing in care homes: what are the lessons for policy and practice?

COVID-19 has devastated care homes. Point-of-care tests (POCTs), mainly using lateral flow devices (LFDs), have been deployed hurriedly without much consideration of their usability or impact on care workflow. Even after the pandemic, POCTs, particularly multiplex tests, may be an important control against spread of SARS-CoV-2 and other respiratory infections in care homes by enabling identification of cases. They should not, however, replace other infection control measures such as barrier methods and quarantine. Adherence to LFDs as implemented among care home staff is suboptimal. Other tests-such as point-of-care polymerase chain reaction and automated antigen tests-would also need to be accommodated into care home workflows to improve adherence. The up-front costs of POCTs are straightforward but additional costs, including staffing preparation and reporting processes and the impacts of false positive and negative tests on absence rates and infection days, are more complex and as yet unquantified. A detailed appraisal is needed as the future of testing in care homes is considered.

Is point-of-care testing feasible and safe in care homes in England? An exploratory usability and accuracy evaluation of a point-of-care polymerase chain reaction test for SARS-CoV-2

Introduction

Reliable rapid testing for COVID-19 is needed in care homes to reduce the risk of outbreaks and enable timely care. This study aimed to examine the usability and test performance of a point of care polymerase chain reaction (PCR) test for detection of SARS-CoV-2 (POCKIT^TM Central) in care homes.

Methods

POCKIT^TM Central was evaluated in a purposeful sample of four UK care homes. Test agreement with laboratory real-time PCR and usability and used errors were assessed.

Results

No significant usability-related hazards emerged, and the sources of error identified were found to be amendable with minor changes in training or test workflow. POCKIT^TM Central has acceptable sensitivity and specificity based on RT-PCR as the reference standard, especially for symptomatic cases.

Asymptomatic specimens showed 83.3% (95% confidence interval (CI): 35.9–99.6%) positive agreement and 98.7% negative agreement (95% CI: 96.2–99.7%), with overall prevalence and bias-adjusted kappa (PABAK) of 0.965 (95% CI: 0.932– 0.999). Symptomatic specimens showed 100% (95% CI: 2.5–100%) positive agreement and 100% negative agreement (95% CI: 85.8–100%), with overall PABAK of 1.

Recommendations are provided to mitigate the frequency of occurrence of the residual use errors observed. Integration pathways were discussed to identify opportunities and limitations of adopting POCKIT™ Central for screening and diagnostic testing purposes.

Conclusions

Point-of-care PCR testing in care homes can be considered with appropriate preparatory steps and safeguards. Further diagnostic accuracy evaluations and in-service evaluation studies should be conducted, if the test is to be implemented more widely, to build greater certainty on this initial exploratory analysis.

Attitudes towards Trusting Artificial Intelligence Insights and Factors to Prevent the Passive Adherence of GPs: A Pilot Study

Artificial Intelligence (AI) systems could improve system efficiency by supporting clinicians in making appropriate referrals. However, they are imperfect by nature and misdiagnoses, if not correctly identified, can have consequences for patient care. In this paper, findings from an online survey are presented to understand the aptitude of GPs (n = 50) in appropriately trusting or not trusting the output of a fictitious AI-based decision support tool when assessing skin lesions, and to identify which individual characteristics could make GPs less prone to adhere to erroneous diagnostics results. The findings suggest that, when the AI was correct, the GPs’ ability to correctly diagnose a skin lesion significantly improved after receiving correct AI information, from 73.6% to 86.8% (X² (1, N = 50) = 21.787, p < 0.001), with significant effects for both the benign (X² (1, N = 50) = 21, p < 0.001) and malignant cases (X² (1, N = 50) = 4.654, p = 0.031). However, when the AI provided erroneous information, only 10% of the GPs were able to correctly disagree with the indication of the AI in terms of diagnosis (d-AIW M: 0.12, SD: 0.37), and only 14% of participants were able to correctly decide the management plan despite the AI insights (d-AIW M:0.12, SD: 0.32). The analysis of the difference between groups in terms of individual characteristics suggested that GPs with domain knowledge in dermatology were better at rejecting the wrong insights from AI.

COVID-19 testing in English care homes and implications for staff and residents

INTRODUCTION

Care home residents are at high risk of dying from coronavirus disease 2019 (COVID-19). Regular testing, producing rapid and reliable results is important in this population because infections spread quickly, and presentations are often atypical or asymptomatic. This study evaluated current testing pathways in care homes to explore the role of point-of-care tests (POCTs).

METHODS

A total of 10 staff from eight care homes, purposively sampled to reflect care organisational attributes that influence outbreak severity, underwent a semi-structured remote videoconference interview. Transcripts were analysed using process mapping tools and framework analysis focussing on perceptions about, gaps within and needs arising from current pathways.

RESULTS

Four main steps were identified in testing: infection prevention, preparatory steps, swabbing procedure and management of residents. Infection prevention was particularly challenging for mobile residents with cognitive impairment. Swabbing and preparatory steps were resource-intensive, requiring additional staff resource. Swabbing required flexibility and staff who were familiar to the resident. Frequent approaches to residents were needed to ensure they would participate at a suitable time. After-test management varied between sites. Several homes reported deviating from government guidance to take more cautious approaches, which they perceived to be more robust.

CONCLUSION

Swab-based testing is organisationally complex and resource-intensive in care homes. It needs to be flexible to meet the needs of residents and provide care homes with rapid information to support care decisions. POCT could help address gaps but the complexity of the setting means that each technology must be evaluated in context before widespread adoption in care homes.

Unmet clinical needs for COVID-19 tests in UK health and social care settings

There is an urgent requirement to identify which clinical settings are in most need of COVID-19 tests and the priority role(s) for tests in these settings to accelerate the development of tests fit for purpose in health and social care across the UK. This study sought to identify and prioritize unmet clinical needs for COVID-19 tests across different settings within the UK health and social care sector via an online survey of health and social care professionals and policymakers. Four hundred and forty-seven responses were received between 22nd May and 15th June 2020. Hospitals and care homes were recognized as the settings with the greatest unmet clinical need for COVID-19 diagnostics, despite reporting more access to laboratory molecular testing than other settings. Hospital staff identified a need for diagnostic tests for symptomatic workers and patients. In contrast, care home staff expressed an urgency for screening at the front door to protect high-risk residents and limit transmission. The length of time to test result was considered a widespread problem with current testing across all settings. Rapid tests for staff were regarded as an area of need across general practice and dental settings alongside tests to limit antibiotics use.

Analytical and semipreparative enantiomeric separation of azole antifungal agents by high-performance liquid chromatography on polysaccharide-based chiral stationary phases. Application to in vitro biological studies

High-performance liquid chromatography (HPLC) was used for the enantiomeric separation of chiral imidazole derivatives endowed with antimycotic activity. Enantioselective columns, containing carbamates of cellulose and amylose, were used. The influence of the nature and content of an alcoholic modifier in the mobile phase was studied. The isolated enantiomers, separated on semipreparative columns, were submitted to in vitro biological investigations.