A rapid mixed-methods evaluation of remote home monitoring models during the COVID-19 pandemic in England

Applying the major system change framework to evaluate implementation of rapid healthcare system change: a case study of COVID-19 remote home monitoring services

BACKGROUND

A framework to evaluate implementation of Major System Change (MSC) in healthcare has been developed and applied to implementation of longer-term system changes. This was the first study to apply the five domains of the MSC framework to rapid healthcare system change. We aimed to: i) evaluate implementation of rapid MSC, using England COVID-19 remote home monitoring services as a case study and ii) consider whether and how the MSC framework can be applied to rapid MSC.

METHODS

A mixed-methods rapid evaluation in England, across 28 primary and secondary healthcare sites (October 2020-November 2021; data collection: 4 months). We conducted 126 interviews (5 national leads, 59 staff, 62 patients/carers) and surveyed staff (n = 292) and patients/carers (n = 1069). Service providers completed cost surveys. Aggregated and patient-level national datasets were used to explore enrolment, service use and clinical outcomes. The MSC framework was applied retrospectively. Qualitative data were analysed thematically to explore key themes within each MSC framework domain. Descriptive statistics and multivariate analyses were used to analyse experience, costs, service use and clinical outcomes.

RESULTS

Decision to change/Decision on model: Service development happened concurrently: i) early local development motivated by urgent clinical need, ii) national rollout using standard operating procedures, and iii) local implementation and adaptation. Implementation approach: Services were tailored to local needs to consider patient, staff, organisational and resource factors. Implementation outcomes: Patient enrolment was low (59% services <10%). Service models and implementation approaches varied substantially. Intervention outcomes: No associations found between services and clinical outcomes. Patient and staff experiences were generally positive. However, barriers to delivery and engagement were found; with some groups finding it harder to engage.

CONCLUSIONS

Low enrolment rates and substantial variation due to tailoring services to local contexts meant it was not possible to conclusively determine service effectiveness. Process outcomes indicated areas of improvement. The MSC framework can be used to analyse rapid MSC. Implementation and factors influencing implementation may differ to non-rapid contexts (e.g. less uniformity, more tailoring). Our mixed-methods approach could inform future evaluations of large-scale rapid and non-rapid MSC in a range of conditions and services internationally.

The Future Hospital in Global Health Systems: The Future Hospital as an Entity

Health care is changing rapidly. Hospitals are, and will remain, an essential setting to deliver it. We discuss how to maximise the benefits of hospitals in the future in different geographic and health system settings, highlighting a series of cross-cutting issues. We do this by exploring the evolving roles of hospitals and the main factors that we must consider as they adapt. These include changing population and disease profiles, the impact of evolving technology, and new concepts in hospital design and planning. Our focus is on delivering high-quality, patient-centred care while ensuring equitable access, even if strategic decisions require compromise across these functions. The COVID-19 pandemic has shown the importance of hospitals in societies while also revealing the limitations of current structures and the potential of technology to transform hospital services within the broader healthcare system. The aim of this multidisciplinary perspective is to provide an overview of pertinent issues whilst highlighting the challenges and opportunities in optimising future hospital planning, construction, design, and development in high-income (HIC) and low -and medium-income country (LMIC) settings.

A 2-Year Retrospective Clinical Evaluation of a Novel Virtual Ward Model

OBJECTIVE

The Wrightington, Wigan, and Leigh NHS Teaching Hospitals Foundation Trust (WWL) developed a novel virtual ward (VW) service that integrated with community and primary care, supported healthcare throughout a patient's journey, and had a clinical workflow that could step-up or step-down care as needed. We described their VW and evaluated clinical outcomes, adherence, safety, and patient satisfaction.

METHODS

Retrospective, single-center study of patients admitted to the WWL VW service from January 14, 2022 to January 31, 2024. Clinical data collected by WWL in their database for patients admitted to the VW, were matched to data captured automatically by the Current Health (CH) platform linked to the CH remote monitoring kits assigned to patients on the VW. The CH kits enabled the VW care at WWL and included a wearable device for continuous vital signs monitoring, a blood pressure cuff, and tablet. Evaluation metrics included clinical scope, clinical outcomes, adherence, safety, and patient satisfaction.

RESULTS

There were 1835 admissions and a 93% match rate between the clinical and CH databases. About 38% of referrals were step-up (31% ambulatory care and 7% primary care) and 62% of referrals were step-down (100% inpatients). Most specialty referrals were from thoracic and acute medicine (77%). The median length of stay on the VW was 8 days [IQR 5-13], 209 (12%) admissions were escalated to the hospital, 179 (11%) escalated to the emergency department out of hours, and 29 (2%) signposted to urgent medical services. Adherence to the wearable device was 92%. There were 38 minor safety incidents (typically hypersensitivity reactions or administrative errors) and 17 expected deaths. About 94% of admissions rated the VW experience as "excellent" or "good." Results were similar between step-up and step-down referrals.

CONCLUSION

We have shown the VW service yielded acceptable clinical outcomes, was safe with no serious adverse events or negative impact on mortality rate. Patient adherence to the technology and satisfaction with the VW service were high. The VW service was innovative in its acceptance of a broad range of patients, expanding services beyond respiratory medicine, and in developing a step-up pathway, preventing some patients from ever taking up an acute bed in the hospital.

Evaluating the Implementation of the Rapid Prenatal Exome Sequencing Service in England

INTRODUCTION

In October 2020, a national rapid prenatal exome sequencing (pES) service was rolled out across the English National Health Service (NHS). This service is delivered by multiple clinical and two laboratory teams. While there was high level national guidance to support implementation, it was unclear how the service had been delivered in practice. This study evaluated pES service implementation across England, using the major system change (MSC) framework to explore links between implementation approaches and outcomes.

METHODS

We conducted a national mixed-methods multi-site study of 17 clinical genomics services, their linked fetal medicine services and two laboratories delivering the pES service. The MSC framework informed the study. Key documents, semi-structured interviews (eight national service developers, 55 staff), and surveys (n = 159 staff) were analysed using inductive and deductive thematic analysis and descriptive statistics. Findings were integrated.

RESULTS

Implementation was influenced by a range of factors including evidence of benefit, laboratory service reconfiguration, and stakeholder support. Local implementation approaches varied; seven models of service delivery were identified. Key differences between models included leadership, staffing, and multidisciplinary team approaches. Local staff factors (e.g., time, capacity, attitudes), pES service factors (e.g., communication/collaboration, logistics), and organisational factors (e.g., infrastructure and previous experience) influenced implementation.

CONCLUSION

We have identified multiple barriers and facilitators that are associated with implementing a major change to genomic services in a complex national healthcare system. This study highlights which models of pES may work in practice and why. Findings will inform future development of the pES service.

A Cost Evaluation of COVID-19 Remote Home Monitoring Services in England

BACKGROUND

Remote home monitoring services emerged as critical components of health care delivery from NHS England during the COVID-19 pandemic, aiming to provide timely interventions and reduce health care system burden. Two types of service were offered: referral by community health services to home-based care to ensure the right people were admitted to the hospital at the right time (called COVID Oximetry@home, CO@h); and referral by hospital to support patients' transition from hospital to home (called COVID-19 Virtual Ward, CVW). The information collected for the oxygen levels and other symptoms was provided via digital means (technology-enabled) or over the phone (analogue-only submission mode). This study aimed to evaluate the costs of implementing remote home monitoring for COVID-19 patients across 26 sites in England during wave 2 of the pandemic. Understanding the operational and financial implications of these services from the NHS perspective is essential for effective resource allocation and service planning.

METHODS

We used a bottom-up costing approach at the intervention level to describe the costs of setting up and running the services. Twenty-six implementation sites reported the numbers of patients and staff involved in the service and other resources used. Descriptive statistics and multivariable regression analysis were used to assess cost variations and quantify the relationship between the number of users and costs while adjusting for other service characteristics.

RESULTS

The mean cost per patient monitored was lower in the CO@h service compared with the CVW service (£527 vs £599). The mean cost per patient was lower for implementation sites using technology-enabled and analogue data submission modes compared with implementation sites using analogue-only modes for both CO@h (£515 vs £561) and CVW (£584 vs £612) services. The number of patients enrolled in the services and the service type significantly affected the mean cost per patient.

CONCLUSIONS

Our analysis provides a framework for evaluating the costs of similar services in the future and shows that the implementation of these services benefit from the employment of tech-enabled data submission modes.

Knowledge as a Predictor for Preparedness in Managing COVID-19 Among General Practitioners in Malaysia

Introduction The COVID-19 pandemic has changed the working environment for general practitioners (GPs). GPs had to adapt quickly when care mitigation for mild COVID-19 in the community began. We assessed Malaysian GPs' knowledge and preparedness to manage COVID-19. Method A cross-sectional online survey was conducted between May and October 2022 among the GPs. Emails were sent to GPs affiliated with the main GP organizations in Malaysia, such as the Academy of Family Physicians of Malaysia (AFPM). Additionally, participation was sought through social media groups, including the Association of Malaysian Islamic Doctors, the Federation of Private Medical Practitioners' Associations Malaysia, and the Primary Care Network. Data was collected using a self-administered questionnaire on items related to knowledge and preparedness to manage COVID-19. The content was validated by six experts. Multiple logistic regression was used to determine the predictors for preparedness. Results A total of 178 GPs participated in this study. The mean age of the GPs was 41.8 (SD 12.37) years, 54.5% were males, 47.8% had a postgraduate qualification, and 68% had up to 10 years of general practice experience. Their practices are commonly solo (55.1%), located within an urban area (56.2%) and 47.2% operate 7 days a week. A majority of GPs (n = 124, 69.7%) had a good level of knowledge of COVID-19. In contrast, about a third (n = 60, 33.7%) had a good level of preparedness to manage COVID-19. GPs with a good level of knowledge of COVID-19 had 1.96 times the odds of having a good level of preparedness as compared to GPs with lower knowledge (OR = 2.11 (95% CI: 1.06, 4.18, p = 0.03)). Conclusion A good level of knowledge is a predictor for preparedness to manage COVID-19. Relevant and targeted measures to enhance knowledge for better preparedness among the GPs to respond to future pandemics are needed.

Rapid evaluation of service innovations in health and social care: key considerations

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (RSET: 16/138/17; BRACE: 16/138/31).