1
|
Butler MJ, Arneil C, Whitelaw AS, Thomson K, Gordon MWG, Thorburn J, Shiels D, Lowe DJ. Implementation of major trauma app: usability and data completeness. BMC Emerg Med 2024; 24:136. [PMID: 39075337 PMCID: PMC11288075 DOI: 10.1186/s12873-024-01022-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Accepted: 06/12/2024] [Indexed: 07/31/2024] Open
Abstract
BACKGROUND The current UK standard for major trauma patients is to record notes in a paper trauma booklet. Through an innovative collaboration between a major trauma centre and a digital transformation industry partner, a TraumaApp was developed. Electronic notes have been shown to have fewer errors, granular data collection and enable time stamped contemporaneous record keeping. Implementation of digital clinical records presents a challenge within the context of trauma multidisciplinary trauma resuscitation. Data can be easily accessible and shared for quality improvement, audit and research purposes. This study compared paper and electronic notes for completeness and for acceptability data following the implementation of the TraumaApp. METHODS Trauma team members who performed scribe function attended training for the newly launched TraumaApp. Two staff members acted as scribe, using either the paper trauma booklet or TraumaApp, and attended major trauma calls. A framework for comparison of paper and electronic notes was created and used for a retrospective review of major trauma patients' notes. Statistical analysis was performed using a two-tailed t-test. Staff using the TraumaApp completed a System Usability Score questionnaire. RESULTS There was a total of 37 data points for collection per case. The mean numbers collected were paper notes 24.1 of 37 (65.1%) and electronic notes, 25.7 of 37 (69.5%). There was no statistical significance between the completeness of paper and electronic notes. The mean System Usability Score was 68.4. DISCUSSION Recording accurate patient information during a major trauma call can be challenging and the role of the scribe to accurately record events is critical for immediate and future care. There was no statistically significant difference in completeness of paper and electronic notes, however the mean System Usability Score was 68.4, which is greater than the internationally validated standard of acceptable usability. CONCLUSION It is feasible to introduce digital data collection tools enabling accurate record keeping during trauma resuscitation and improve information sharing between clinicians.
Collapse
Affiliation(s)
- Miss Joanna Butler
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK
- Clyde Trauma and Orthopaedics, Royal Alexandra Hospital, Paisley, PA2 9PN, UK
| | - Clare Arneil
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK
| | - Alan S Whitelaw
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK
| | - Kevin Thomson
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK
| | - Malcolm W G Gordon
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK
| | - Josh Thorburn
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK
| | - Darren Shiels
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK
| | - David J Lowe
- Emergency Department, Queen Elizabeth University Hospital, Glasgow, G52 4TF, UK.
- School of Health and Wellbeing, University of Glasgow, Glasgow, G12 8RZ, UK.
| |
Collapse
|
2
|
Howick J, de Zulueta P, Gray M. Beyond empathy training for practitioners: Cultivating empathic healthcare systems and leadership. J Eval Clin Pract 2024; 30:548-558. [PMID: 38436621 DOI: 10.1111/jep.13970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 01/11/2024] [Indexed: 03/05/2024]
Abstract
Empathic care benefits patients and practitioners, and empathy training for practitioners can enhance empathy. However, practitioners do not operate in a vacuum. For empathy to thrive, healthcare consultations must be situated in a nurturing milieu, guided by empathic, compassionate leaders. Empathy will be suppressed, or even reversed if practitioners are burned out and working in an unpleasant, under-resourced environment with increasingly poorly served and dissatisfied patients. Efforts to enhance empathy must therefore go beyond training practitioners to address system-level factors that foster empathy. These include patient education, cultivating empathic leadership, customer service training for reception staff, valuing cleaning and all ancillary staff, creating healing spaces, and using appropriate, efficiency saving technology to reduce the administrative burden on healthcare practitioners. We divide these elements into environmental factors, organisational factors, job factors, and individual characteristics.
Collapse
Affiliation(s)
- Jeremy Howick
- Stoneygate Centre for Empathic Healthcare, Leicester Medical School, University of Leicester, Leicester, UK
| | - Paquita de Zulueta
- Department of Primary Care and Public Health, Imperial College London, London, UK
| | - Muir Gray
- Director of the Oxford Value and Stewardship Programme, Oxford, UK
- Faculty of Philosophy, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
3
|
Alfian SD, Sania JA, Aini DQ, Khoiry QA, Griselda M, Ausi Y, Zakiyah N, Puspitasari IM, Suwantika AA, Mahfud M, Aji S, Abdulah R, Kassianos AP. Evaluation of usability and user feedback to guide telepharmacy application development in Indonesia: a mixed-methods study. BMC Med Inform Decis Mak 2024; 24:130. [PMID: 38773562 PMCID: PMC11106925 DOI: 10.1186/s12911-024-02494-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 03/27/2024] [Indexed: 05/24/2024] Open
Abstract
BACKGROUND In Indonesia, the adoption of telepharmacy was propelled by the COVID-19 pandemic, prompting the need for a user-friendly application to support both the general population and pharmacists in accessing healthcare services. Therefore, this study aimed to evaluate usability and user feedback of a pioneering telepharmacy application known as Tanya Obat (translating to "Ask about Medications") in Indonesia, from the perspectives of the general population and pharmacists. METHODS A mixed-methods sequential study was conducted with the early-stage Tanya Obat application in Bandung City. Participants, including the general population and pharmacists, were instructed to use the application for a week. Questionnaires for the general population and pharmacists were distributed from March to May and February to June 2023, respectively. The System Usability Scale questionnaire was adopted to describe usability of the developed application. Further exploration of the quantitative results required collecting open-ended feedback to assess the impressions of the participants, difficulties encountered, and desired features for enhanced user-friendliness. The collected statements were summarized and clustered using thematic analysis. Subsequently, the association between the characteristics of participants and perceived usability was determined with the Chi-square test. RESULT A total of 176 participants, comprising 100 individuals from the general population and 76 pharmacists, engaged in this study. In terms of usability, the questionnaire showed that Tanya Obat application was on the borderline of acceptability, with mean scores of 63.4 and 64.1 from the general population and pharmacists, respectively. Additionally, open-ended feedback targeted at achieving a more compelling user experience was categorized into two themes, including concerns regarding the functionality of certain features and recommendations for improved visual aesthetics and bug fixes. No significant associations were observed between the characteristics of participants and perceived usability (p-value > 0.05). CONCLUSION The results showed that the perceived usability of Tanya Obat developed for telepharmacy was below average. Therefore, feature optimizations should be performed to facilitate usability of this application in Indonesia.
Collapse
Affiliation(s)
- Sofa D Alfian
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia.
- Drug Utilization and Pharmacoepidemiology Research Group, Center of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia.
- Center for Health Technology Assessment, Universitas Padjadjaran, Jatinangor, Indonesia.
| | - Jihan A Sania
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Dzulfah Q Aini
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Qisty A Khoiry
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Meliana Griselda
- Drug Utilization and Pharmacoepidemiology Research Group, Center of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Yudisia Ausi
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
- Drug Utilization and Pharmacoepidemiology Research Group, Center of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Neily Zakiyah
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
- Drug Utilization and Pharmacoepidemiology Research Group, Center of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Irma M Puspitasari
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
- Drug Utilization and Pharmacoepidemiology Research Group, Center of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Auliya A Suwantika
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
- Drug Utilization and Pharmacoepidemiology Research Group, Center of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia
- Center for Health Technology Assessment, Universitas Padjadjaran, Jatinangor, Indonesia
| | | | - Saktian Aji
- Dienggo Kreasi Nusantara Company, Jakarta, Indonesia
| | - Rizky Abdulah
- Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia
- Drug Utilization and Pharmacoepidemiology Research Group, Center of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia
| | - Angelos P Kassianos
- Department of Nursing, School of Health Sciences, Cyprus University of Technology, Limassol, Cyprus
| |
Collapse
|
4
|
Jabeen S, Rahman M, Siddique AB, Hasan M, Matin R, Rahman QSU, AKM TH, Alim A, Nadia N, Mahmud M, Islam J, Islam MS, Haider MS, Dewan F, Begum F, Barua U, Anam MT, Islam A, Razzak KSB, Ameen S, Hossain AT, Nahar Q, Ahmed A, El Arifeen S, Rahman AE. Introducing a digital emergency obstetric and newborn care register for indoor obstetric patient management: An implementation research in selected public health care facilities of Bangladesh. J Glob Health 2024; 14:04075. [PMID: 38722093 PMCID: PMC11082830 DOI: 10.7189/jogh.14.04075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/12/2024] Open
Abstract
Background Digital health records have emerged as vital tools for improving health care delivery and patient data management. Acknowledging the gaps in data recording by a paper-based register, the emergency obstetric and newborn care (EmONC) register used in the labour ward was digitised. In this study, we aimed to assess the implementation outcome of the digital register in selected public health care facilities in Bangladesh. Methods Extensive collaboration with stakeholders facilitated the development of an android-based electronic register from the paper-based register in the labour rooms of the selected district and sub-district level public health facilities of Bangladesh. We conducted a study to assess the implementation outcome of introducing the digital EmONC register in the labour ward. Results The digital register demonstrated high usability with a score of 83.7 according to the system usability scale, and health care providers found it highly acceptable, with an average score exceeding 95% using the technology acceptance model. The adoption rate reached an impressive 98% (95% confidence interval (CI) = 98-99), and fidelity stood at 90% (95% CI = 88-91) in the digital register, encompassing more than 80% of data elements. Notably, fidelity increased significantly over the implementation period of six months. The digital system proved a high utility rate of 89% (95% CI = 88-91), and all outcome variables exceeded the predefined benchmark. Conclusions The implementation outcome assessment underscores the potential of the digital register to enhance maternal and newborn health care in Bangladesh. Its user-friendliness, improved data completeness, and high adoption rates indicate its capacity to streamline health care data management and improve the quality of care.
Collapse
Affiliation(s)
- Sabrina Jabeen
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | - Mahiur Rahman
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | | | - Mehedi Hasan
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | - Rubaiya Matin
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | | | | | - Azizul Alim
- Directorate General of Health Services, Ministry of Health and Family Welfare, Government of the People’s Republic of Bangladesh, Dhaka, Bangladesh
| | - Nuzhat Nadia
- Directorate General of Health Services, Ministry of Health and Family Welfare, Government of the People’s Republic of Bangladesh, Dhaka, Bangladesh
| | - Mustufa Mahmud
- Directorate General of Health Services, Ministry of Health and Family Welfare, Government of the People’s Republic of Bangladesh, Dhaka, Bangladesh
| | - Jahurul Islam
- Directorate General of Health Services, Ministry of Health and Family Welfare, Government of the People’s Republic of Bangladesh, Dhaka, Bangladesh
| | - Muhammad Shariful Islam
- Directorate General of Health Services, Ministry of Health and Family Welfare, Government of the People’s Republic of Bangladesh, Dhaka, Bangladesh
| | - Mohammad Sabbir Haider
- Directorate General of Health Services, Ministry of Health and Family Welfare, Government of the People’s Republic of Bangladesh, Dhaka, Bangladesh
| | - Farhana Dewan
- Obstetrical and Gynaecological Society of Bangladesh, Dhaka, Bangladesh
| | - Ferdousi Begum
- Obstetrical and Gynaecological Society of Bangladesh, Dhaka, Bangladesh
| | - Uchchash Barua
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | | | - Abirul Islam
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | | | - Shafiqul Ameen
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | | | - Quamrun Nahar
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | - Anisuddin Ahmed
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | - Shams El Arifeen
- International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
| | | |
Collapse
|
5
|
Morris JS. A Call to Reconsider a Nationwide Electronic Health Record System: Correcting the Failures of the National Program for IT. JMIR Med Inform 2023; 11:e53112. [PMID: 38163966 PMCID: PMC10958994 DOI: 10.2196/53112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 11/30/2023] [Accepted: 12/02/2023] [Indexed: 01/03/2024] Open
Abstract
Abstract
The National Programme for IT (NPfIT) was launched in 2005 to implement 7 nationwide IT services across the National Health Service (NHS). Despite the success of many of these designated “deliverables,” the establishment of a single nationwide electronic health record (EHR) system never fully materialized. As a result, NHS medical records are now stored using a diverse array of alternate EHR systems, which frequently restricts health care practitioners from accessing extensive portions of their patients’ notes. This not only limits their ability to make well-informed clinical decisions but also impacts the quality of care they are able to provide. This article assesses the medical, economic, and bureaucratic implications of an NHS-wide EHR system. Additionally, it explores how the shortcomings of the NPfIT should be addressed when attempting to introduce such a system in the future.
Collapse
Affiliation(s)
- James Seymour Morris
- School of Clinical Medicine, University of Cambridge, Addenbrooke's Hospital NHS Foundation Trust, Cambridge, United Kingdom
| |
Collapse
|
6
|
Karajizadeh M, Zand F, Vazin A, Saeidnia HR, Lund BD, Tummuru SP, Sharifian R. Design, development, implementation, and evaluation of a severe drug-drug interaction alert system in the ICU: An analysis of acceptance and override rates. Int J Med Inform 2023; 177:105135. [PMID: 37406570 DOI: 10.1016/j.ijmedinf.2023.105135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2023] [Revised: 06/10/2023] [Accepted: 06/22/2023] [Indexed: 07/07/2023]
Abstract
BACKGROUND AND OBJECTIVE The override rate of Drug-Drug Interaction Alerts (DDIA) in Intensive Care Units (ICUs) is very high. Therefore, this study aimed to design, develop, implement, and evaluate a severe Drug-Drug Alert System (DDIAS) in a system of ICUs and measure the override rate of this system. METHODS This is a cross-sectional study that details the design, development, implementation, and evaluation of a DDIAS for severe interactions into a Computerized Provider Order Entry (CPOE) system in the ICUs of Nemazee general teaching hospitals in 2021. The patients exposed to the volume of DDIAS, acceptance and overridden of DDIAS, and usability of DDIAS have been collected. The study was approved by the local Institutional Review Board (IRB) and; the ethics committee of Shiraz University of Medical Science on date: 2019-11-23 (Approval ID: IR.SUMS.REC.1398.1046). RESULTS The knowledge base of the DDIAS contains 9,809 severe potential drug-drug interactions (pDDIs). A total of 2672 medications were prescribed in the population study. The volume and acceptance rate for the DDIAS were 81 % and 97.5 %, respectively. The override rate was 2.5 %. The mean System Usability Scale (SUS) score of the DDIAS was 75. CONCLUSION This study demonstrates that implementing high-risk DDIAS at the point of prescribing in ICUs improves adherence to alerts. In addition, the usability of the DDIAS was reasonable. Further studies are needed to investigate the establishment of severe DDIAS and measure the prescribers' response to DDIAS on a larger scale.
Collapse
Affiliation(s)
- Mehrdad Karajizadeh
- Shiraz University of Medical, Trauma Research Center, Shahid Rajaee (Emtiaz) Trauma Hospital, Shiraz, Iran.
| | - Farid Zand
- Shiraz University of Medical Sciences, Anesthesiology and Critical Care Research Center, Shiraz, Iran
| | - Afsaneh Vazin
- Shiraz University of Medical Sciences, Shiraz, Department of Clinical Pharmacy, Faculty of Pharmacy, Shiraz, Iran
| | | | - Brady D Lund
- University of North Texas, Department of Information Science, Denton, TX, US
| | - Sai Priya Tummuru
- University of North Texas, Department of Information Science, Denton, TX, US
| | - Roxana Sharifian
- Shiraz University of Medical Sciences, Department of Health Information Management, Health Human Resources Research Center, School of Management & Medical Information Sciences, Shiraz, Iran.
| |
Collapse
|
7
|
Li E, Lounsbury O, Clarke J, Ashrafian H, Darzi A, Neves AL. Perceptions of chief clinical information officers on the state of electronic health records systems interoperability in NHS England: a qualitative interview study. BMC Med Inform Decis Mak 2023; 23:158. [PMID: 37573388 PMCID: PMC10423420 DOI: 10.1186/s12911-023-02255-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 08/02/2023] [Indexed: 08/14/2023] Open
Abstract
BACKGROUND In the era of electronic health records (EHR), the ability to share clinical data is a key facilitator of healthcare delivery. Since the introduction of EHRs, this aspect has been extensively studied from the perspective of healthcare providers. Less often explored are the day-to-day challenges surrounding the procurement, deployment, maintenance, and use of interoperable EHR systems, from the perspective of healthcare administrators, such as chief clinical information officers (CCIOs). OBJECTIVE Our study aims to capture the perceptions of CCIOs on the current state of EHR interoperability in the NHS, its impact on patient safety, the perceived facilitators and barriers to improving EHR interoperability, and what the future of EHR development in the NHS may entail. METHODS Semi-structured interviews were conducted between November 2020 - October 2021. Convenience sampling was employed to recruit NHS England CCIOs. Interviews were digitally recorded and transcribed verbatim. A thematic analysis was performed by two independent researchers to identify emerging themes. RESULTS Fifteen CCIOs participated in the study. Participants reported that limited EHR interoperability contributed to the inability to easily access and transfer data into a unified source, thus resulting in data fragmentation. The resulting lack of clarity on patients' health status negatively impacts patient safety through suboptimal care coordination, duplication of efforts, and more defensive practice. Facilitators to improving interoperability included the recognition of the need by clinicians, patient expectations, and the inherent centralised nature of the NHS. Barriers included systems usability difficulties, and institutional, data management, and financial-related challenges. Looking ahead, participants acknowledged that realising that vision across the NHS would require a renewed focus on mandating data standards, user-centred design, greater patient involvement, and encouraging inter-organisational collaboration. CONCLUSION Tackling poor interoperability will require solutions both at the technical level and in the wider policy context. This will involve demanding interoperability functionalities from the outset in procurement contracts, fostering greater inter-organisation cooperation on implementation strategies, and encouraging systems vendors to prioritise interoperability in their products. Only by comprehensively addressing these challenges would the full potential promised by the use of fully interoperable EHRs be realised.
Collapse
Affiliation(s)
- Edmond Li
- Institute of Global Health Innovation, National Institute for Health and Care Research (NIHR) Imperial Patient Safety Translational Research Centre, Imperial College London, London, UK.
| | | | - Jonathan Clarke
- Institute of Global Health Innovation, National Institute for Health and Care Research (NIHR) Imperial Patient Safety Translational Research Centre, Imperial College London, London, UK
- Centre for Mathematics of Precision Healthcare, Department of Mathematics, Imperial College London, London, UK
| | - Hutan Ashrafian
- Institute of Global Health Innovation, National Institute for Health and Care Research (NIHR) Imperial Patient Safety Translational Research Centre, Imperial College London, London, UK
| | - Ara Darzi
- Institute of Global Health Innovation, National Institute for Health and Care Research (NIHR) Imperial Patient Safety Translational Research Centre, Imperial College London, London, UK
| | - Ana Luisa Neves
- Institute of Global Health Innovation, National Institute for Health and Care Research (NIHR) Imperial Patient Safety Translational Research Centre, Imperial College London, London, UK
- Department of Primary Care and Public Health, Imperial College London, London, UK
- Department of Community Medicine, Health Information and Decision, Center for Health Technology and Services Research, University of Porto, Porto, Portugal
| |
Collapse
|
8
|
White NM, Carter HE, Kularatna S, Borg DN, Brain DC, Tariq A, Abell B, Blythe R, McPhail SM. Evaluating the costs and consequences of computerized clinical decision support systems in hospitals: a scoping review and recommendations for future practice. J Am Med Inform Assoc 2023; 30:1205-1218. [PMID: 36972263 PMCID: PMC10198542 DOI: 10.1093/jamia/ocad040] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 02/23/2023] [Accepted: 03/03/2023] [Indexed: 11/14/2023] Open
Abstract
OBJECTIVE Sustainable investment in computerized decision support systems (CDSS) requires robust evaluation of their economic impacts compared with current clinical workflows. We reviewed current approaches used to evaluate the costs and consequences of CDSS in hospital settings and presented recommendations to improve the generalizability of future evaluations. MATERIALS AND METHODS A scoping review of peer-reviewed research articles published since 2010. Searches were completed in the PubMed, Ovid Medline, Embase, and Scopus databases (last searched February 14, 2023). All studies reported the costs and consequences of a CDSS-based intervention compared with current hospital workflows. Findings were summarized using narrative synthesis. Individual studies were further appraised against the Consolidated Health Economic Evaluation and Reporting (CHEERS) 2022 checklist. RESULTS Twenty-nine studies published since 2010 were included. Studies evaluated CDSS for adverse event surveillance (5 studies), antimicrobial stewardship (4 studies), blood product management (8 studies), laboratory testing (7 studies), and medication safety (5 studies). All studies evaluated costs from a hospital perspective but varied based on the valuation of resources affected by CDSS implementation, and the measurement of consequences. We recommend future studies follow guidance from the CHEERS checklist; use study designs that adjust for confounders; consider both the costs of CDSS implementation and adherence; evaluate consequences that are directly or indirectly affected by CDSS-initiated behavior change; examine the impacts of uncertainty and differences in outcomes across patient subgroups. DISCUSSION AND CONCLUSION Improving consistency in the conduct and reporting of evaluations will enable detailed comparisons between promising initiatives, and their subsequent uptake by decision-makers.
Collapse
Affiliation(s)
- Nicole M White
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Hannah E Carter
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Sanjeewa Kularatna
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - David N Borg
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - David C Brain
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Amina Tariq
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Bridget Abell
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Robin Blythe
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Steven M McPhail
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
- Digital Health and Informatics Directorate, Metro South Health, Brisbane, Queensland, Australia
| |
Collapse
|
9
|
Vasilica C, Wynn M, Davis D, Charnley K, Garwood-Cross L. The digital future of nursing: making sense of taxonomies and key concepts. BRITISH JOURNAL OF NURSING (MARK ALLEN PUBLISHING) 2023; 32:442-446. [PMID: 37173087 DOI: 10.12968/bjon.2023.32.9.442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
Digital technology is becoming increasingly common in routine nursing practice. The adoption of digital technologies such as video calling, and other digital communication, has been hastened by the recent COVID-19 pandemic. Use of these technologies has the potential to revolutionise nursing practice, leading to potentially more accurate patient assessment, monitoring processes and improved safety in clinical areas. This article outlines key concepts related to the digitalisation of health care and the implications for nursing practice. The aim of this article is to encourage nurses to consider the implications, opportunities and challenges associated with the move towards digitalisation and advances in technology. Specifically, this means understanding key digital developments and innovations associated with healthcare provision and appreciating the implications of digitalisation for the future of nursing practice.
Collapse
Affiliation(s)
- Cristina Vasilica
- Reader, Digital Health, School of Health and Society, University of Salford, Salford
| | - Matthew Wynn
- Lecturer, Adult Nursing, School of Health and Society, University of Salford, Salford
| | - Dilla Davis
- Lecturer, Adult Nursing, School of Health and Society, University of Salford, Salford
| | - Kyle Charnley
- Lecturer, Mental Health Nursing, School of Health and Society, University of Salford, Salford
| | - Lisa Garwood-Cross
- Research Fellow, Digital Health, School of Health and Society, University of Salford, Salford
| |
Collapse
|
10
|
Heys M, Kesler E, Sassoon Y, Wilson E, Fitzgerald F, Gannon H, Hull-Bailey T, Chimhini G, Khan N, Cortina-Borja M, Nkhoma D, Chiyaka T, Stevenson A, Crehan C, Chiume ME, Chimhuya S. Development and implementation experience of a learning healthcare system for facility based newborn care in low resource settings: The Neotree. Learn Health Syst 2023; 7:e10310. [PMID: 36654803 PMCID: PMC9835040 DOI: 10.1002/lrh2.10310] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Revised: 02/28/2022] [Accepted: 03/20/2022] [Indexed: 01/21/2023] Open
Abstract
Introduction Improving peri- and postnatal facility-based care in low-resource settings (LRS) could save over 6000 babies' lives per day. Most of the annual 2.4 million neonatal deaths and 2 million stillbirths occur in healthcare facilities in LRS and are preventable through the implementation of cost-effective, simple, evidence-based interventions. However, their implementation is challenging in healthcare systems where one in four babies admitted to neonatal units die. In high-resource settings healthcare systems strengthening is increasingly delivered via learning healthcare systems to optimise care quality, but this approach is rare in LRS. Methods Since 2014 we have worked in Bangladesh, Malawi, Zimbabwe, and the UK to co-develop and pilot the Neotree system: an android application with accompanying data visualisation, linkage, and export. Its low-cost hardware and state-of-the-art software are used to support healthcare professionals to improve postnatal care at the bedside and to provide insights into population health trends. Here we summarise the formative conceptualisation, development, and preliminary implementation experience of the Neotree. Results Data thus far from ~18 000 babies, 400 healthcare professionals in four hospitals (two in Zimbabwe, two in Malawi) show high acceptability, feasibility, usability, and improvements in healthcare professionals' ability to deliver newborn care. The data also highlight gaps in knowledge in newborn care and quality improvement. Implementation has been resilient and informative during external crises, for example, coronavirus disease 2019 (COVID-19) pandemic. We have demonstrated evidence of improvements in clinical care and use of data for Quality Improvement (QI) projects. Conclusion Human-centred digital development of a QI system for newborn care has demonstrated the potential of a sustainable learning healthcare system to improve newborn care and outcomes in LRS. Pilot implementation evaluation is ongoing in three of the four aforementioned hospitals (two in Zimbabwe and one in Malawi) and a larger scale clinical cost effectiveness trial is planned.
Collapse
Affiliation(s)
- Michelle Heys
- Population, Policy and Practice Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | - Erin Kesler
- Children's Hospital of Philadelphia General, Thoracic, and Fetal Surgery Newborn Intensive Care Unit Philadelphia USA
| | | | - Emma Wilson
- Population, Policy and Practice Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | - Felicity Fitzgerald
- Infection, Immunity and Inflammation Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | - Hannah Gannon
- Population, Policy and Practice Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | - Tim Hull-Bailey
- Population, Policy and Practice Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | - Gwendoline Chimhini
- Department of Primary Healthcare Sciences University of Zimbabwe Harare Zimbabwe
| | - Nushrat Khan
- Population, Policy and Practice Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | - Mario Cortina-Borja
- Population, Policy and Practice Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | | | | | - Alex Stevenson
- Department of Primary Healthcare Sciences University of Zimbabwe Harare Zimbabwe.,Mbuya Nehanda Maternity Hospital Harare Zimbabwe
| | - Caroline Crehan
- Population, Policy and Practice Research and Teaching Department University College London Great Ormond Street Institute of Child Health London UK
| | | | - Simbarashe Chimhuya
- Department of Primary Healthcare Sciences University of Zimbabwe Harare Zimbabwe.,Maternity Division Sally Mugabe Central Hospital Harare Zimbabwe
| | | |
Collapse
|
11
|
Thiam MM, Simac L, Fougère E, Forgeot C, Meurice L, Naud J, Le Strat Y, Caserio-Schönemann C. Expert consultation using the on-line Delphi method for the revision of syndromic groups compiled from emergency data (SOS Médecins and OSCOUR®) in France. BMC Public Health 2022; 22:1791. [PMID: 36131273 PMCID: PMC9494916 DOI: 10.1186/s12889-022-14157-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Accepted: 09/08/2022] [Indexed: 11/10/2022] Open
Abstract
Background Consultation data from emergency general practitioners known as SOS Médecins and emergency departments (ED) from OSCOUR® network to the French syndromic surveillance system SurSaUD® (Surveillance sanitaire des urgences et décès). These data are aggregated and monitored on a daily basis through groupings of one or more medical symptoms or diagnoses (“syndromic groups” (SG)). The objective of this study was to evaluate, revise and enrich the composition of SGs through a consensus of experts who contributed or have experience in syndromic surveillance. Methods Three rounds of a Delphi survey were organised, involving 15 volunteers from SOS Médecins and 64 ED physicians in the OSCOUR® network as well as 8 international epidemiologists. Thirty-four SOS Médecins and 40 OSCOUR® SGs covering major medical specialities were put to the experts, along with their diagnostic codes and their surveillance objectives. In each round, the experts could retain or reject the codes according to the surveillance objective. The panel could also put forward new diagnostic codes in the 1st round, included in subsequent rounds. Consensus was reached for a code if 80% of participants had chosen to keep it, or less than 20% to reject it. Results A total of 12 SOS Médecins doctors (80%), 30 ED doctors (47%) and 4 international experts (50%) participated in the three rounds. All of the SGs presented to the panel included 102 initial diagnostic codes and 73 additional codes for SOS Médecins, 272 initial diagnostic codes and 204 additional codes for OSCOUR®. At the end of the 3 rounds, 14 SOS Médecins (40%) and 11 OSCOUR® (28%) SGs achieved a consensus to maintain all of their diagnostic codes. Among these, indicators of winter seasonal surveillance (bronchiolitis and gastroenteritis) were included. Conclusion This study involved a panel of national experts with international representation and a good level of involvement throughout the survey. In the absence of a standard definition, the Delphi method has been shown to be useful in defining and validating syndromic surveillance indicators. Supplementary Information The online version contains supplementary material available at 10.1186/s12889-022-14157-x.
Collapse
Affiliation(s)
| | - Leslie Simac
- Regional Division, Santé Publique France, Saint-Maurice, France.
| | - Erica Fougère
- Regional Division, Santé Publique France, Saint-Maurice, France
| | - Cécile Forgeot
- Data Science Division, Santé Publique France, Saint-Maurice, France
| | - Laure Meurice
- Regional Division, Santé Publique France, Saint-Maurice, France
| | - Jérôme Naud
- Data Science Division, Santé Publique France, Saint-Maurice, France
| | - Yann Le Strat
- Data Science Division, Santé Publique France, Saint-Maurice, France
| | | |
Collapse
|
12
|
Similarity-based prediction of ejection fraction in heart failure patients. INFORMATICS IN MEDICINE UNLOCKED 2022. [DOI: 10.1016/j.imu.2022.101035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
|
13
|
Hunt SV, Caesar R, Malhotra R. Are electronic medical records a medicolegal risk to the oculoplastic surgeon? A survey of British Oculoplastic Surgery Society Members. Eye (Lond) 2022; 36:1326-1328. [PMID: 34815530 PMCID: PMC9151649 DOI: 10.1038/s41433-021-01835-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2021] [Revised: 10/05/2021] [Accepted: 10/21/2021] [Indexed: 11/09/2022] Open
Affiliation(s)
- Samantha Vicki Hunt
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol Eye Hospital, Bristol, England.
- Corneoplastic Unit, Queen Victoria Hospital, East Grinstead, England.
| | - Richard Caesar
- Gloucestershire Hospitals NHS Foundation Trust, Ophthalmology Unit, Cheltenham General Hospital, Cheltenham, England
| | - Raman Malhotra
- Corneoplastic Unit, Queen Victoria Hospital, East Grinstead, England
| |
Collapse
|
14
|
Crehan C, Chiume M, Mgusha Y, Dinga P, Hull-Bailey T, Normand C, Sassoon Y, Nkhoma D, Greenwood K, Lorencatto F, Lakhanpaul M, Heys M. Usability-Focused Development and Usage of NeoTree-Beta, an App for Newborn Care in a Low-Resource Neonatal Unit, Malawi. Front Public Health 2022; 10:793314. [PMID: 35570891 PMCID: PMC9096438 DOI: 10.3389/fpubh.2022.793314] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Accepted: 03/02/2022] [Indexed: 11/24/2022] Open
Abstract
Background Neonatal mortality is high in low-resource settings. NeoTree is a digital intervention for neonatal healthcare professionals (HCPs) aiming to achieve data-driven quality improvement and improved neonatal survival in low-resource hospitals. Optimising usability with end-users could help digital health interventions succeed beyond pilot stages in low-resource settings. Usability is the quality of a user's experience when interacting with an intervention, encompassing their effectiveness, efficiency, and overall satisfaction. Objective To evaluate the usability and usage of NeoTree beta-app and conduct Agile usability-focused intervention development. Method A real-world pilot of NeoTree beta-app was conducted over 6 months at Kamuzu Central Hospital neonatal unit, Malawi. Prior to deployment, think-aloud interviews were conducted to guide nurses through the app whilst voicing their thoughts aloud (n = 6). System Usability Scale (SUS) scores were collected before the implementation of NeoTree into usual clinical care and 6 months after implementation (n = 8 and 8). During the pilot, real-world user-feedback and user-data were gathered. Feedback notes were subjected to thematic analysis within an Agile “product backlog.” For usage, number of users, user-cadre, proportion of admissions/outcomes recorded digitally, and median app-completion times were calculated. Results Twelve overarching usability themes generated 57 app adjustments, 39 (68%) from think aloud analysis and 18 (32%) from the real-world testing. A total of 21 usability themes/issues with corresponding app features were produced and added to the app. Six themes relating to data collection included exhaustiveness of data schema, prevention of errors, ease of progression, efficiency of data entry using shortcuts, navigation of user interface (UI), and relevancy of content. Six themes relating to the clinical care included cohesion with ward process, embedded education, locally coherent language, adaptability of user-interface to available resources, and printout design to facilitate handover. SUS scores were above average (88.1 and 89.4 at 1 and 6 months, respectively). Ninety-three different HCPs of 5 cadres, recorded 1,323 admissions and 1,197 outcomes over 6 months. NeoTree achieved 100% digital coverage of sick neonates admitted. Median completion times were 16 and 8 min for admissions and outcomes, respectively. Conclusions This study demonstrates optimisation of a digital health app in a low-resource setting and could inform other similar usability studies apps in similar settings.
Collapse
Affiliation(s)
- Caroline Crehan
- Population Policy and Practice Department, Great Ormond Street Institute of Child Health, University College London, London, United Kingdom
| | - Msandeni Chiume
- Paediatric Department, Kamuzu Central Hospital, Lilongwe, Malawi
| | - Yamikani Mgusha
- Paediatric Department, Kamuzu Central Hospital, Lilongwe, Malawi
| | - Precious Dinga
- Paediatric Department, Kamuzu Central Hospital, Lilongwe, Malawi
| | - Tim Hull-Bailey
- Population Policy and Practice Department, Great Ormond Street Institute of Child Health, University College London, London, United Kingdom
| | | | | | - Deliwe Nkhoma
- Parent and Child Health Initiative, Lilongwe, Malawi
| | | | - Fabiana Lorencatto
- Centre for Behaviour Change, University College London, London, United Kingdom
| | - Monica Lakhanpaul
- Population Policy and Practice Department, Great Ormond Street Institute of Child Health, University College London, London, United Kingdom
| | - Michelle Heys
- Population Policy and Practice Department, Great Ormond Street Institute of Child Health, University College London, London, United Kingdom
| |
Collapse
|
15
|
Lourenço DF, Valentim EC, Lopes MHBDM. Translation and Cross-Cultural Adaptation of the System Usability Scale to Brazilian Portuguese. AQUICHAN 2022. [DOI: 10.5294/aqui.2022.22.2.8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Objective: To adapt culturally the System Usability Scale to Brazilian Portuguese and assess its internal consistency and structural construct validity. Materials and methods: This methodological study of a measurement instrument’s cultural adaptation included the initial translation, the translations’ synthesis, the back-translation, the evaluation by a committee of eight experts, testinh with a sample of 100 students, who evaluated the usability of the WhatsApp application, and the evaluation of structural construct validity by exploratory factor analysis. Results: The judges validated the Brazilian version of the System Usability Scale in the second round. It was revealed that, following the structural construct validation, the version had a unidimensional structure and an acceptable level of reliability (Cronbach’s alpha of 0.76). Besides, in the usability test, no suggestions for change were made. Conclusions: It is worth noting that the Brazilian version of this scale was semantically, idiomatically, conceptually, and culturally equivalent to the original English version and showed adequate reliability and structural construct validity.
Collapse
|
16
|
Wang B, Hao X, Yan X, Lai J, Jin F, Liao X, Xie H, Yao C. Evaluation of the clinical application effect of eSource record tools for clinical research. BMC Med Inform Decis Mak 2022; 22:98. [PMID: 35410214 PMCID: PMC9004184 DOI: 10.1186/s12911-022-01824-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Accepted: 03/23/2022] [Indexed: 11/10/2022] Open
Abstract
Background Electronic sources (eSources) can improve data quality and reduce clinical trial costs. Our team has developed an innovative eSource record (ESR) system in China. This study aims to evaluate the efficiency, quality, and system performance of the ESR system in data collection and data transcription. Methods The study used time efficiency and data transcription accuracy indicators to compare the eSource and non-eSource data collection workflows in a real-world study (RWS). The two processes are traditional data collection and manual transcription (the non-eSource method) and the ESR-based source data collection and electronic transmission (the eSource method). Through the system usability scale (SUS) and other characteristic evaluation scales (system security, system compatibility, record quality), the participants’ experience of using ESR was evaluated. Results In terms of the source data collection (the total time required for writing electronic medical records (EMRs)), the ESR system can reduce the time required by 39% on average compared to the EMR system. In terms of data transcription (electronic case report form (eCRF) filling and verification), the ESR can reduce the time required by 80% compared to the non-eSource method (difference: 223 ± 21 s). The ESR accuracy in filling the eCRF field is 96.92%. The SUS score of ESR is 66.9 ± 16.7, which is at the D level and thus very close to the acceptable margin, indicating that optimization work is needed. Conclusions This preliminary evaluation shows that in the clinical medical environment, the ESR-based eSource method can improve the efficiency of source data collection and reduce the workload required to complete data transcription. Supplementary Information The online version contains supplementary material available at 10.1186/s12911-022-01824-7.
Collapse
Affiliation(s)
- Bin Wang
- Peking University Clinical Research Institute, Peking University First Hospital, Beijing, China
| | - Xinbao Hao
- Department of Hematology, First Affiliated Hospital of Hainan Medical College, Haikou, China.,Boao Lecheng Tigermed Clinical Research Center, Qionghai, China
| | - Xiaoyan Yan
- Peking University Clinical Research Institute, Peking University First Hospital, Beijing, China
| | - Junkai Lai
- Peking University Clinical Research Institute, Peking University First Hospital, Beijing, China
| | - Feifei Jin
- National Center for Trauma Medicine, Peking University People's Hospital, Beijing, China
| | - Xiwen Liao
- Peking University Clinical Research Institute, Peking University First Hospital, Beijing, China
| | - Hongju Xie
- Department of Plastic and Cosmetic Surgery, The Second Affiliated Hospital of Hainan Medical University, Haikou, China
| | - Chen Yao
- Peking University Clinical Research Institute, Peking University First Hospital, Beijing, China. .,Hainan Institute of Real World Data, Qionghai, China.
| |
Collapse
|
17
|
Butler J, Wright E, Longbottom L, Whitelaw AS, Thomson K, Gordon MWG, Lowe DJ. Usability of novel major TraumaApp for digital data collection. BMC Emerg Med 2022; 22:39. [PMID: 35279070 PMCID: PMC8917623 DOI: 10.1186/s12873-022-00578-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2021] [Accepted: 12/28/2021] [Indexed: 11/10/2022] Open
Abstract
Background Delivery of major trauma care is complex and often fast paced. Clear and comprehensive documentation is paramount to support effective communication during complex clinical care episodes, and to allow collection of data for audit, research and continuous improvement. Clinical events are typically recorded on paper-based records that are developed for individual centres or systems. As one of the priorities laid out by the Scottish Trauma Network project was to develop an electronic data collection system, the TraumaApp was created as a data collection tool for major trauma that could be adopted worldwide. Methods The study was performed as a service evaluation based at the Queen Elizabeth University Hospital Emergency Department. Fifty staff members were recruited in pairs and listened to five paired major trauma standby and handover recordings. Participants were randomised to input data to the TraumaApp and one into the existing paper proforma. The time taken to input data add into was measured, along with time for clarifications and any errors made. Those using the app completed a System Usability Score. Results No statistically significant difference was demonstrated between times taken for data entry for the digital and paper documentation, apart from the Case 5 Handover (p < 0.05). Case 1 showed a significantly higher time for clarifications and number of errors with digital data collection (p = 0.01 and p = 1.79E-05 respectively). There were no other differences between data for the app and the proforma. The mean System Usability score for this cohort was 75 out of 100, with a standard deviation of 17 (rounded to nearest integer). Conclusion Digital real-time recording of clinical events using a tool such as the TraumaApp is comparable to completion of paper proforma. The System Usability Score for the TraumaApp was above the internationally validated standard of acceptable usability. There was no evidence of improvement in use over time or familiarity, most likely due to the brevity of the assessments and the refined user interface. This would benefit from further research, exploring data completeness and a potential mixed methods approach to explore training requirements for use of the TraumaApp. Supplementary Information The online version contains supplementary material available at 10.1186/s12873-022-00578-9.
Collapse
|
18
|
Searle T, Ibrahim Z, Teo J, Dobson R. Estimating redundancy in clinical text. J Biomed Inform 2021; 124:103938. [PMID: 34695581 DOI: 10.1016/j.jbi.2021.103938] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 08/19/2021] [Accepted: 10/17/2021] [Indexed: 12/15/2022]
Abstract
The current mode of use of Electronic Health Records (EHR) elicits text redundancy. Clinicians often populate new documents by duplicating existing notes, then updating accordingly. Data duplication can lead to propagation of errors, inconsistencies and misreporting of care. Therefore, measures to quantify information redundancy play an essential role in evaluating innovations that operate on clinical narratives. This work is a quantitative examination of information redundancy in EHR notes. We present and evaluate two methods to measure redundancy: an information-theoretic approach and a lexicosyntactic and semantic model. Our first measure trains large Transformer-based language models using clinical text from a large openly available US-based ICU dataset and a large multi-site UK based Hospital. By comparing the information-theoretic efficient encoding of clinical text against open-domain corpora, we find that clinical text is ∼1.5× to ∼3× less efficient than open-domain corpora at conveying information. Our second measure, evaluates automated summarisation metrics Rouge and BERTScore to evaluate successive note pairs demonstrating lexicosyntactic and semantic redundancy, with averages from ∼43 to ∼65%.
Collapse
Affiliation(s)
- Thomas Searle
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK.
| | - Zina Ibrahim
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK.
| | - James Teo
- King's College Hospital NHS Foundation Trust, London, UK.
| | - Richard Dobson
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK; Institute of Health Informatics, University College London, London, UK.
| |
Collapse
|
19
|
|
20
|
Bloom BM, Hughes TC. Response to letter by Kakleas et al: Utilisation and accuracy of the emergency care data set in children with food allergy and anaphylaxis. Emerg Med J 2021; 38:863-864. [PMID: 34193615 DOI: 10.1136/emermed-2021-211721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/23/2021] [Indexed: 11/03/2022]
Affiliation(s)
| | - Thomas C Hughes
- Emergency Department, John Radcliffe Hospital, Oxford, Oxfordshire, UK
| |
Collapse
|
21
|
Implementation of a Real-Time Medication Intake Monitoring Technology Intervention in Community Pharmacy Settings: A Mixed-Method Pilot Study. PHARMACY 2021; 9:pharmacy9020105. [PMID: 34070544 PMCID: PMC8162977 DOI: 10.3390/pharmacy9020105] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 05/10/2021] [Accepted: 05/19/2021] [Indexed: 11/16/2022] Open
Abstract
Innovative dispensing products offering real-time medication intake monitoring are being developed to address medication non-adherence. However, implementation of these interventions within the workflow of a community pharmacy is unknown. The purpose of this study was to explore factors affecting implementation of a real-time adherence-monitoring, multidose-dispensing system in community pharmacies. A mixed-method study was conducted with pharmacy staff, who packaged and dispensed medications in smart multidose packages and monitored real-time medication intake via web-portal. Pharmacy staff participated in semi-structured interviews. The Technology Acceptance Model, Theory of Planned Behaviour and Capability, Opportunity, Motivation, Behaviour Model informed the interview guide. Interview transcripts were analyzed thematically and findings were mapped back to the frameworks. The usability was assessed by the System Usability Scale (SUS). Three pharmacists and one pharmacy assistant with a mean of 19 years of practice were interviewed. Three themes and 12 subthemes were generated. Themes included: pharmacy workflow factors, integration factors, and pharmacist-perceived patient factors. The mean SUS was found to be 80.63. Products with real-time adherence monitoring capabilities are valued by pharmacists. A careful assessment of infrastructure—including pharmacy workload, manpower and financial resources—is imperative for successful implementation of such interventions in a community pharmacy setting.
Collapse
|
22
|
Walker K, Dwyer T, Heaton HA. Emergency medicine electronic health record usability: where to from here? Emerg Med J 2021; 38:408-409. [PMID: 33727234 DOI: 10.1136/emermed-2021-211384] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2021] [Indexed: 11/03/2022]
Affiliation(s)
- Katie Walker
- Emergency Department, Casey Hospital, Berwick, Victoria, Australia .,School of Clinical Sciences, Faculty of Medicine, Nursing and Health Sciences, Melbourne, Victoria, Australia
| | - Tim Dwyer
- Department of Human Centred Computing, Monash University Faculty of Information Technology, Clayton, Victoria, Australia
| | - Heather A Heaton
- Department of Emergency Medicine, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
23
|
Bloom BM, Pott J, Thomas S, Gaunt DR, Hughes TC. Usability of electronic health record systems in UK EDs. Emerg Med J 2021; 38:410-415. [PMID: 33658268 PMCID: PMC8165140 DOI: 10.1136/emermed-2020-210401] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Revised: 01/04/2021] [Accepted: 01/10/2021] [Indexed: 11/04/2022]
Abstract
BACKGROUND The large volume of patients, rapid staff turnover and high work pressure mean that the usability of all systems within the ED is important. The transition to electronic health records (EHRs) has brought many benefits to emergency care but imposes a significant burden on staff to enter data. Poor usability has a direct consequence and opportunity cost in staff time and resources that could otherwise be employed in patient care. This research measures the usability of EHR systems in UK EDs using a validated assessment tool. METHODS This was a survey completed by members and fellows of the Royal College of Emergency Medicine conducted during summer 2019. The primary outcome was the System Usability Scale Score, which ranges from 0 (worst) to 100 (best). Scores were compared with an internationally recognised measure of acceptable usability of 68. Results were analysed by EHR system, country, healthcare organisation and physician grade. Only EHR systems with at least 20 responses were analysed. RESULTS There were 1663 responses from a total population of 8794 (19%) representing 192 healthcare organisations (mainly UK NHS), and 25 EHR systems. Fifteen EHR systems had at least 20 responses and were included in the analysis. No EHR system achieved a median usability score that met the industry standard of acceptable usability.The median usability score was 53 (IQR 35-68). Individual EHR systems' scores ranged from 35 (IQR 26-53) to 65 (IQR 44-80). CONCLUSION In this survey, no UK ED EHR system met the internationally validated standard of acceptable usability for information technology.
Collapse
Affiliation(s)
- Benjamin Michael Bloom
- Emergency Department, Royal London Hospital, London, UK .,Centre for Trauma Sciences, Blizard Institute, Queen Mary University of London, London, UK
| | - Jason Pott
- Emergency Department, Royal London Hospital, London, UK.,Centre for Trauma Sciences, Blizard Institute, Queen Mary University of London, London, UK
| | - Stephen Thomas
- Centre for Trauma Sciences, Blizard Institute, Queen Mary University of London, London, UK.,Emergency Department, Hamad General Hospital, Doha, Qatar
| | - David Ramon Gaunt
- Emergency Medicine, West Hertfordshire Hospitals NHS Trust, Watford, UK
| | | |
Collapse
|