1
|
Tegenaw GS, Sori DA, Teklemariam GK, Verbeke F, Cornelis J, Jansen B. Evaluation of a Computer-Aided Clinical Decision Support System for Point-of-Care Use in Low-Resource Primary Care Settings: Acceptability Evaluation Study. JMIR Hum Factors 2024; 11:e47631. [PMID: 38861298 PMCID: PMC11200044 DOI: 10.2196/47631] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 09/11/2023] [Accepted: 01/20/2024] [Indexed: 06/12/2024] Open
Abstract
BACKGROUND A clinical decision support system (CDSS) based on the logic and philosophy of clinical pathways is critical for managing the quality of health care and for standardizing care processes. Using such a system at a point-of-care setting is becoming more frequent these days. However, in a low-resource setting (LRS), such systems are frequently overlooked. OBJECTIVE The purpose of the study was to evaluate the user acceptance of a CDSS in LRSs. METHODS The CDSS evaluation was carried out at the Jimma Health Center and the Jimma Higher Two Health Center, Jimma, Ethiopia. The evaluation was based on 22 parameters organized into 6 categories: ease of use, system quality, information quality, decision changes, process changes, and user acceptance. A Mann-Whitney U test was used to investigate whether the difference between the 2 health centers was significant (2-tailed, 95% CI; α=.05). Pearson correlation and partial least squares structural equation modeling (PLS-SEM) was used to identify the relationship and factors influencing the overall acceptance of the CDSS in an LRS. RESULTS On the basis of 116 antenatal care, pregnant patient care, and postnatal care cases, 73 CDSS evaluation responses were recorded. We found that the 2 health centers did not differ significantly on 16 evaluation parameters. We did, however, detect a statistically significant difference in 6 parameters (P<.05). PLS-SEM results showed that the coefficient of determination, R2, of perceived user acceptance was 0.703. More precisely, the perceived ease of use (β=.015, P=.91) and information quality (β=.149, P=.25) had no positive effect on CDSS acceptance but, rather, on the system quality and perceived benefits of the CDSS, with P<.05 and β=.321 and β=.486, respectively. Furthermore, the perceived ease of use was influenced by information quality and system quality, with an R2 value of 0.479, indicating that the influence of information quality on the ease of use is significant but the influence of system quality on the ease of use is not, with β=.678 (P<.05) and β=.021(P=.89), respectively. Moreover, the influence of decision changes (β=.374, P<.05) and process changes (β=.749, P<.05) both was significant on perceived benefits (R2=0.983). CONCLUSIONS This study concludes that users are more likely to accept and use a CDSS at the point of care when it is easy to grasp the perceived benefits and system quality in terms of health care professionals' needs. We believe that the CDSS acceptance model developed in this study reveals specific factors and variables that constitute a step toward the effective adoption and deployment of a CDSS in LRSs.
Collapse
Affiliation(s)
- Geletaw Sahle Tegenaw
- Department of Electronics and Informatics, Vrije Universiteit Brussel, Brussel, Belgium
- Faculty of Computing, Jimma Institute of Technology, Jimma University, Jimma, Ethiopia
| | - Demisew Amenu Sori
- Department of Obstetrics and Gynecology, College of Health Science, Jimma University, Jimma, Ethiopia
| | | | - Frank Verbeke
- Department of Electronics and Informatics, Vrije Universiteit Brussel, Brussel, Belgium
| | - Jan Cornelis
- Department of Electronics and Informatics, Vrije Universiteit Brussel, Brussel, Belgium
| | - Bart Jansen
- Department of Electronics and Informatics, Vrije Universiteit Brussel, Brussel, Belgium
- Interuniversitair Micro-Electronica Centrum, Leuven, Belgium
| |
Collapse
|
2
|
Baudet A, Brennstuhl MJ, Lizon J, Regad M, Thilly N, Demoré B, Florentin A. Perceptions of infection control professionals toward electronic surveillance software supporting inpatient infections: A mixed methods study. Int J Med Inform 2024; 186:105419. [PMID: 38513323 DOI: 10.1016/j.ijmedinf.2024.105419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 03/13/2024] [Accepted: 03/18/2024] [Indexed: 03/23/2024]
Abstract
BACKGROUND Electronic surveillance software (ESS) collects multiple patient data from hospital software to assist infection control professionals in the prevention and control of hospital-associated infections. This study aimed to understand the perceptions of end users (i.e., infection control professionals) and the facilitators and barriers related to a commercial ESS named ZINC and to assess its usability. METHODS A mixed-method research approach was adopted among infection control professionals 10 months after the implementation of commercial ESS in the university hospital of Nancy, France. A qualitative analysis based on individual semistructured interviews was conducted to collect professionals' perceptions of ESS and to understand barriers and facilitators. Qualitative data were systematically coded and thematically analyzed. A quantitative analysis was performed using the System Usability Scale (SUS). RESULTS Thirteen infection control professionals were included. Qualitative analysis revealed technical, organizational and human barriers to the installation and use stages and five significant facilitators: the relevant design of the ESS, the improvement of infection prevention and control practices, the designation of a champion/superuser among professionals, training, and collaboration with the developer team. Quantitative analysis indicated that the evaluated ESS was a "good" system in terms of perceived ease of use, with an overall median SUS score of 85/100. CONCLUSIONS This study shows the value of ESS to support inpatient infections as perceived by infection control professionals. It reveals barriers and facilitators to the implementation and adoption of ESS. These barriers and facilitators should be considered to facilitate the installation of the software in other hospitals.
Collapse
Affiliation(s)
- Alexandre Baudet
- Université de Lorraine, Inserm, INSPIIRE, F-54000 Nancy, France; Université de Lorraine, CHRU-Nancy, F-54000 Nancy, France.
| | - Marie-Jo Brennstuhl
- Université de Lorraine, Inserm, INSPIIRE, F-54000 Nancy, France; Université de Lorraine, UFR Sciences Humaines et Sociales, Metz, France
| | - Julie Lizon
- Université de Lorraine, CHRU-Nancy, F-54000 Nancy, France
| | - Marie Regad
- Université de Lorraine, Inserm, INSPIIRE, F-54000 Nancy, France; Université de Lorraine, CHRU-Nancy, F-54000 Nancy, France
| | - Nathalie Thilly
- Université de Lorraine, Inserm, INSPIIRE, F-54000 Nancy, France; Université de Lorraine, CHRU-Nancy, F-54000 Nancy, France
| | - Béatrice Demoré
- Université de Lorraine, Inserm, INSPIIRE, F-54000 Nancy, France; Université de Lorraine, CHRU-Nancy, F-54000 Nancy, France
| | - Arnaud Florentin
- Université de Lorraine, Inserm, INSPIIRE, F-54000 Nancy, France; Université de Lorraine, CHRU-Nancy, F-54000 Nancy, France
| |
Collapse
|
3
|
Ackerhans S, Huynh T, Kaiser C, Schultz C. Exploring the role of professional identity in the implementation of clinical decision support systems-a narrative review. Implement Sci 2024; 19:11. [PMID: 38347525 PMCID: PMC10860285 DOI: 10.1186/s13012-024-01339-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 01/09/2024] [Indexed: 02/15/2024] Open
Abstract
BACKGROUND Clinical decision support systems (CDSSs) have the potential to improve quality of care, patient safety, and efficiency because of their ability to perform medical tasks in a more data-driven, evidence-based, and semi-autonomous way. However, CDSSs may also affect the professional identity of health professionals. Some professionals might experience these systems as a threat to their professional identity, as CDSSs could partially substitute clinical competencies, autonomy, or control over the care process. Other professionals may experience an empowerment of the role in the medical system. The purpose of this study is to uncover the role of professional identity in CDSS implementation and to identify core human, technological, and organizational factors that may determine the effect of CDSSs on professional identity. METHODS We conducted a systematic literature review and included peer-reviewed empirical studies from two electronic databases (PubMed, Web of Science) that reported on key factors to CDSS implementation and were published between 2010 and 2023. Our explorative, inductive thematic analysis assessed the antecedents of professional identity-related mechanisms from the perspective of different health care professionals (i.e., physicians, residents, nurse practitioners, pharmacists). RESULTS One hundred thirty-one qualitative, quantitative, or mixed-method studies from over 60 journals were included in this review. The thematic analysis found three dimensions of professional identity-related mechanisms that influence CDSS implementation success: perceived threat or enhancement of professional control and autonomy, perceived threat or enhancement of professional skills and expertise, and perceived loss or gain of control over patient relationships. At the technological level, the most common issues were the system's ability to fit into existing clinical workflows and organizational structures, and its ability to meet user needs. At the organizational level, time pressure and tension, as well as internal communication and involvement of end users were most frequently reported. At the human level, individual attitudes and emotional responses, as well as familiarity with the system, most often influenced the CDSS implementation. Our results show that professional identity-related mechanisms are driven by these factors and influence CDSS implementation success. The perception of the change of professional identity is influenced by the user's professional status and expertise and is improved over the course of implementation. CONCLUSION This review highlights the need for health care managers to evaluate perceived professional identity threats to health care professionals across all implementation phases when introducing a CDSS and to consider their varying manifestations among different health care professionals. Moreover, it highlights the importance of innovation and change management approaches, such as involving health professionals in the design and implementation process to mitigate threat perceptions. We provide future areas of research for the evaluation of the professional identity construct within health care.
Collapse
Affiliation(s)
- Sophia Ackerhans
- Kiel Institute for Responsible Innovation, University of Kiel, Westring 425, 24118, Kiel, Germany.
| | - Thomas Huynh
- Kiel Institute for Responsible Innovation, University of Kiel, Westring 425, 24118, Kiel, Germany
| | - Carsten Kaiser
- Kiel Institute for Responsible Innovation, University of Kiel, Westring 425, 24118, Kiel, Germany
| | - Carsten Schultz
- Kiel Institute for Responsible Innovation, University of Kiel, Westring 425, 24118, Kiel, Germany
| |
Collapse
|
4
|
Zhang T, Gephart SM, Subbian V, Boyce RD, Villa-Zapata L, Tan MS, Horn J, Gomez-Lumbreras A, Romero AV, Malone DC. Barriers to Adoption of Tailored Drug-Drug Interaction Clinical Decision Support. Appl Clin Inform 2023; 14:779-788. [PMID: 37793617 PMCID: PMC10550365 DOI: 10.1055/s-0043-1772686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Accepted: 07/20/2023] [Indexed: 10/06/2023] Open
Abstract
OBJECTIVE Despite the benefits of the tailored drug-drug interaction (DDI) alerts and the broad dissemination strategy, the uptake of our tailored DDI alert algorithms that are enhanced with patient-specific and context-specific factors has been limited. The goal of the study was to examine barriers and health care system dynamics related to implementing tailored DDI alerts and identify the factors that would drive optimization and improvement of DDI alerts. METHODS We employed a qualitative research approach, conducting interviews with a participant interview guide framed based on Proctor's taxonomy of implementation outcomes and informed by the Theoretical Domains Framework. Participants included pharmacists with informatics roles within hospitals, chief medical informatics officers, and associate medical informatics directors/officers. Our data analysis was informed by the technique used in grounded theory analysis, and the reporting of open coding results was based on a modified version of the Safety-Related Electronic Health Record Research Reporting Framework. RESULTS Our analysis generated 15 barriers, and we mapped the interconnections of these barriers, which clustered around three entities (i.e., users, organizations, and technical stakeholders). Our findings revealed that misaligned interests regarding DDI alert performance and misaligned expectations regarding DDI alert optimizations among these entities within health care organizations could result in system inertia in implementing tailored DDI alerts. CONCLUSION Health care organizations primarily determine the implementation and optimization of DDI alerts, and it is essential to identify and demonstrate value metrics that health care organizations prioritize to enable tailored DDI alert implementation. This could be achieved via a multifaceted approach, such as partnering with health care organizations that have the capacity to adopt tailored DDI alerts and identifying specialists who know users' needs, liaise with organizations and vendors, and facilitate technical stakeholders' work. In the future, researchers can adopt the systematic approach to study tailored DDI implementation problems from other system perspectives (e.g., the vendors' system).
Collapse
Affiliation(s)
- Tianyi Zhang
- Department of Systems and Industrial Engineering, College of Engineering, University of Arizona, Tucson, Arizona
| | - Sheila M. Gephart
- Advanced Nursing Practice and Science Division, College of Nursing, University of Arizona, Tucson, Arizona
| | - Vignesh Subbian
- Department of Systems and Industrial Engineering, College of Engineering, University of Arizona, Tucson, Arizona
| | - Richard D. Boyce
- Department of Biomedical Informatics, School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Lorenzo Villa-Zapata
- Clinical and Administrative Pharmacy, College of Pharmacy, University of Georgia, Athens, Georgia
| | - Malinda S. Tan
- Department of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, Utah
| | - John Horn
- Department of Pharmacy, School of Pharmacy, University of Washington, Seattle, Washington
| | - Ainhoa Gomez-Lumbreras
- Department of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, Utah
| | | | - Daniel C. Malone
- Department of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, Utah
| |
Collapse
|
5
|
Alshehri N, Alanazi A. Pharmacists' Perceptions on Safety Alerts of the Drug Utilization Review (DUR) in Electronic Health Records in a Tertiary Healthcare Hospital. PHARMACY 2023; 11:119. [PMID: 37489350 PMCID: PMC10366836 DOI: 10.3390/pharmacy11040119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2023] [Revised: 07/14/2023] [Accepted: 07/18/2023] [Indexed: 07/26/2023] Open
Abstract
Electronic Drug Alarms and Drug Utilization Reviews (DURs) are crucial in improving patient safety by reducing the dispensing of contraindicated medications and minimizing adverse drug events. The DUR system often generates low-level alerts, making it challenging for pharmacists and doctors to discern more critical alerts. This can result in alert fatigue, causing burnout and jeopardizing patient safety. A cross-sectional study was conducted in a tertiary hospital to explore pharmacists' perspectives and experience with the DUR system. This study aimed to identify their responses to alerts indicating a need to change the original prescription and the difficulties encountered. Out of all the participants, 85% had prior experience with DUR alerts. However, 40% of them expressed dissatisfaction with the alerts. Moreover, 88% of the participants received highly frequent DUR alerts, but only 40% believed that DUR alerts could identify rare adverse drug reactions. Additionally, only 27% of the participants altered their prescriptions based on alerts for the MAOI/serotonin modulator. The survey showed that 66% of participants believe improvements are necessary for the DUR system. Specifically, 77% of participants felt that more information is needed on overlapping prescriptions, 82% on patients with chronic diseases, and 82% on potential reactions caused by co-administration. At the same time, 75% raised concern about the need for backup for any server breakdown. Positive perceptions about DUR lead to changing the prescription in response to an alert. Therefore, improving the DUR system is crucial to prevent pharmacists from missing important alerts and to increase their awareness of clinically significant alarm signals. By doing so, we can optimize patient safety and contribute to providing high-quality healthcare services.
Collapse
Affiliation(s)
- Nouf Alshehri
- Department of Health Informatics, College of Public Health and Health Informatics, King Saud Ibn Abdulaziz University for Health Sciences, Riyadh 11481, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh 14611, Saudi Arabia
| | - Abdullah Alanazi
- Department of Health Informatics, College of Public Health and Health Informatics, King Saud Ibn Abdulaziz University for Health Sciences, Riyadh 11481, Saudi Arabia
| |
Collapse
|
6
|
Brühwiler LD, Gresch SJ, Schwappach DLB. Implementation status of safety measures to prevent errors with non-oncologic methotrexate: surveys in community and hospital pharmacies. Int J Clin Pharm 2023:10.1007/s11096-023-01567-z. [PMID: 36991221 DOI: 10.1007/s11096-023-01567-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Accepted: 03/01/2023] [Indexed: 03/31/2023]
Abstract
BACKGROUND Accidental overdose of low-dose methotrexate can lead to serious patient harm. Different safety measures are recommended to prevent errors, yet, as errors continue to happen, their implementation is questionable. AIM To evaluate the implementation status of safety measures for methotrexate in community and hospital pharmacies. METHOD An electronic questionnaire was sent to head pharmacists of 163 community and 94 hospital pharmacies in Switzerland. The implementation of recommended safety measures (general measures, safety working procedures, IT-based measures) was assessed and descriptive analysis performed. An analysis of sales data underlined the relevance of our results, i.e., the population under risk for overdose. RESULTS A response was obtained from 53% (n = 87) of community and 50% (n = 47) of hospital pharmacists. Pharmacies had implemented a median of 6 (IQR 3, community) and 5 (IQR 5, hospital) safety measures overall. Most of these were defined safety procedures, instructing staff on how to handle methotrexate prescriptions. Across all safety measures, compliance with single procedures was perceived as "very likely" by 54% of community pharmacies. IT-based measures (e.g., alerts) were absent in 38% (n = 31) of community and 57% (n = 27) of hospital pharmacies. On average, every community pharmacy dispensed 22 packages annually. CONCLUSION Safety in relation to methotrexate in pharmacies relies mostly on staff instructions, which are considered weak measures. In light of the serious risk imposed on patients, pharmacies should set a focus on stronger IT-based measures that rely less on human performance.
Collapse
Affiliation(s)
| | - Simone J Gresch
- Swiss Patient Safety Foundation, Zurich, Switzerland
- Pharmaceutical Care Research Group, University of Basel, Basel, Switzerland
| | - David L B Schwappach
- Swiss Patient Safety Foundation, Zurich, Switzerland
- Institute of Social and Preventive Medicine (ISPM), University of Bern, Bern, Switzerland
| |
Collapse
|
7
|
Fujimori R, Liu K, Soeno S, Naraba H, Ogura K, Hara K, Sonoo T, Ogura T, Nakamura K, Goto T. Acceptance, barriers and facilitators to implementing AI-based decision support systems in emergency departments: a quantitative and qualitative evaluation (Preprint). JMIR Form Res 2022; 6:e36501. [PMID: 35699995 PMCID: PMC9237770 DOI: 10.2196/36501] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Revised: 04/13/2022] [Accepted: 05/08/2022] [Indexed: 01/22/2023] Open
Abstract
Background Despite the increasing availability of clinical decision support systems (CDSSs) and rising expectation for CDSSs based on artificial intelligence (AI), little is known about the acceptance of AI-based CDSS by physicians and its barriers and facilitators in emergency care settings. Objective We aimed to evaluate the acceptance, barriers, and facilitators to implementing AI-based CDSSs in the emergency care setting through the opinions of physicians on our newly developed, real-time AI-based CDSS, which alerts ED physicians by predicting aortic dissection based on numeric and text information from medical charts, by using the Unified Theory of Acceptance and Use of Technology (UTAUT; for quantitative evaluation) and the Consolidated Framework for Implementation Research (CFIR; for qualitative evaluation) frameworks. Methods This mixed methods study was performed from March to April 2021. Transitional year residents (n=6), emergency medicine residents (n=5), and emergency physicians (n=3) from two community, tertiary care hospitals in Japan were included. We first developed a real-time CDSS for predicting aortic dissection based on numeric and text information from medical charts (eg, chief complaints, medical history, vital signs) with natural language processing. This system was deployed on the internet, and the participants used the system with clinical vignettes of model cases. Participants were then involved in a mixed methods evaluation consisting of a UTAUT-based questionnaire with a 5-point Likert scale (quantitative) and a CFIR-based semistructured interview (qualitative). Cronbach α was calculated as a reliability estimate for UTAUT subconstructs. Interviews were sampled, transcribed, and analyzed using the MaxQDA software. The framework analysis approach was used during the study to determine the relevance of the CFIR constructs. Results All 14 participants completed the questionnaires and interviews. Quantitative analysis revealed generally positive responses for user acceptance with all scores above the neutral score of 3.0. In addition, the mixed methods analysis identified two significant barriers (System Performance, Compatibility) and two major facilitators (Evidence Strength, Design Quality) for implementation of AI-based CDSSs in emergency care settings. Conclusions Our mixed methods evaluation based on theoretically grounded frameworks revealed the acceptance, barriers, and facilitators of implementation of AI-based CDSS. Although the concern of system failure and overtrusting of the system could be barriers to implementation, the locality of the system and designing an intuitive user interface could likely facilitate the use of optimal AI-based CDSS. Alleviating and resolving these factors should be key to achieving good user acceptance of AI-based CDSS.
Collapse
Affiliation(s)
- Ryo Fujimori
- Faculty of Medicine, The University of Tokyo, Tokyo, Japan
- TXP Medical Co Ltd, Tokyo, Japan
| | - Keibun Liu
- TXP Medical Co Ltd, Tokyo, Japan
- Critical Care Research Group, The Prince Charles Hospital, Brisbane, Australia
| | - Shoko Soeno
- TXP Medical Co Ltd, Tokyo, Japan
- Department of Palliative Care, Southern Tohoku General Hospital, Fukushima, Japan
| | - Hiromu Naraba
- TXP Medical Co Ltd, Tokyo, Japan
- Department of Emergency and Critical Care Medicine, Hitachi General Hospital, Ibaraki, Japan
| | - Kentaro Ogura
- Faculty of Medicine, The University of Tokyo, Tokyo, Japan
- TXP Medical Co Ltd, Tokyo, Japan
| | - Konan Hara
- TXP Medical Co Ltd, Tokyo, Japan
- Department of Economics, University of Arizona, Tucson, AZ, United States
| | - Tomohiro Sonoo
- TXP Medical Co Ltd, Tokyo, Japan
- Department of Emergency and Critical Care Medicine, Hitachi General Hospital, Ibaraki, Japan
| | - Takayuki Ogura
- Department of Emergency and Critical Care Medicine, Saiseikai Utsunomiya Hospital, Tochigi, Japan
| | - Kensuke Nakamura
- Department of Emergency and Critical Care Medicine, Hitachi General Hospital, Ibaraki, Japan
| | | |
Collapse
|
8
|
Chen RF, Hsiao JL. Health Professionals' Perspectives on Electronic Medical Record Infusion and Individual Performance: Model Development and Questionnaire Survey Study. JMIR Med Inform 2021; 9:e32180. [PMID: 34851297 PMCID: PMC8672292 DOI: 10.2196/32180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Revised: 10/07/2021] [Accepted: 10/17/2021] [Indexed: 12/05/2022] Open
Abstract
Background Electronic medical records (EMRs) are integrated information sources generated by health care professionals (HCPs) from various health care information systems. EMRs play crucial roles in improving the quality of care and medical decision-making and in facilitating cross-hospital health information exchange. Although many hospitals have invested considerable resources and efforts to develop EMRs for several years, the factors affecting the long-term success of EMRs, particularly in the EMR infusion stage, remain unclear. Objective The aim of this study was to investigate the effects of technology, user, and task characteristics on EMR infusion to determine the factors that largely affect EMR infusion. In addition, we examined the effect of EMR infusion on individual HCP performance. Methods A questionnaire survey was used to collect data from HCPs with >6 months experience in using EMRs in a Taiwanese teaching hospital. A total of 316 questionnaires were distributed and 211 complete copies were returned, yielding a valid response rate of 66.8%. The collected data were further analyzed using WarpPLS 5.0. Results EMR infusion (R2=0.771) was mainly affected by user habits (β=.411), portability (β=.217), personal innovativeness (β=.198), technostress (β=.169), and time criticality (β=.168), and individual performance (R2=0.541) was affected by EMR infusion (β=.735). This finding indicated that user (habit, personal innovativeness, and technostress), technology (portability), and task (mobility and time criticality) characteristics have major effects on EMR infusion. Furthermore, the results indicated that EMR infusion positively affects individual performance. Conclusions The factors identified in this study can extend information systems infusion theory and provide useful insights for the further improvement of EMR development in hospitals and by the government, specifically in its infusion stage. In addition, the developed instrument can be used as an assessment tool to identify the key factors for EMR infusion, and to evaluate the extent of EMR infusion and the individual performance of hospitals that have implemented EMR systems. Moreover, the results can help governments to understand the urgent needs of hospitals in implementing EMR systems, provide sufficient resources and support to improve the incentives of EMR development, and develop adequate EMR policies for the meaningful use of electronic health records among hospitals and clinics.
Collapse
Affiliation(s)
- Rai-Fu Chen
- Department of Information Management, Chia-Nan University of Pharmacy and Science, Tainan City, Taiwan
| | - Ju-Ling Hsiao
- Department of Pharmacy, Chia-Nan University of Pharmacy and Science, Tainan City, Taiwan
| |
Collapse
|
9
|
Abdulaal A, Patel A, Al-Hindawi A, Charani E, Alqahtani SA, Davies GW, Mughal N, Moore LSP. Clinical Utility and Functionality of an Artificial Intelligence-Based App to Predict Mortality in COVID-19: Mixed Methods Analysis. JMIR Form Res 2021; 5:e27992. [PMID: 34115603 PMCID: PMC8320734 DOI: 10.2196/27992] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2021] [Revised: 03/19/2021] [Accepted: 05/31/2021] [Indexed: 12/24/2022] Open
Abstract
Background The artificial neural network (ANN) is an increasingly important tool in the context of solving complex medical classification problems. However, one of the principal challenges in leveraging artificial intelligence technology in the health care setting has been the relative inability to translate models into clinician workflow. Objective Here we demonstrate the development of a COVID-19 outcome prediction app that utilizes an ANN and assesses its usability in the clinical setting. Methods Usability assessment was conducted using the app, followed by a semistructured end-user interview. Usability was specified by effectiveness, efficiency, and satisfaction measures. These data were reported with descriptive statistics. The end-user interview data were analyzed using the thematic framework method, which allowed for the development of themes from the interview narratives. In total, 31 National Health Service physicians at a West London teaching hospital, including foundation physicians, senior house officers, registrars, and consultants, were included in this study. Results All participants were able to complete the assessment, with a mean time to complete separate patient vignettes of 59.35 (SD 10.35) seconds. The mean system usability scale score was 91.94 (SD 8.54), which corresponds to a qualitative rating of “excellent.” The clinicians found the app intuitive and easy to use, with the majority describing its predictions as a useful adjunct to their clinical practice. The main concern was related to the use of the app in isolation rather than in conjunction with other clinical parameters. However, most clinicians speculated that the app could positively reinforce or validate their clinical decision-making. Conclusions Translating artificial intelligence technologies into the clinical setting remains an important but challenging task. We demonstrate the effectiveness, efficiency, and system usability of a web-based app designed to predict the outcomes of patients with COVID-19 from an ANN.
Collapse
Affiliation(s)
- Ahmed Abdulaal
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Aatish Patel
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Ahmed Al-Hindawi
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Esmita Charani
- National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, United Kingdom
| | - Saleh A Alqahtani
- Johns Hopkins University, Baltimore, MD, United States.,King Faisal Specialist Hospital and Research Centre, Riyadh, Saudi Arabia
| | - Gary W Davies
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Nabeela Mughal
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom.,National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, United Kingdom.,North West London Pathology, Imperial College Healthcare NHS Trust, London, United Kingdom
| | - Luke Stephen Prockter Moore
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom.,National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, United Kingdom.,North West London Pathology, Imperial College Healthcare NHS Trust, London, United Kingdom
| |
Collapse
|
10
|
Hammar T, Hamqvist S, Zetterholm M, Jokela P, Ferati M. Current Knowledge about Providing Drug-Drug Interaction Services for Patients-A Scoping Review. PHARMACY 2021; 9:69. [PMID: 33805205 PMCID: PMC8103271 DOI: 10.3390/pharmacy9020069] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Revised: 03/20/2021] [Accepted: 03/22/2021] [Indexed: 12/24/2022] Open
Abstract
Drug-drug interactions (DDIs) pose a major problem to patient safety. eHealth solutions have the potential to address this problem and generally improve medication management by providing digital services for health care professionals and patients. Clinical decision support systems (CDSS) to alert physicians or pharmacists about DDIs are common, and there is an extensive body of research about CDSS for professionals. Information about DDIs is commonly requested by patients, but little is known about providing similar support to patients. The aim of this scoping review was to explore and describe current knowledge about providing digital DDI services for patients. Using a broad search strategy and an established framework for scoping reviews, 19 papers were included. The results show that although some patients want to check for DDIs themselves, there are differences between patients, in terms of demands and ability. There are numerous DDI services available, but the existence of large variations regarding service quality implies potential safety issues. The review includes suggestions about design features but also indicates a substantial knowledge gap highlighting the need for further research about how to best design and provide digital DDI to patients without risking patient safety or having other unintended consequences.
Collapse
Affiliation(s)
- Tora Hammar
- Department of Medicine and Optometry, The eHealth Institute, Linnaeus University, 391 82 Kalmar, Sweden;
| | - Sara Hamqvist
- Department of Media and Journalism, Linnaeus University, 391 82 Kalmar, Sweden;
| | - My Zetterholm
- Department of Medicine and Optometry, The eHealth Institute, Linnaeus University, 391 82 Kalmar, Sweden;
- Department of Informatics, Linnaeus University, 391 82 Kalmar, Sweden; (P.J.); (M.F.)
| | - Päivi Jokela
- Department of Informatics, Linnaeus University, 391 82 Kalmar, Sweden; (P.J.); (M.F.)
| | - Mexhid Ferati
- Department of Informatics, Linnaeus University, 391 82 Kalmar, Sweden; (P.J.); (M.F.)
| |
Collapse
|
11
|
Laka M, Milazzo A, Merlin T. Factors That Impact the Adoption of Clinical Decision Support Systems (CDSS) for Antibiotic Management. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18041901. [PMID: 33669353 PMCID: PMC7920296 DOI: 10.3390/ijerph18041901] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 02/08/2021] [Accepted: 02/11/2021] [Indexed: 01/22/2023]
Abstract
The study evaluated individual and setting-specific factors that moderate clinicians’ perception regarding use of clinical decision support systems (CDSS) for antibiotic management. A cross-sectional online survey examined clinicians’ perceptions about CDSS implementation for antibiotic management in Australia. Multivariable logistic regression determined the association between drivers of CDSS adoption and different moderators. Clinical experience, CDSS use and care setting were important predictors of clinicians’ perception concerning CDSS adoption. Compared to nonusers, CDSS users were less likely to lack confidence in CDSS (OR = 0.63, 95%, CI = 0.32, 0.94) and consider it a threat to professional autonomy (OR = 0.47, 95%, CI = 0.08, 0.83). Conversely, there was higher likelihood in experienced clinicians (>20 years) to distrust CDSS (OR = 1.58, 95%, CI = 1.08, 2.23) due to fear of comprising their clinical judgement (OR = 1.68, 95%, CI = 1.27, 2.85). In primary care, clinicians were more likely to perceive time constraints (OR = 1.96, 95%, CI = 1.04, 3.70) and patient preference (OR = 1.84, 95%, CI = 1.19, 2.78) as barriers to CDSS adoption for antibiotic prescribing. Our findings provide differentiated understanding of the CDSS implementation landscape by identifying different individual, organisational and system-level factors that influence system adoption. The individual and setting characteristics can help understand the variability in CDSS adoption for antibiotic management in different clinicians.
Collapse
Affiliation(s)
- Mah Laka
- School of Public Health, University of Adelaide, Adelaide 5005, Australia; (M.L.); (A.M.)
| | - Adriana Milazzo
- School of Public Health, University of Adelaide, Adelaide 5005, Australia; (M.L.); (A.M.)
| | - Tracy Merlin
- Adelaide Health Technology Assessment (AHTA), School of Public Health, University of Adelaide, Adelaide 5005, Australia
- Correspondence: ; Tel.: +61-(8)-8313-3575
| |
Collapse
|