1
|
Wang Y, Fu W, Zhang Y, Wang D, Gu Y, Wang W, Xu H, Ge X, Ye C, Fang J, Su L, Wang J, He W, Zhang X, Feng R. Constructing and implementing a performance evaluation indicator set for artificial intelligence decision support systems in pediatric outpatient clinics: an observational study. Sci Rep 2024; 14:14482. [PMID: 38914707 PMCID: PMC11196575 DOI: 10.1038/s41598-024-64893-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 06/13/2024] [Indexed: 06/26/2024] Open
Abstract
Artificial intelligence (AI) decision support systems in pediatric healthcare have a complex application background. As an AI decision support system (AI-DSS) can be costly, once applied, it is crucial to focus on its performance, interpret its success, and then monitor and update it to ensure ongoing success consistently. Therefore, a set of evaluation indicators was explicitly developed for AI-DSS in pediatric healthcare, enabling continuous and systematic performance monitoring. The study unfolded in two stages. The first stage encompassed establishing the evaluation indicator set through a literature review, a focus group interview, and expert consultation using the Delphi method. In the second stage, weight analysis was conducted. Subjective weights were calculated based on expert opinions through analytic hierarchy process, while objective weights were determined using the entropy weight method. Subsequently, subject and object weights were synthesized to form the combined weight. In the two rounds of expert consultation, the authority coefficients were 0.834 and 0.846, Kendall's coordination coefficient was 0.135 in Round 1 and 0.312 in Round 2. The final evaluation indicator set has three first-class indicators, fifteen second-class indicators, and forty-seven third-class indicators. Indicator I-1(Organizational performance) carries the highest weight, followed by Indicator I-2(Societal performance) and Indicator I-3(User experience performance) in the objective and combined weights. Conversely, 'Societal performance' holds the most weight among the subjective weights, followed by 'Organizational performance' and 'User experience performance'. In this study, a comprehensive and specialized set of evaluation indicators for the AI-DSS in the pediatric outpatient clinic was established, and then implemented. Continuous evaluation still requires long-term data collection to optimize the weight proportions of the established indicators.
Collapse
Affiliation(s)
- Yingwen Wang
- Nursing Department, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Weijia Fu
- Medical Information Center, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Yuejie Zhang
- School of Computer Science, Fudan University, Shanghai, 200438, China
| | - Daoyang Wang
- School of Public, Health Fudan University, Shanghai, 200032, China
| | - Ying Gu
- Nursing Department, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Weibing Wang
- School of Public, Health Fudan University, Shanghai, 200032, China
| | - Hong Xu
- Nephrology Department, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Xiaoling Ge
- Statistical and Data Management Center, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Chengjie Ye
- Medical Information Center, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Jinwu Fang
- School of Public, Health Fudan University, Shanghai, 200032, China
| | - Ling Su
- Statistical and Data Management Center, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Jiayu Wang
- National Health Commission Key Laboratory of Neonatal Diseases (Fudan University), Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Wen He
- Respiratory Department, Children's Hospital of Fudan University, Shanghai, 201102, China
| | - Xiaobo Zhang
- Respiratory Department, Children's Hospital of Fudan University, Shanghai, 201102, China.
| | - Rui Feng
- School of Computer Science, Fudan University, Shanghai, 200438, China.
- School of Computer Science, Fudan University, 2005 Songhu Road, Shanghai, 200438, China.
| |
Collapse
|
2
|
Ahmadzadeh B, Patey C, Hurley O, Knight J, Norman P, Farrell A, Czarnuch S, Asghari S. Applications of Artificial Intelligence in Emergency Departments to Improve Wait Times: Protocol for an Integrative Living Review. JMIR Res Protoc 2024; 13:e52612. [PMID: 38607662 PMCID: PMC11053385 DOI: 10.2196/52612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 02/14/2024] [Accepted: 03/01/2024] [Indexed: 04/13/2024] Open
Abstract
BACKGROUND Long wait times in the emergency department (ED) are a major issue for health care systems all over the world. The application of artificial intelligence (AI) is a novel strategy to reduce ED wait times when compared to the interventions included in previous research endeavors. To date, comprehensive systematic reviews that include studies involving AI applications in the context of EDs have covered a wide range of AI implementation issues. However, the lack of an iterative update strategy limits the use of these reviews. Since the subject of AI development is cutting edge and is continuously changing, reviews in this area must be frequently updated to remain relevant. OBJECTIVE This study aims to provide a summary of the evidence that is currently available regarding how AI can affect ED wait times; discuss the applications of AI in improving wait times; and periodically assess the depth, breadth, and quality of the evidence supporting the application of AI in reducing ED wait times. METHODS We plan to conduct a living systematic review (LSR). Our strategy involves conducting continuous monitoring of evidence, with biannual search updates and annual review updates. Upon completing the initial round of the review, we will refine the search strategy and establish clear schedules for updating the LSR. An interpretive synthesis using Whittemore and Knafl's framework will be performed to compile and summarize the findings. The review will be carried out using an integrated knowledge translation strategy, and knowledge users will be involved at all stages of the review to guarantee applicability, usability, and clarity of purpose. RESULTS The literature search was completed by September 22, 2023, and identified 17,569 articles. The title and abstract screening were completed by December 9, 2023. In total, 70 papers were eligible. The full-text screening is in progress. CONCLUSIONS The review will summarize AI applications that improve ED wait time. The LSR enables researchers to maintain high methodological rigor while enhancing the timeliness, applicability, and value of the review. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/52612.
Collapse
Affiliation(s)
- Bahareh Ahmadzadeh
- Centre for Rural Health Studies, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Christopher Patey
- Eastern Health, Carbonear Institute for Rural Reach and Innovation by the Sea, Carbonear General Hospital, Carbonear, NL, Canada
- Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Oliver Hurley
- Centre for Rural Health Studies, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - John Knight
- Data and Information Services, Digital Health, NL Health Services, St. John's, NL, Canada
- Division of Community Health and Humanities, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Paul Norman
- Eastern Health, Carbonear Institute for Rural Reach and Innovation by the Sea, Carbonear General Hospital, Carbonear, NL, Canada
| | - Alison Farrell
- Health Sciences Library, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Stephen Czarnuch
- Department of Electrical and Computer Engineering, Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John's, NL, Canada
- Discipline of Emergency Medicine, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Shabnam Asghari
- Centre for Rural Health Studies, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| |
Collapse
|
3
|
Cohen I, Sorin V, Lekach R, Raskin D, Segev M, Klang E, Eshed I, Barash Y. Artificial intelligence for detection of effusion and lipo-hemarthrosis in X-rays and CT of the knee. Eur J Radiol 2024; 175:111460. [PMID: 38608501 DOI: 10.1016/j.ejrad.2024.111460] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 03/29/2024] [Accepted: 04/08/2024] [Indexed: 04/14/2024]
Abstract
BACKGROUND Traumatic knee injuries are challenging to diagnose accurately through radiography and to a lesser extent, through CT, with fractures sometimes overlooked. Ancillary signs like joint effusion or lipo-hemarthrosis are indicative of fractures, suggesting the need for further imaging. Artificial Intelligence (AI) can automate image analysis, improving diagnostic accuracy and help prioritizing clinically important X-ray or CT studies. OBJECTIVE To develop and evaluate an AI algorithm for detecting effusion of any kind in knee X-rays and selected CT images and distinguishing between simple effusion and lipo-hemarthrosis indicative of intra-articular fractures. METHODS This retrospective study analyzed post traumatic knee imaging from January 2016 to February 2023, categorizing images into lipo-hemarthrosis, simple effusion, or normal. It utilized the FishNet-150 algorithm for image classification, with class activation maps highlighting decision-influential regions. The AI's diagnostic accuracy was validated against a gold standard, based on the evaluations made by a radiologist with at least four years of experience. RESULTS Analysis included CT images from 515 patients and X-rays from 637 post traumatic patients, identifying lipo-hemarthrosis, simple effusion, and normal findings. The AI showed an AUC of 0.81 for detecting any effusion, 0.78 for simple effusion, and 0.83 for lipo-hemarthrosis in X-rays; and 0.89, 0.89, and 0.91, respectively, in CTs. CONCLUSION The AI algorithm effectively detects knee effusion and differentiates between simple effusion and lipo-hemarthrosis in post-traumatic patients for both X-rays and selected CT images further studies are needed to validate these results.
Collapse
Affiliation(s)
- Israel Cohen
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Vera Sorin
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Ruth Lekach
- Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Nuclear Medicine, Sourasky Medical Center, Tel-Aviv, Israel.
| | - Daniel Raskin
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Maria Segev
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Eyal Klang
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Iris Eshed
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Yiftach Barash
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| |
Collapse
|
4
|
Maleki Varnosfaderani S, Forouzanfar M. The Role of AI in Hospitals and Clinics: Transforming Healthcare in the 21st Century. Bioengineering (Basel) 2024; 11:337. [PMID: 38671759 PMCID: PMC11047988 DOI: 10.3390/bioengineering11040337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 03/25/2024] [Accepted: 03/26/2024] [Indexed: 04/28/2024] Open
Abstract
As healthcare systems around the world face challenges such as escalating costs, limited access, and growing demand for personalized care, artificial intelligence (AI) is emerging as a key force for transformation. This review is motivated by the urgent need to harness AI's potential to mitigate these issues and aims to critically assess AI's integration in different healthcare domains. We explore how AI empowers clinical decision-making, optimizes hospital operation and management, refines medical image analysis, and revolutionizes patient care and monitoring through AI-powered wearables. Through several case studies, we review how AI has transformed specific healthcare domains and discuss the remaining challenges and possible solutions. Additionally, we will discuss methodologies for assessing AI healthcare solutions, ethical challenges of AI deployment, and the importance of data privacy and bias mitigation for responsible technology use. By presenting a critical assessment of AI's transformative potential, this review equips researchers with a deeper understanding of AI's current and future impact on healthcare. It encourages an interdisciplinary dialogue between researchers, clinicians, and technologists to navigate the complexities of AI implementation, fostering the development of AI-driven solutions that prioritize ethical standards, equity, and a patient-centered approach.
Collapse
Affiliation(s)
| | - Mohamad Forouzanfar
- Département de Génie des Systèmes, École de Technologie Supérieure (ÉTS), Université du Québec, Montréal, QC H3C 1K3, Canada
- Centre de Recherche de L’institut Universitaire de Gériatrie de Montréal (CRIUGM), Montréal, QC H3W 1W5, Canada
| |
Collapse
|
5
|
Jagemann I, Wensing O, Stegemann M, Hirschfeld G. Acceptance of Medical Artificial Intelligence in Skin Cancer Screening: Choice-Based Conjoint Survey. JMIR Form Res 2024; 8:e46402. [PMID: 38214959 PMCID: PMC10818228 DOI: 10.2196/46402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 08/17/2023] [Accepted: 11/20/2023] [Indexed: 01/13/2024] Open
Abstract
BACKGROUND There is great interest in using artificial intelligence (AI) to screen for skin cancer. This is fueled by a rising incidence of skin cancer and an increasing scarcity of trained dermatologists. AI systems capable of identifying melanoma could save lives, enable immediate access to screenings, and reduce unnecessary care and health care costs. While such AI-based systems are useful from a public health perspective, past research has shown that individual patients are very hesitant about being examined by an AI system. OBJECTIVE The aim of this study was two-fold: (1) to determine the relative importance of the provider (in-person physician, physician via teledermatology, AI, personalized AI), costs of screening (free, 10€, 25€, 40€; 1€=US $1.09), and waiting time (immediate, 1 day, 1 week, 4 weeks) as attributes contributing to patients' choices of a particular mode of skin cancer screening; and (2) to investigate whether sociodemographic characteristics, especially age, were systematically related to participants' individual choices. METHODS A choice-based conjoint analysis was used to examine the acceptance of medical AI for a skin cancer screening from the patient's perspective. Participants responded to 12 choice sets, each containing three screening variants, where each variant was described through the attributes of provider, costs, and waiting time. Furthermore, the impacts of sociodemographic characteristics (age, gender, income, job status, and educational background) on the choices were assessed. RESULTS Among the 383 clicks on the survey link, a total of 126 (32.9%) respondents completed the online survey. The conjoint analysis showed that the three attributes had more or less equal importance in contributing to the participants' choices, with provider being the most important attribute. Inspecting the individual part-worths of conjoint attributes showed that treatment by a physician was the most preferred modality, followed by electronic consultation with a physician and personalized AI; the lowest scores were found for the three AI levels. Concerning the relationship between sociodemographic characteristics and relative importance, only age showed a significant positive association to the importance of the attribute provider (r=0.21, P=.02), in which younger participants put less importance on the provider than older participants. All other correlations were not significant. CONCLUSIONS This study adds to the growing body of research using choice-based experiments to investigate the acceptance of AI in health contexts. Future studies are needed to explore the reasons why AI is accepted or rejected and whether sociodemographic characteristics are associated with this decision.
Collapse
Affiliation(s)
- Inga Jagemann
- School of Business, University of Applied Sciences and Arts Bielefeld, Bielefeld, Germany
| | - Ole Wensing
- School of Business, University of Applied Sciences and Arts Bielefeld, Bielefeld, Germany
| | - Manuel Stegemann
- School of Business, University of Applied Sciences and Arts Bielefeld, Bielefeld, Germany
| | - Gerrit Hirschfeld
- School of Business, University of Applied Sciences and Arts Bielefeld, Bielefeld, Germany
| |
Collapse
|
6
|
Mese I, Taslicay CA, Sivrioglu AK. Improving radiology workflow using ChatGPT and artificial intelligence. Clin Imaging 2023; 103:109993. [PMID: 37812965 DOI: 10.1016/j.clinimag.2023.109993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 08/19/2023] [Accepted: 09/28/2023] [Indexed: 10/11/2023]
Abstract
Artificial Intelligence is a branch of computer science that aims to create intelligent machines capable of performing tasks that typically require human intelligence. One of the branches of artificial intelligence is natural language processing, which is dedicated to studying the interaction between computers and human language. ChatGPT is a sophisticated natural language processing tool that can understand and respond to complex questions and commands in natural language. Radiology is a vital aspect of modern medicine that involves the use of imaging technologies to diagnose and treat medical conditions artificial intelligence, including ChatGPT, can be integrated into radiology workflows to improve efficiency, accuracy, and patient care. ChatGPT can streamline various radiology workflow steps, including patient registration, scheduling, patient check-in, image acquisition, interpretation, and reporting. While ChatGPT has the potential to transform radiology workflows, there are limitations to the technology that must be addressed, such as the potential for bias in artificial intelligence algorithms and ethical concerns. As technology continues to advance, ChatGPT is likely to become an increasingly important tool in the field of radiology, and in healthcare more broadly.
Collapse
Affiliation(s)
- Ismail Mese
- Department of Radiology, Health Sciences University, Erenkoy Mental Health and Neurology Training and Research Hospital, 19 Mayıs, Sinan Ercan Cd. No: 23, Kadıköy/Istanbul 34736, Turkey.
| | | | - Ali Kemal Sivrioglu
- Department of Radiology, Liv Hospital Vadistanbul, Ayazağa Mahallesi, Kemerburgaz Caddesi, Vadistanbul Park Etabı, 7F Blok, 34396 Sarıyer/İstanbul, Turkey
| |
Collapse
|
7
|
Zhang H, Ma W, Zhou S, Zhu J, Wang L, Gong K. Effect of waiting time on patient satisfaction in outpatient: An empirical investigation. Medicine (Baltimore) 2023; 102:e35184. [PMID: 37800750 PMCID: PMC10553012 DOI: 10.1097/md.0000000000035184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 08/22/2023] [Indexed: 10/07/2023] Open
Abstract
This study aimed to identify the effect of waiting time on patient satisfaction and the relationship between different types of waiting time. The questionnaire contained 2 parts. The first part included questions about expected waiting time (EWT), reasonable waiting time, tolerance waiting time, and basic personal information. The second part included perceived waiting time (PWT) and satisfaction evaluation. The actual waiting time (AWT) was recorded by the worker. Linear regression was used to analyze the influence of waiting time on satisfaction. Before data collection, this study was approved by the hospital's health ethics committee. In total, 323 questionnaires were collected, of which 292 (90.4%) were valid. The EWT, tolerance waiting time, rational waiting time, and PWT had a significant effect on patient satisfaction (P = .006, P = .043, P = .009, P = .000), whereas AWT had no significant effect on satisfaction (P = .365). The difference between the EWT and AWT had a significant effect on satisfaction (P = .000), while the difference between the PWT and AWT had a significant effect on satisfaction (P = .000). Age, educational background, gender, appointment, and hospital visit experience had no significant effect on patient satisfaction (P = .105, P = .443, P = .260, P = .352, P = .461, respectively). Patient satisfaction with waiting time was not directly affected by AWT, but by subjective waiting times. Furthermore, objective waiting time affects patient satisfaction through the subjective waiting time. Therefore, hospital managers can improve service quality by focusing on adjusting a patient's subjective waiting time while reducing the objective waiting time.
Collapse
Affiliation(s)
- Hui Zhang
- School of Economics and Management, Tongji University, Shanghai, China
| | - Weimin Ma
- School of Economics and Management, Tongji University, Shanghai, China
| | - Shufen Zhou
- School of Management, Shanghai University of Engineering Science, Shanghai, China
| | - Jingjing Zhu
- Scientific Research Department, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, China
| | - Li Wang
- Eye Hospital, Wenzhou Medical University at Hangzhou, Zhejiang Eye Hospital at Hangzhou, Hangzhou, China
| | - Kaixin Gong
- School of Economics and Management, Tongji University, Shanghai, China
| |
Collapse
|
8
|
Zhang H, Ma WM, Zhu JJ, Wang L, Guo ZJ, Chen XT. How to adjust the expected waiting time to improve patient's satisfaction? BMC Health Serv Res 2023; 23:455. [PMID: 37158912 PMCID: PMC10169334 DOI: 10.1186/s12913-023-09385-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 04/10/2023] [Indexed: 05/10/2023] Open
Abstract
BACKGROUND Long waiting time in hospital leads to patient's low satisfaction. In addition to reducing the actual waiting time (AWT), we can also improve satisfaction by adjusting the expected waiting time (EWT). Then how much can the EWT be adjusted to attribute a higher satisfaction? METHODS This study was conducted though experimental with hypothetical scenarios. A total of 303 patients who were treated by the same doctor from August 2021 to April 2022 voluntarily participated in this study. The patients were randomly divided into six groups: a control group (n = 52) and five experimental groups (n = 245). In the control group, the patients were asked their satisfaction degree regarding a communicated EWT (T0) and AWT (Ta) under a hypothetical situation. In the experimental groups, in addition to the same T0 and Ta as the control group, the patients were also asked about their satisfaction degree with the extended communicated EWT (T1). Patients in five experimental groups were given T1 values with 70, 80, 90, 100, and 110 min respectively. Patients in both control and experiment groups were asked to indicate their initial EWT, after given unfavorable information (UI) in a hypothetical situation, the experiment groups were asked to indicate their extended EWT. Each participant only participated in filling out one hypothetical scenario. 297 valid hypothetical scenarios were obtained from the 303 hypothetical scenarios given. RESULTS The experimental groups had significant differences between the initial indicated EWT and extended indicated EWT under the effect of UI (20 [10, 30] vs. 30 [10, 50], Z = -4.086, P < 0.001). There was no significant difference in gender, age, education level and hospital visit history (χ2 = 3.198, P = 0.270; χ2 = 2.177, P = 0.903; χ2 = 3.988, P = 0.678; χ2 = 3.979, P = 0.264) in extended indicated EWT. As for patient's satisfaction, compared with the control group, significant differences were found when T1 = 80 min (χ2 = 13.511, P = 0.004), T1 = 90 min (χ2 = 12.207, P = 0.007) and T1 = 100 min (χ2 = 12.941, P = 0.005). When T1 = 90 min, which is equal to the Ta, 69.4% (34/49) of the patients felt "very satisfied", this proportion is not only significantly higher than that of the control group (34/ 49 vs. 19/52, χ2 = 10.916, P = 0.001), but also the highest among all groups. When T1 = 100 min (10 min longer than Ta), 62.5% (30/48) of the patients felt "very satisfied", it is significantly higher than that of the control group (30/ 48 vs. 19/52, χ2 = 6.732, P = 0.009). When T1 = 80 min (10 min shorter than Ta), 64.8% (35/54) of the patients felt "satisfied", it is significantly higher than that of the control group (35/ 54 vs. 17/52, χ2 = 10.938, P = 0.001). However, no significant difference was found when T1 = 70 min (χ2 = 7.747, P = 0.052) and T1 = 110 min (χ2 = 4.382, P = 0.223). CONCLUSIONS Providing UI prompts can extend the EWT. When the extended EWT is closer to the AWT, the patient's satisfaction level can be improved higher. Therefore, medical institutions can adjust the EWT of patient's through UI release according to the AWT of hospitals to improve patient's satisfaction.
Collapse
Affiliation(s)
- Hui Zhang
- School of Economics and Management, Tongji University, Shanghai, 200092, China
| | - Wei-Min Ma
- School of Economics and Management, Tongji University, Shanghai, 200092, China
| | - Jing-Jing Zhu
- Scientific Research Department, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, 310000, China
| | - Li Wang
- Eye Hospital, Wenzhou Medical University at Hangzhou, Zhejiang Eye Hospital at Hangzhou, Hangzhou, 310000, China.
| | - Zhen-Jie Guo
- Eye Hospital, Wenzhou Medical University at Hangzhou, Zhejiang Eye Hospital at Hangzhou, Hangzhou, 310000, China
| | - Xiang-Tang Chen
- School of Economics and Management, Wenzhou University of Technology, Wenzhou, 325000, China
| |
Collapse
|
9
|
Stature estimation by semi-automatic measurements of 3D CT images of the femur. Int J Legal Med 2023; 137:359-377. [PMID: 36474127 PMCID: PMC9902306 DOI: 10.1007/s00414-022-02921-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 11/15/2022] [Indexed: 12/12/2022]
Abstract
Stature estimation is one of the most basic and important methods of personal identification. The long bones of the limbs provide the most accurate stature estimation, with the femur being one of the most useful. In all the previously reported methods of stature estimation using computed tomography (CT) images of the femur, laborious manual measurement was necessary. A semi-automatic bone measuring method can simplify this process, so we firstly reported a stature estimation process using semi-automatic bone measurement software equipped with artificial intelligence. Multiple measurements of femurs of adult Japanese cadavers were performed using automatic three-dimensional reconstructed CT images of femurs. After manually setting four points on the femur, an automatic measurement was acquired. The relationships between stature and five femoral measurements, with acceptable intraobserver and interobserver errors, were analyzed with single regression analysis using the standard error of the estimate (SEE) and the coefficient of determination (R2). The maximum length of the femur (MLF) provided the lowest SEE and the highest R2; the SEE and R2 in all cadavers, males and females, respectively, were 3.913 cm (R2 = 0.842), 3.664 cm (R2 = 0.705), and 3.456 cm (R2 = 0.686) for MLF on the right femur, and 3.837 cm (R2 = 0.848), 3.667 cm (R2 = 0.705), and 3.384 cm (R2 = 0.699) for MLF on the left femur. These results were non-inferior to those of previous reports regarding stature estimation using the MLF. Stature estimation with this simple and time-saving method would be useful in forensic medical practice.
Collapse
|
10
|
The Association between mHealth App Use and Healthcare Satisfaction among Clients at Outpatient Clinics: A Cross-Sectional Study in Inner Mongolia, China. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19116916. [PMID: 35682498 PMCID: PMC9180655 DOI: 10.3390/ijerph19116916] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 05/31/2022] [Accepted: 06/02/2022] [Indexed: 01/27/2023]
Abstract
Mobile health (mHealth) applications (apps) have been developed in hospital settings to allocate and manage medical care services, which is one of the national strategies to improve health care in China. Little is known about the comprehensive effects of hospital-based mHealth app use on client satisfaction. The aim of this study was to determine the relationship between the full range of mHealth app use and satisfaction domains among clients attending outpatient clinics. A cross-sectional survey was conducted from January to February 2021 in twelve tertiary hospitals in Inner Mongolia. After the construction of the mHealth app use, structural equation modeling was used for data analysis. Of 1889 participants, the standardized coefficients β on environment/convenience, health information, and medical service fees were 0.11 (p < 0.001), 0.06 (p = 0.039), and 0.08 (p = 0.004), respectively. However, app use was not significantly associated with satisfaction of doctor−patient communication (β = 0.05, p = 0.069), short-term outcomes (β = 0.05, p = 0.054), and general satisfaction (β = 0.02, p = 0.429). Clients of the study hospitals were satisfied with the services, but their satisfaction was not much associated with mHealth use. The limitation of the mHealth system should be improved to enhance communication and engagement among clients, doctors, and healthcare givers, as well as to pay more attention to health outcomes and satisfaction of clients.
Collapse
|
11
|
Li X, Tian D, Li W, Hu Y, Dong B, Wang H, Yuan J, Li B, Mei H, Tong S, Zhao L, Liu S. Using artificial intelligence to reduce queuing time and improve satisfaction in pediatric outpatient service: A randomized clinical trial. Front Pediatr 2022; 10:929834. [PMID: 36034568 PMCID: PMC9399636 DOI: 10.3389/fped.2022.929834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Accepted: 07/25/2022] [Indexed: 11/13/2022] Open
Abstract
INTRODUCTION Complicated outpatient procedures are associated with excessive paperwork and long waiting times. We aimed to shorten queuing times and improve visiting satisfaction. METHODS We developed an artificial intelligence (AI)-assisted program named Smart-doctor. A randomized controlled trial was conducted at Shanghai Children's Medical Center. Participants were randomly divided into an AI-assisted and conventional group. Smart-doctor was used as a medical assistant in the AI-assisted group. At the end of the visit, an e-medical satisfaction questionnaire was asked to be done. The primary outcome was the queuing time, while secondary outcomes included the consulting time, test time, total time, and satisfaction score. Wilcoxon rank sum test, multiple linear regression and ordinal regression were also used. RESULTS We enrolled 740 eligible patients (114 withdrew, response rate: 84.59%). The median queuing time was 8.78 (interquartile range [IQR] 3.97,33.88) minutes for the AI-assisted group versus 21.81 (IQR 6.66,73.10) minutes for the conventional group (p < 0.01), and the AI-assisted group had a shorter consulting time (0.35 [IQR 0.18, 0.99] vs. 2.68 [IQR 1.82, 3.80] minutes, p < 0.01), and total time (40.20 [IQR 26.40, 73.80] vs. 110.40 [IQR 68.40, 164.40] minutes, p < 0.01). The overall satisfaction score was increased by 17.53% (p < 0.01) in the AI-assisted group. In addition, multiple linear regression and ordinal regression showed that the queuing time and satisfaction were mainly affected by group (p < 0.01), and missing the turn (p < 0.01). CONCLUSIONS Using AI to simplify the outpatient service procedure can shorten the queuing time of patients and improve visit satisfaction.
Collapse
Affiliation(s)
- Xiaoqing Li
- School of Medicine, Shanghai Children's Medical Center, Child Health Advocacy Institute, Shanghai Jiao Tong University, Shanghai, China.,School of Public Health, Shanghai Jiao Tong University, Shanghai, China
| | - Dan Tian
- Division of Hospital Management, Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.,Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Shanghai Engineering Research Center of Intelligence Pediatrics (SERCIP), Shanghai, China
| | - Weihua Li
- Division of Hospital Management, Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.,Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Shanghai Engineering Research Center of Intelligence Pediatrics (SERCIP), Shanghai, China
| | - Yabin Hu
- School of Medicine, Shanghai Children's Medical Center, Child Health Advocacy Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Bin Dong
- Division of Hospital Management, Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.,Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Shanghai Engineering Research Center of Intelligence Pediatrics (SERCIP), Shanghai, China
| | - Hansong Wang
- Division of Hospital Management, Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.,Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Shanghai Engineering Research Center of Intelligence Pediatrics (SERCIP), Shanghai, China
| | - Jiajun Yuan
- Division of Hospital Management, Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.,Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Shanghai Engineering Research Center of Intelligence Pediatrics (SERCIP), Shanghai, China
| | - Biru Li
- Department of Pediatric Internal Medicine, Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Hao Mei
- School of Medicine, Shanghai Children's Medical Center, Child Health Advocacy Institute, Shanghai Jiao Tong University, Shanghai, China.,Department of Data Science, School of Population Health, University of Mississippi Medical Center, Jackson, MS, United States
| | - Shilu Tong
- School of Medicine, Shanghai Children's Medical Center, Child Health Advocacy Institute, Shanghai Jiao Tong University, Shanghai, China.,School of Public Health and Social Work, Institute of Health and Biomedical Innovation, Queensland University of Technology, Brisbane, QLD, Australia
| | - Liebin Zhao
- Shanghai Engineering Research Center of Intelligence Pediatrics (SERCIP), Shanghai, China
| | - Shijian Liu
- School of Medicine, Shanghai Children's Medical Center, Child Health Advocacy Institute, Shanghai Jiao Tong University, Shanghai, China.,School of Public Health, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
12
|
Prediction across healthcare settings: a case study in predicting emergency department disposition. NPJ Digit Med 2021; 4:169. [PMID: 34912043 PMCID: PMC8674364 DOI: 10.1038/s41746-021-00537-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 10/19/2021] [Indexed: 12/24/2022] Open
Abstract
Several approaches exist today for developing predictive models across multiple clinical sites, yet there is a lack of comparative data on their performance, especially within the context of EHR-based prediction models. We set out to provide a framework for prediction across healthcare settings. As a case study, we examined an ED disposition prediction model across three geographically and demographically diverse sites. We conducted a 1-year retrospective study, including all visits in which the outcome was either discharge-to-home or hospitalization. Four modeling approaches were compared: a ready-made model trained at one site and validated at other sites, a centralized uniform model incorporating data from all sites, multiple site-specific models, and a hybrid approach of a ready-made model re-calibrated using site-specific data. Predictions were performed using XGBoost. The study included 288,962 visits with an overall admission rate of 16.8% (7.9–26.9%). Some risk factors for admission were prominent across all sites (e.g., high-acuity triage emergency severity index score, high prior admissions rate), while others were prominent at only some sites (multiple lab tests ordered at the pediatric sites, early use of ECG at the adult site). The XGBoost model achieved its best performance using the uniform and site-specific approaches (AUC = 0.9–0.93), followed by the calibrated-model approach (AUC = 0.87–0.92), and the ready-made approach (AUC = 0.62–0.85). Our results show that site-specific customization is a key driver of predictive model performance.
Collapse
|