1
|
Hughes JA, Wu Y, Jones L, Douglas C, Brown N, Hazelwood S, Lyrstedt AL, Jarugula R, Chu K, Nguyen A. Analyzing pain patterns in the emergency department: Leveraging clinical text deep learning models for real-world insights. Int J Med Inform 2024; 190:105544. [PMID: 39003790 DOI: 10.1016/j.ijmedinf.2024.105544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Revised: 06/09/2024] [Accepted: 07/06/2024] [Indexed: 07/16/2024]
Abstract
OBJECTIVE To determine the incidence of patients presenting in pain to a large Australian inner-city emergency department (ED) using a clinical text deep learning algorithm. MATERIALS AND METHODS A fine-tuned, domain-specific, transformer-based clinical text deep learning model was used to interpret free-text nursing assessments in the electronic medical records of 235,789 adult presentations to the ED over a three-year period. The model classified presentations according to whether the patient had pain on arrival at the ED. Interrupted time series analysis was used to determine the incidence of pain in patients on arrival over time. We described the changes in the population characteristics and incidence of patients with pain on arrival occurring with the start of the Covid-19 pandemic. RESULTS 55.16% (95%CI 54.95%-55.36%) of all patients presenting to this ED had pain on arrival. There were differences in demographics and arrival and departure patterns between patients with and without pain. The Covid-19 pandemic initially precipitated a decrease followed by a sharp, sustained rise in pain on arrival, with concurrent changes to the population arriving in pain and their treatment. DISCUSSION Applying a clinical text deep learning model has successfully identified the incidence of pain on arrival. It represents an automated, reproducible mechanism to identify pain from routinely collected medical records. The description of this population and their treatment forms the basis of intervention to improve care for patients with pain. The combination of the clinical text deep learning models and interrupted time series analysis has reported on the effects of the Covid-19 pandemic on pain care in the ED, outlining a methodology to assess the impact of significant events or interventions on pain care in the ED. CONCLUSION Applying a novel deep learning approach to identifying pain guides methodological approaches to evaluating pain care interventions in the ED, giving previously unavailable population-level insights.
Collapse
Affiliation(s)
- James A Hughes
- School of Nursing, Queensland University of Technology, Brisbane, Australia; Emergency and Trauma Centre, Royal Brisbane and Women's Hospital, Brisbane, Australia.
| | - Yutong Wu
- Australian e-Health Research Centre, CSIRO, Brisbane, Australia
| | - Lee Jones
- QIMR-Berghoffer Research Institute, Brisbane, Australia
| | - Clint Douglas
- School of Nursing, Queensland University of Technology, Brisbane, Australia; Metro North Health, Queensland, Australia
| | - Nathan Brown
- Emergency and Trauma Centre, Royal Brisbane and Women's Hospital, Brisbane, Australia; Faculty of Medicine, University of Queensland, Brisbane, Australia
| | - Sarah Hazelwood
- Emergency Department, The Prince Charles Hospital, Queensland, Australia
| | - Anna-Lisa Lyrstedt
- School of Nursing, Queensland University of Technology, Brisbane, Australia; Emergency and Trauma Centre, Royal Brisbane and Women's Hospital, Brisbane, Australia
| | - Rajeev Jarugula
- Emergency Department, The Prince Charles Hospital, Queensland, Australia
| | - Kevin Chu
- Emergency and Trauma Centre, Royal Brisbane and Women's Hospital, Brisbane, Australia; Faculty of Medicine, University of Queensland, Brisbane, Australia
| | - Anthony Nguyen
- Australian e-Health Research Centre, CSIRO, Brisbane, Australia
| |
Collapse
|
2
|
Garrido NJ, González-Martínez F, Losada S, Plaza A, del Olmo E, Mateo J. Innovation through Artificial Intelligence in Triage Systems for Resource Optimization in Future Pandemics. Biomimetics (Basel) 2024; 9:440. [PMID: 39056881 PMCID: PMC11274710 DOI: 10.3390/biomimetics9070440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Revised: 07/12/2024] [Accepted: 07/16/2024] [Indexed: 07/28/2024] Open
Abstract
Artificial intelligence (AI) systems are already being used in various healthcare areas. Similarly, they can offer many advantages in hospital emergency services. The objective of this work is to demonstrate that through the novel use of AI, a trained system can be developed to detect patients at potential risk of infection in a new pandemic more quickly than standardized triage systems. This identification would occur in the emergency department, thus allowing for the early implementation of organizational preventive measures to block the chain of transmission. MATERIALS AND METHODS In this study, we propose the use of a machine learning system in emergency department triage during pandemics to detect patients at the highest risk of death and infection using the COVID-19 era as an example, where rapid decision making and comprehensive support have becoming increasingly crucial. All patients who consecutively presented to the emergency department were included, and more than 89 variables were automatically analyzed using the extreme gradient boosting (XGB) algorithm. RESULTS The XGB system demonstrated the highest balanced accuracy at 91.61%. Additionally, it obtained results more quickly than traditional triage systems. The variables that most influenced mortality prediction were procalcitonin level, age, and oxygen saturation, followed by lactate dehydrogenase (LDH) level, C-reactive protein, the presence of interstitial infiltrates on chest X-ray, and D-dimer. Our system also identified the importance of oxygen therapy in these patients. CONCLUSIONS These results highlight that XGB is a useful and novel tool in triage systems for guiding the care pathway in future pandemics, thus following the example set by the well-known COVID-19 pandemic.
Collapse
Affiliation(s)
- Nicolás J. Garrido
- Internal Medicine, Virgen de la Luz Hospital, 16002 Cuenca, Spain
- Expert Medical Analysis Group, Institute of Technology, University of Castilla-La Mancha, 16071 Cuenca, Spain
| | - Félix González-Martínez
- Expert Medical Analysis Group, Institute of Technology, University of Castilla-La Mancha, 16071 Cuenca, Spain
- Department of Emergency Medicine, Virgen de la Luz Hospital, 16002 Cuenca, Spain
- Expert Medical Analysis Group, Instituto de Investigación Sanitaria de Castilla-La Mancha (IDISCAM), 45071 Toledo, Spain
| | - Susana Losada
- Department of Emergency Medicine, Virgen de la Luz Hospital, 16002 Cuenca, Spain
| | - Adrián Plaza
- Department of Emergency Medicine, Virgen de la Luz Hospital, 16002 Cuenca, Spain
| | - Eneida del Olmo
- Department of Emergency Medicine, Virgen de la Luz Hospital, 16002 Cuenca, Spain
| | - Jorge Mateo
- Expert Medical Analysis Group, Institute of Technology, University of Castilla-La Mancha, 16071 Cuenca, Spain
- Expert Medical Analysis Group, Instituto de Investigación Sanitaria de Castilla-La Mancha (IDISCAM), 45071 Toledo, Spain
| |
Collapse
|
3
|
Park S, Yoo J, Lee Y, DeGuzman PB, Kang MJ, Dykes PC, Shin SY, Cha WC. Quantifying emergency department nursing workload at the task level using NASA-TLX: An exploratory descriptive study. Int Emerg Nurs 2024; 74:101424. [PMID: 38531213 DOI: 10.1016/j.ienj.2024.101424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 01/20/2024] [Accepted: 02/14/2024] [Indexed: 03/28/2024]
Abstract
BACKGROUND Emergency departments (ED) nurses experience high mental workloads because of unpredictable work environments; however, research evaluating ED nursing workload using a tool incorporating nurses' perception is lacking. Quantify ED nursing subjective workload and explore the impact of work experience on perceived workload. METHODS Thirty-two ED nurses at a tertiary academic hospital in the Republic of Korea were surveyed to assess their subjective workload for ED procedures using the National Aeronautics and Space Administration Task Load Index (NASA-TLX). Nonparametric statistical analysis was performed to describe the data, and linear regression analysis was conducted to estimate the impact of work experience on perceived workload. RESULTS Cardiopulmonary resuscitation (CPR) had the highest median workload, followed by interruption from a patient and their family members. Although inexperienced nurses perceived the 'special care' procedures (CPR and defibrillation) as more challenging compared with other categories, analysis revealed that nurses with more than 107 months of experience reported a significantly higher workload than those with less than 36 months of experience. CONCLUSION Addressing interruptions and customizing training can alleviate ED nursing workload. Quantified perceived workload is useful for identifying acceptable thresholds to maintain optimal workload, which ultimately contributes to predicting nursing staffing needs and ED crowding.
Collapse
Affiliation(s)
- Sookyung Park
- School of Nursing, University of Virginia, 225 Jeanette Lancaster Way, Charlottesville, VA 22903-3388, USA
| | - Junsang Yoo
- Department of Digital Health, Samsung Advanced Institute for Health Science & Technology (SAIHST), Sungkyunkwan University, 115 Irwon-ro Gangnam-gu, Seoul 06355, Republic of Korea
| | - Yerim Lee
- Department of Digital Health, Samsung Advanced Institute for Health Science & Technology (SAIHST), Sungkyunkwan University, 115 Irwon-ro Gangnam-gu, Seoul 06355, Republic of Korea
| | - Pamela Baker DeGuzman
- School of Nursing, University of Virginia, 225 Jeanette Lancaster Way, Charlottesville, VA 22903-3388, USA
| | - Min-Jeoung Kang
- Harvard Medical School, 25 Shattuck Street, Boston MA 02115, MA, USA; Department of Medicine, Division of General Internal Medicine and Primay Care, Brigham and Women's Hospital, 1620 Tremont Street, MA, USA
| | - Patricia C Dykes
- Harvard Medical School, 25 Shattuck Street, Boston MA 02115, MA, USA; Department of Medicine, Division of General Internal Medicine and Primay Care, Brigham and Women's Hospital, 1620 Tremont Street, MA, USA
| | - So Yeon Shin
- Department of Nursing, Samsung Medical Center, 81 Irwon-ro Gangnam-gu, Seoul 06351, Republic of Korea
| | - Won Chul Cha
- Department of Digital Health, Samsung Advanced Institute for Health Science & Technology (SAIHST), Sungkyunkwan University, 115 Irwon-ro Gangnam-gu, Seoul 06355, Republic of Korea; Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul 06355, Republic of Korea; Digital Innovation Center, Samsung Medical Center, 81 Irwon-ro Gangnam-gu, Seoul 06351, Republic of Korea.
| |
Collapse
|
4
|
Alrawashdeh A, Alqahtani S, Alkhatib ZI, Kheirallah K, Melhem NY, Alwidyan M, Al-Dekah AM, Alshammari T, Nehme Z. Applications and Performance of Machine Learning Algorithms in Emergency Medical Services: A Scoping Review. Prehosp Disaster Med 2024:1-11. [PMID: 38757150 DOI: 10.1017/s1049023x24000414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/18/2024]
Abstract
OBJECTIVE The aim of this study was to summarize the literature on the applications of machine learning (ML) and their performance in Emergency Medical Services (EMS). METHODS Four relevant electronic databases were searched (from inception through January 2024) for all original studies that employed EMS-guided ML algorithms to enhance the clinical and operational performance of EMS. Two reviewers screened the retrieved studies and extracted relevant data from the included studies. The characteristics of included studies, employed ML algorithms, and their performance were quantitively described across primary domains and subdomains. RESULTS This review included a total of 164 studies published from 2005 through 2024. Of those, 125 were clinical domain focused and 39 were operational. The characteristics of ML algorithms such as sample size, number and type of input features, and performance varied between and within domains and subdomains of applications. Clinical applications of ML algorithms involved triage or diagnosis classification (n = 62), treatment prediction (n = 12), or clinical outcome prediction (n = 50), mainly for out-of-hospital cardiac arrest/OHCA (n = 62), cardiovascular diseases/CVDs (n = 19), and trauma (n = 24). The performance of these ML algorithms varied, with a median area under the receiver operating characteristic curve (AUC) of 85.6%, accuracy of 88.1%, sensitivity of 86.05%, and specificity of 86.5%. Within the operational studies, the operational task of most ML algorithms was ambulance allocation (n = 21), followed by ambulance detection (n = 5), ambulance deployment (n = 5), route optimization (n = 5), and quality assurance (n = 3). The performance of all operational ML algorithms varied and had a median AUC of 96.1%, accuracy of 90.0%, sensitivity of 94.4%, and specificity of 87.7%. Generally, neural network and ensemble algorithms, to some degree, out-performed other ML algorithms. CONCLUSION Triaging and managing different prehospital medical conditions and augmenting ambulance performance can be improved by ML algorithms. Future reports should focus on a specific clinical condition or operational task to improve the precision of the performance metrics of ML models.
Collapse
Affiliation(s)
- Ahmad Alrawashdeh
- Department of Allied Medical Sciences, Jordan University of Science and Technology, Irbid, Jordan
| | - Saeed Alqahtani
- Department of Emergency Medical Services, Prince Sultan Military College for Health Sciences, Dhahran, Saudi Arabia
| | - Zaid I Alkhatib
- Department of Allied Medical Sciences, Jordan University of Science and Technology, Irbid, Jordan
| | - Khalid Kheirallah
- Department of Public Health and Family Medicine, Faculty of Medicine, Jordan University of Science and Technology, Irbid, Jordan
| | - Nebras Y Melhem
- Department of Anatomy, Physiology and Biochemistry, Faculty of Medicine, The Hashemite University, Zarqa, Jordan
| | - Mahmoud Alwidyan
- Department of Allied Medical Sciences, Jordan University of Science and Technology, Irbid, Jordan
| | | | - Talal Alshammari
- Department of Emergency Medical Care, College of Applied Medical Sciences, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Ziad Nehme
- Ambulance Victoria, Doncaster, Victoria, Australia
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| |
Collapse
|
5
|
Jovanovic L, Damaševičius R, Matic R, Kabiljo M, Simic V, Kunjadic G, Antonijevic M, Zivkovic M, Bacanin N. Detecting Parkinson's disease from shoe-mounted accelerometer sensors using convolutional neural networks optimized with modified metaheuristics. PeerJ Comput Sci 2024; 10:e2031. [PMID: 38855236 PMCID: PMC11157549 DOI: 10.7717/peerj-cs.2031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 04/09/2024] [Indexed: 06/11/2024]
Abstract
Neurodegenerative conditions significantly impact patient quality of life. Many conditions do not have a cure, but with appropriate and timely treatment the advance of the disease could be diminished. However, many patients only seek a diagnosis once the condition progresses to a point at which the quality of life is significantly impacted. Effective non-invasive and readily accessible methods for early diagnosis can considerably enhance the quality of life of patients affected by neurodegenerative conditions. This work explores the potential of convolutional neural networks (CNNs) for patient gain freezing associated with Parkinson's disease. Sensor data collected from wearable gyroscopes located at the sole of the patient's shoe record walking patterns. These patterns are further analyzed using convolutional networks to accurately detect abnormal walking patterns. The suggested method is assessed on a public real-world dataset collected from parents affected by Parkinson's as well as individuals from a control group. To improve the accuracy of the classification, an altered variant of the recent crayfish optimization algorithm is introduced and compared to contemporary optimization metaheuristics. Our findings reveal that the modified algorithm (MSCHO) significantly outperforms other methods in accuracy, demonstrated by low error rates and high Cohen's Kappa, precision, sensitivity, and F1-measures across three datasets. These results suggest the potential of CNNs, combined with advanced optimization techniques, for early, non-invasive diagnosis of neurodegenerative conditions, offering a path to improve patient quality of life.
Collapse
Affiliation(s)
- Luka Jovanovic
- Faculty of Technical Sciences, Singidunum University, Belgrade, Serbia
| | | | - Rade Matic
- Department for Information Systems and Technologies, Belgrade Academy for Business and Arts Applied Studies, Belgrade, Serbia
| | - Milos Kabiljo
- Department for Information Systems and Technologies, Belgrade Academy for Business and Arts Applied Studies, Belgrade, Serbia
| | - Vladimir Simic
- Faculty of Transport and Traffic Engineering, University of Belgrade, Belgrade, Serbia
- College of Engineering, Department of Industrial Engineering and Management, Yuan Ze University, Taoyuan City, Taiwan
| | - Goran Kunjadic
- Higher Colleges of Technology, Abu Dhabi, United Arab Emirates
| | - Milos Antonijevic
- Faculty of Informatics and Computing, Singidunum University, Belgrade, Serbia
| | - Miodrag Zivkovic
- Faculty of Informatics and Computing, Singidunum University, Belgrade, Serbia
| | - Nebojsa Bacanin
- Faculty of Informatics and Computing, Singidunum University, Belgrade, Serbia
- MEU Research Unit, Middle East University, Amman, Jordan
| |
Collapse
|
6
|
Tyler S, Olis M, Aust N, Patel L, Simon L, Triantafyllidis C, Patel V, Lee DW, Ginsberg B, Ahmad H, Jacobs RJ. Use of Artificial Intelligence in Triage in Hospital Emergency Departments: A Scoping Review. Cureus 2024; 16:e59906. [PMID: 38854295 PMCID: PMC11158416 DOI: 10.7759/cureus.59906] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 05/08/2024] [Indexed: 06/11/2024] Open
Abstract
The integration of artificial intelligence (AI) and machine learning (ML) in healthcare has become a major point of interest and raises the question of its impact on the emergency department (ED) triaging process. AI's capacity to emulate human cognitive processes coupled with advancements in computing has shown positive outcomes in various aspects of healthcare but little is known about the use of AI in triaging patients in ED. AI algorithms may allow for earlier diagnosis and intervention; however, overconfident answers may present dangers to patients. The purpose of this review was to explore comprehensively recently published literature regarding the effect of AI and ML in ED triage and identify research gaps. A systemized search was conducted in September 2023 using the electronic databases EMBASE, Ovid MEDLINE, and Web of Science. To meet inclusion criteria, articles had to be peer-reviewed, written in English, and based on primary data research studies published in US journals 2013-2023. Other criteria included 1) studies with patients needing to be admitted to hospital EDs, 2) AI must have been used when triaging a patient, and 3) patient outcomes must be represented. The search was conducted using controlled descriptors from the Medical Subject Headings (MeSH) that included the terms "artificial intelligence" OR "machine learning" AND "emergency ward" OR "emergency care" OR "emergency department" OR "emergency room" AND "patient triage" OR "triage" OR "triaging." The search initially identified 1,142 citations. After a rigorous, systemized screening process and critical appraisal of the evidence, 29 studies were selected for the final review. The findings indicated that 1) ML models consistently demonstrated superior discrimination abilities compared to conventional triage systems, 2) the integration of AI into the triage process yielded significant enhancements in predictive accuracy, disease identification, and risk assessment, 3) ML accurately determined the necessity of hospitalization for patients requiring urgent attention, and 4) ML improved resource allocation and quality of patient care, including predicting length of stay. The suggested superiority of ML models in prioritizing patients in the ED holds the potential to redefine triage precision.
Collapse
Affiliation(s)
- Samantha Tyler
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Matthew Olis
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Nicole Aust
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Love Patel
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Leah Simon
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Catherine Triantafyllidis
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Vijay Patel
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Dong Won Lee
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Brendan Ginsberg
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Hiba Ahmad
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Robin J Jacobs
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| |
Collapse
|
7
|
Ahmadzadeh B, Patey C, Hurley O, Knight J, Norman P, Farrell A, Czarnuch S, Asghari S. Applications of Artificial Intelligence in Emergency Departments to Improve Wait Times: Protocol for an Integrative Living Review. JMIR Res Protoc 2024; 13:e52612. [PMID: 38607662 PMCID: PMC11053385 DOI: 10.2196/52612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 02/14/2024] [Accepted: 03/01/2024] [Indexed: 04/13/2024] Open
Abstract
BACKGROUND Long wait times in the emergency department (ED) are a major issue for health care systems all over the world. The application of artificial intelligence (AI) is a novel strategy to reduce ED wait times when compared to the interventions included in previous research endeavors. To date, comprehensive systematic reviews that include studies involving AI applications in the context of EDs have covered a wide range of AI implementation issues. However, the lack of an iterative update strategy limits the use of these reviews. Since the subject of AI development is cutting edge and is continuously changing, reviews in this area must be frequently updated to remain relevant. OBJECTIVE This study aims to provide a summary of the evidence that is currently available regarding how AI can affect ED wait times; discuss the applications of AI in improving wait times; and periodically assess the depth, breadth, and quality of the evidence supporting the application of AI in reducing ED wait times. METHODS We plan to conduct a living systematic review (LSR). Our strategy involves conducting continuous monitoring of evidence, with biannual search updates and annual review updates. Upon completing the initial round of the review, we will refine the search strategy and establish clear schedules for updating the LSR. An interpretive synthesis using Whittemore and Knafl's framework will be performed to compile and summarize the findings. The review will be carried out using an integrated knowledge translation strategy, and knowledge users will be involved at all stages of the review to guarantee applicability, usability, and clarity of purpose. RESULTS The literature search was completed by September 22, 2023, and identified 17,569 articles. The title and abstract screening were completed by December 9, 2023. In total, 70 papers were eligible. The full-text screening is in progress. CONCLUSIONS The review will summarize AI applications that improve ED wait time. The LSR enables researchers to maintain high methodological rigor while enhancing the timeliness, applicability, and value of the review. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/52612.
Collapse
Affiliation(s)
- Bahareh Ahmadzadeh
- Centre for Rural Health Studies, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Christopher Patey
- Eastern Health, Carbonear Institute for Rural Reach and Innovation by the Sea, Carbonear General Hospital, Carbonear, NL, Canada
- Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Oliver Hurley
- Centre for Rural Health Studies, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - John Knight
- Data and Information Services, Digital Health, NL Health Services, St. John's, NL, Canada
- Division of Community Health and Humanities, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Paul Norman
- Eastern Health, Carbonear Institute for Rural Reach and Innovation by the Sea, Carbonear General Hospital, Carbonear, NL, Canada
| | - Alison Farrell
- Health Sciences Library, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Stephen Czarnuch
- Department of Electrical and Computer Engineering, Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John's, NL, Canada
- Discipline of Emergency Medicine, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Shabnam Asghari
- Centre for Rural Health Studies, Faculty of Medicine, Memorial University of Newfoundland, St. John's, NL, Canada
| |
Collapse
|
8
|
Cohen I, Sorin V, Lekach R, Raskin D, Segev M, Klang E, Eshed I, Barash Y. Artificial intelligence for detection of effusion and lipo-hemarthrosis in X-rays and CT of the knee. Eur J Radiol 2024; 175:111460. [PMID: 38608501 DOI: 10.1016/j.ejrad.2024.111460] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 03/29/2024] [Accepted: 04/08/2024] [Indexed: 04/14/2024]
Abstract
BACKGROUND Traumatic knee injuries are challenging to diagnose accurately through radiography and to a lesser extent, through CT, with fractures sometimes overlooked. Ancillary signs like joint effusion or lipo-hemarthrosis are indicative of fractures, suggesting the need for further imaging. Artificial Intelligence (AI) can automate image analysis, improving diagnostic accuracy and help prioritizing clinically important X-ray or CT studies. OBJECTIVE To develop and evaluate an AI algorithm for detecting effusion of any kind in knee X-rays and selected CT images and distinguishing between simple effusion and lipo-hemarthrosis indicative of intra-articular fractures. METHODS This retrospective study analyzed post traumatic knee imaging from January 2016 to February 2023, categorizing images into lipo-hemarthrosis, simple effusion, or normal. It utilized the FishNet-150 algorithm for image classification, with class activation maps highlighting decision-influential regions. The AI's diagnostic accuracy was validated against a gold standard, based on the evaluations made by a radiologist with at least four years of experience. RESULTS Analysis included CT images from 515 patients and X-rays from 637 post traumatic patients, identifying lipo-hemarthrosis, simple effusion, and normal findings. The AI showed an AUC of 0.81 for detecting any effusion, 0.78 for simple effusion, and 0.83 for lipo-hemarthrosis in X-rays; and 0.89, 0.89, and 0.91, respectively, in CTs. CONCLUSION The AI algorithm effectively detects knee effusion and differentiates between simple effusion and lipo-hemarthrosis in post-traumatic patients for both X-rays and selected CT images further studies are needed to validate these results.
Collapse
Affiliation(s)
- Israel Cohen
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Vera Sorin
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Ruth Lekach
- Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Nuclear Medicine, Sourasky Medical Center, Tel-Aviv, Israel.
| | - Daniel Raskin
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Maria Segev
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Eyal Klang
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Iris Eshed
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Yiftach Barash
- Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| |
Collapse
|
9
|
Piliuk K, Tomforde S. Artificial intelligence in emergency medicine. A systematic literature review. Int J Med Inform 2023; 180:105274. [PMID: 37944275 DOI: 10.1016/j.ijmedinf.2023.105274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 10/21/2023] [Accepted: 10/26/2023] [Indexed: 11/12/2023]
Abstract
Motivation and objective: Emergency medicine is becoming a popular application area for artificial intelligence methods but remains less investigated than other healthcare branches. The need for time-sensitive decision-making on the basis of high data volumes makes the use of quantitative technologies inevitable. However, the specifics of healthcare regulations impose strict requirements for such applications. Published contributions cover separate parts of emergency medicine and use disparate data and algorithms. This study aims to systematize the relevant contributions, investigate the main obstacles to artificial intelligence applications in emergency medicine, and propose directions for further studies. METHODS The contributions selection process was conducted with systematic electronic databases querying and filtering with respect to established exclusion criteria. Among the 380 papers gathered from IEEE Xplore, ACM Digital Library, Springer Library, ScienceDirect, and Nature databases 116 were considered to be a part of the survey. The main features of the selected papers are the focus on emergency medicine and the use of machine learning or deep learning algorithms. FINDINGS AND DISCUSSION The selected papers were classified into two branches: diagnostics-specific and triage-specific. The former ones are focused on either diagnosis prediction or decision support. The latter covers such applications as mortality, outcome, admission prediction, condition severity estimation, and urgent care prediction. The observed contributions are highly specialized within a single disease or medical operation and often use privately collected retrospective data, making them incomparable. These and other issues can be addressed by creating an end-to-end solution based on human-machine interaction. CONCLUSION Artificial intelligence applications are finding their place in emergency medicine, while most of the corresponding studies remain isolated and lack higher generalization and more sophisticated methodology, which can be a matter of forthcoming improvements.
Collapse
Affiliation(s)
| | - Sven Tomforde
- Christian-Albrechts-Universität zu Kiel, 24118 Kiel, Germany
| |
Collapse
|
10
|
Gan RK, Uddin H, Gan AZ, Yew YY, González PA. ChatGPT's performance before and after teaching in mass casualty incident triage. Sci Rep 2023; 13:20350. [PMID: 37989755 PMCID: PMC10663620 DOI: 10.1038/s41598-023-46986-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Accepted: 11/07/2023] [Indexed: 11/23/2023] Open
Abstract
Since its initial launching, ChatGPT has gained significant attention from the media, with many claiming that ChatGPT's arrival is a transformative milestone in the advancement of the AI revolution. Our aim was to assess the performance of ChatGPT before and after teaching the triage of mass casualty incidents by utilizing a validated questionnaire specifically designed for such scenarios. In addition, we compared the triage performance between ChatGPT and medical students. Our cross-sectional study employed a mixed-methods analysis to assess the performance of ChatGPT in mass casualty incident triage, pre- and post-teaching of Simple Triage And Rapid Treatment (START) triage. After teaching the START triage algorithm, ChatGPT scored an overall triage accuracy of 80%, with only 20% of cases being over-triaged. The mean accuracy of medical students on the same questionnaire yielded 64.3%. Qualitative analysis on pre-determined themes on 'walking-wounded', 'respiration', 'perfusion', and 'mental status' on ChatGPT showed similar performance in pre- and post-teaching of START triage. Additional themes on 'disclaimer', 'prediction', 'management plan', and 'assumption' were identified during the thematic analysis. ChatGPT exhibited promising results in effectively responding to mass casualty incident questionnaires. Nevertheless, additional research is necessary to ensure its safety and efficacy before clinical implementation.
Collapse
Affiliation(s)
- Rick Kye Gan
- Unit for Research in Emergency and Disaster, Faculty of Medicine and Health Sciences, University of Oviedo, 33006, Oviedo, Spain
| | - Helal Uddin
- Unit for Research in Emergency and Disaster, Faculty of Medicine and Health Sciences, University of Oviedo, 33006, Oviedo, Spain.
- Department of Global Public Health, Karolinska Institute, 17177, Solna, Sweden.
- Department of Sociology, East West University, Dhaka, 1212, Bangladesh.
| | - Ann Zee Gan
- Tenghilan Health Clinic, 89208, Tuaran, Sabah, Malaysia
| | - Ying Ying Yew
- Unit for Research in Emergency and Disaster, Faculty of Medicine and Health Sciences, University of Oviedo, 33006, Oviedo, Spain
| | - Pedro Arcos González
- Unit for Research in Emergency and Disaster, Faculty of Medicine and Health Sciences, University of Oviedo, 33006, Oviedo, Spain
| |
Collapse
|
11
|
Leonard F, O’Sullivan D, Gilligan J, O’Shea N, Barrett MJ. Supporting clinical decision making in the emergency department for paediatric patients using machine learning: A scoping review protocol. PLoS One 2023; 18:e0294231. [PMID: 37972029 PMCID: PMC10653406 DOI: 10.1371/journal.pone.0294231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 10/28/2023] [Indexed: 11/19/2023] Open
Abstract
INTRODUCTION Machine learning as a clinical decision support system tool has the potential to assist clinicians who must make complex and accurate medical decisions in fast paced environments such as the emergency department. This paper presents a protocol for a scoping review, with the objective of summarising the existing research on machine learning clinical decision support system tools in the emergency department, focusing on models that can be used for paediatric patients, where a knowledge gap exists. MATERIALS AND METHODS The methodology used will follow the scoping study framework of Arksey and O'Malley, along with other guidelines. Machine learning clinical decision support system tools for any outcome and population (paediatric/adult/mixed) for use in the emergency department will be included. Articles such as grey literature, letters, pre-prints, editorials, scoping/literature/narrative reviews, non-English full text papers, protocols, surveys, abstract or full text not available and models based on synthesised data will be excluded. Articles from the last five years will be included. Four databases will be searched: Medline (EBSCO), CINAHL (EBSCO), EMBASE and Cochrane Central. Independent reviewers will perform the screening in two sequential stages (stage 1: clinician expertise and stage 2: computer science expertise), disagreements will be resolved by discussion. Data relevant to the research question will be collected. Quantitative analysis will be performed to generate the results. DISCUSSION The study results will summarise the existing research on machine learning clinical decision support tools in the emergency department, focusing on models that can be used for paediatric patients. This holds the promise to identify opportunities to both incorporate models in clinical practice and to develop future models by utilising reviewers from diverse backgrounds and relevant expertise.
Collapse
Affiliation(s)
- Fiona Leonard
- School of Computer Science, Technological University Dublin, Dublin, Ireland
- Digital Health Department, Children’s Health Ireland, Crumlin, Dublin, Ireland
| | - Dympna O’Sullivan
- School of Computer Science, Technological University Dublin, Dublin, Ireland
| | - John Gilligan
- School of Computer Science, Technological University Dublin, Dublin, Ireland
| | - Nicola O’Shea
- Library and Information Service, Children’s Health Ireland at Crumlin, Dublin, Ireland
| | - Michael J. Barrett
- Department of Paediatric Emergency Medicine, Children’s Health Ireland at Crumlin, Dublin, Ireland
- Women’s and Children’s Health, School of Medicine, University College Dublin, Dublin, Ireland
| |
Collapse
|
12
|
Vântu A, Vasilescu A, Băicoianu A. Medical emergency department triage data processing using a machine-learning solution. Heliyon 2023; 9:e18402. [PMID: 37576318 PMCID: PMC10412878 DOI: 10.1016/j.heliyon.2023.e18402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 07/17/2023] [Accepted: 07/17/2023] [Indexed: 08/15/2023] Open
Abstract
Over the years, artificial intelligence has demonstrated its ability to overcome many challenges in our day-to-day life. The evolution of it inquired more studies about Machine Learning possible solutions for different domains, including health care. The increasing demand for artificial intelligence solutions has brought accessibility to loads of data, including clinical data. The availability of medical records facilitates new opportunities to explore Machine Learning models and their abilities to process a significant amount of data and to identify patterns with the purpose of solving a medical problem. Understanding the applicability of artificial intelligence on this type of data has to be a compelling aim for emergency medicine clinicians. This paper focuses on the general clinical problem of the complex correlation between medical records and later diagnosis and, especially, on the process of emergency department triage which uses the Emergency Severity Index (ESI) as triage protocol. This study presents a comparison between three different Machine Learning models, such as Logistic Regression, Random Forest Tree and NN-Sequentail, with the purpose of classifying patients with an emergency code. We conducted four experiments because of imbalanced data. A web-based application was developed to improve the triage process after our theoretical and exploratory results. Overall, in all experiments, the NN-Sequential model had better results, having, in the first experiment, a ROC-AUC score for each ESI emergency code of: 0.59%, 0.76%, 0.71%, 0.78% 0.64%. After applying methods to balance the data, the model yielded a ROC-AUC score for each emergency code of 0.72%, 0.75%, 0.69%, 0.74%, 0.78%. In the last experiment consisting of a three-class classification problem, the NN-Sequential and Random Forest Tree models had similar metric outcomes, and the NN-Sequential algorithm had a ROC-AUC score for each emergency code of: 0.76%, 0.72%, 0.84%. Without any doubt, our research results presented in this paper endorse this tremendous curiosity in Machine Learning applications to enrich aspects of emergency medical care by applying specific methods for processing both medical data and medical records.
Collapse
Affiliation(s)
- Andreea Vântu
- Faculty of Mathematics and Computer Science, Transilvania University of Braşov, Romania
| | - Anca Vasilescu
- Department of Mathematics and Computer Science, Transilvania University of Braşov, Romania
| | - Alexandra Băicoianu
- Department of Mathematics and Computer Science, Transilvania University of Braşov, Romania
| |
Collapse
|
13
|
Jeong D, Jeong W, Lee JH, Park SY. Use of Automated Machine Learning for Classifying Hemoperitoneum on Ultrasonographic Images of Morrison's Pouch: A Multicenter Retrospective Study. J Clin Med 2023; 12:4043. [PMID: 37373736 PMCID: PMC10298902 DOI: 10.3390/jcm12124043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Revised: 06/09/2023] [Accepted: 06/11/2023] [Indexed: 06/29/2023] Open
Abstract
This study evaluated automated machine learning (AutoML) in classifying the presence or absence of hemoperitoneum in ultrasonography (USG) images of Morrison's pouch. In this multicenter, retrospective study, 864 trauma patients from trauma and emergency medical centers in South Korea were included. In all, 2200 USG images (1100 hemoperitoneum and 1100 normal) were collected. Of these, 1800 images were used for training and 200 were used for the internal validation of AutoML. External validation was performed using 100 hemoperitoneum images and 100 normal images collected separately from a trauma center that were not included in the training and internal validation sets. Google's open-source AutoML was used to train the algorithm in classifying hemoperitoneum in USG images, followed by internal and external validation. In the internal validation, the sensitivity, specificity, and area under the receiver operating characteristic (AUROC) curve were 95%, 99%, and 0.97, respectively. In the external validation, the sensitivity, specificity, and AUROC were 94%, 99%, and 0.97, respectively. The performances of AutoML in the internal and external validation were not statistically different (p = 0.78). A publicly available, general-purpose AutoML can accurately classify the presence or absence of hemoperitoneum in USG images of the Morrison's pouch of real-world trauma patients.
Collapse
Affiliation(s)
- Dongkil Jeong
- Department of Emergency Medicine, College of Medicine, Soonchunhyang University, Cheonan 31151, Republic of Korea;
| | - Wonjoon Jeong
- Department of Emergency Medicine, School of Medicine, Chungnam National University, Daejeon 35015, Republic of Korea;
| | - Ji Han Lee
- Division of Emergency Medicine, Department of Medicine, The Catholic University of Korea, Seoul 11765, Republic of Korea
| | - Sin-Youl Park
- Department of Emergency Medicine, College of Medicine, Yeungnam University, Daegu 42415, Republic of Korea
| |
Collapse
|
14
|
An efficient edge/cloud medical system for rapid detection of level of consciousness in emergency medicine based on explainable machine learning models. Neural Comput Appl 2023; 35:10695-10716. [PMID: 37155550 PMCID: PMC10015549 DOI: 10.1007/s00521-023-08258-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2022] [Accepted: 01/06/2023] [Indexed: 03/17/2023]
Abstract
Emergency medicine (EM) is one of the attractive research fields in which researchers investigate their efforts to diagnose and treat unforeseen illnesses or injuries. There are many tests and observations are involved in EM. Detection of the level of consciousness is one of these observations, which can be detected using several methods. Among these methods, the automatic estimation of the Glasgow coma scale (GCS) is studied in this paper. The GCS is a medical score used to describe a patient’s level of consciousness. This type of scoring system requires medical examination that may not be available with the shortage of the medical expert. Therefore, the automatic medical calculation for a patient’s level of consciousness is highly needed. Artificial intelligence has been deployed in several applications and appears to have a high performance regarding providing automatic solutions. The main objective of this work is to introduce the edge/cloud system to improve the efficiency of the consciousness measurement through efficient local data processing. Moreover, an efficient machine learning (ML) model to predict the level of consciousness of a certain patient based on the patient’s demographic, vital signs, and laboratory tests is proposed, as well as maintaining the explainability issue using Shapley additive explanations (SHAP) that provides natural language explanation in a form that helps the medical expert to understand the final prediction. The developed ML model is validated using vital signs and laboratory tests extracted from the MIMIC III dataset, and it achieves superior performance (mean absolute error (MAE) = 0.269, mean square error (MSE) = 0.625, R2 score = 0.964). The resulting model is accurate, medically intuitive, and trustworthy.
Collapse
|
15
|
Ragab M, Kateb F, Al-Rabia MW, Hamed D, Althaqafi T, AL-Ghamdi ASALM. A Machine Learning Approach for Monitoring and Classifying Healthcare Data-A Case of Emergency Department of KSA Hospitals. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:4794. [PMID: 36981702 PMCID: PMC10049583 DOI: 10.3390/ijerph20064794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 03/04/2023] [Accepted: 03/06/2023] [Indexed: 06/18/2023]
Abstract
The Emergency Departments (EDs), in hospitals located in a few important areas in Saudi Arabia, experience a heavy inflow of patients due to viral illnesses, pandemics, and even on a few special occasions events such as Hajj or Umrah, when pilgrims travel from one region to another with severe disease conditions. Apart from the EDs, it is critical to monitor the movements of patients from EDs to other wards inside the hospital or in the region. This is to track the spread of viral illnesses that require more attention. In this scenario, Machine Learning (ML) algorithms can be used to classify the data into many classes and track the target audience. The current research article presents a Machine Learning-based Medical Data Monitoring and Classification Model for the EDs of the KSA hospitals and is named MLMDMC-ED technique. The most important aim of the proposed MLMDMC-ED technique is to monitor and track the patient's visits to the EDs, the treatment given to them based on the Canadian Emergency Department Triage and Acuity Scale (CTAS), and their Length Of Stay (LOS) in the hospital, based on their treatment requirements. A patient's clinical history is crucial in terms of making decisions during health emergencies or pandemics. So, the data should be processed so that it can be classified and visualized in different formats using the ML technique. The current research work aims at extracting the textual features from the patients' data using the metaheuristic Non-Defeatable Genetic Algorithm II (NSGA II). The data, collected from the hospitals, are classified using the Graph Convolutional Network (GCN) model. Grey Wolf Optimizer (GWO) is exploited for fine-tuning the parameters to optimize the performance of the GCN model. The proposed MLMDMC-ED technique was experimentally validated on the healthcare data and the outcomes indicated the improvements of the MLMDMC-ED technique over other models with a maximum accuracy of 91.87%.
Collapse
Affiliation(s)
- Mahmoud Ragab
- Information Technology Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Mathematics Department, Faculty of Science, Al-Azhar University, Naser City, Cairo 11884, Egypt
| | - Faris Kateb
- Information Technology Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Mohammed W. Al-Rabia
- Department of Medical Microbiology and Parasitology, Faculty of Medicine, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Health Promotion Center, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Diaa Hamed
- Mineral Resources and Rocks Department, Faculty of Earth Sciences, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Geology Department, Faculty of Science, Al-Azhar University, Naser City, Cairo 11884, Egypt
| | - Turki Althaqafi
- Information Systems Department, HECI School, Dar Alhekma University, Jeddah 22246, Saudi Arabia
| | - Abdullah S. AL-Malaise AL-Ghamdi
- Information Systems Department, HECI School, Dar Alhekma University, Jeddah 22246, Saudi Arabia
- Information Systems Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| |
Collapse
|
16
|
Polevoi SK, Straube S. Machine Learning as an Adjunct to Traditional Triage in the Emergency Department. J Emerg Med 2023; 64:107-108. [PMID: 36641253 DOI: 10.1016/j.jemermed.2022.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 10/11/2022] [Indexed: 01/13/2023]
Affiliation(s)
- Steven K Polevoi
- Department of Emergency Medicine, University of California San Francisco, San Francisco, California
| | - Steven Straube
- Department of Emergency Medicine, University of California San Francisco, San Francisco, California
| |
Collapse
|
17
|
Bitkina OV, Park J, Kim HK. Application of artificial intelligence in medical technologies: A systematic review of main trends. Digit Health 2023; 9:20552076231189331. [PMID: 37485326 PMCID: PMC10359663 DOI: 10.1177/20552076231189331] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 06/30/2023] [Indexed: 07/25/2023] Open
Abstract
Objective Artificial intelligence (AI) has been increasingly applied in various fields of science and technology. In line with the current research, medicine involves an increasing number of artificial intelligence technologies. The introduction of rapid AI can lead to positive and negative effects. This is a multilateral analytical literature review aimed at identifying the main branches and trends in the use of using artificial intelligence in medical technologies. Methods The total number of literature sources reviewed is n = 89, and they are analyzed based on the literature reporting evidence-based guideline PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) for a systematic review. Results As a result, from the initially selected 198 references, 155 references were obtained from the databases and the remaining 43 sources were found on open internet as direct links to publications. Finally, 89 literature sources were evaluated after exclusion of unsuitable references based on the duplicated and generalized information without focusing on the users. Conclusions This article is identifying the current state of artificial intelligence in medicine and prospects for future use. The findings of this review will be useful for healthcare and AI professionals for improving the circulation and use of medical AI from design to implementation stage.
Collapse
Affiliation(s)
- Olga Vl Bitkina
- Department of Industrial and Management Engineering, Incheon National University, Incheon, Korea
| | - Jaehyun Park
- Department of Industrial and Management Engineering, Incheon National University, Incheon, Korea
| | - Hyun K. Kim
- School of Information Convergence, Kwangwoon University, Seoul, Korea
| |
Collapse
|
18
|
Shanklin R, Samorani M, Harris S, Santoro MA. Ethical Redress of Racial Inequities in AI: Lessons from Decoupling Machine Learning from Optimization in Medical Appointment Scheduling. PHILOSOPHY & TECHNOLOGY 2022; 35:96. [PMID: 36284736 PMCID: PMC9584259 DOI: 10.1007/s13347-022-00590-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 10/07/2022] [Indexed: 10/30/2022]
Abstract
An Artificial Intelligence algorithm trained on data that reflect racial biases may yield racially biased outputs, even if the algorithm on its own is unbiased. For example, algorithms used to schedule medical appointments in the USA predict that Black patients are at a higher risk of no-show than non-Black patients, though technically accurate given existing data that prediction results in Black patients being overwhelmingly scheduled in appointment slots that cause longer wait times than non-Black patients. This perpetuates racial inequity, in this case lesser access to medical care. This gives rise to one type of Accuracy-Fairness trade-off: preserve the efficiency offered by using AI to schedule appointments or discard that efficiency in order to avoid perpetuating ethno-racial disparities. Similar trade-offs arise in a range of AI applications including others in medicine, as well as in education, judicial systems, and public security, among others. This article presents a framework for addressing such trade-offs where Machine Learning and Optimization components of the algorithm are decoupled. Applied to medical appointment scheduling, our framework articulates four approaches intervening in different ways on different components of the algorithm. Each yields specific results, in one case preserving accuracy comparable to the current state-of-the-art while eliminating the disparity.
Collapse
Affiliation(s)
- Robert Shanklin
- Philosophy Department, Santa Clara University, 500 El Camino Real, Santa Clara, CA 950053 USA
| | - Michele Samorani
- Department of Information Systems and Analytics, Santa Clara University, 500 El Camino Real, Santa Clara, CA 950053 USA
| | - Shannon Harris
- School of Business, Virginia Commonwealth University, Snead Hall, 301 W. Main Street, Box 844000, Richmond, VA 23284-4000 USA
| | - Michael A. Santoro
- Department of Management and Entrepreneurship, Santa Clara University, 500 El Camino Real, Santa Clara, CA 950053 USA
| |
Collapse
|
19
|
Cho A, Min IK, Hong S, Chung HS, Lee HS, Kim JH. Effect of Applying a Real-Time Medical Record Input Assistance System With Voice Artificial Intelligence on Triage Task Performance in the Emergency Department: Prospective Interventional Study. JMIR Med Inform 2022; 10:e39892. [PMID: 36044254 PMCID: PMC9475416 DOI: 10.2196/39892] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 07/27/2022] [Accepted: 08/15/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Natural language processing has been established as an important tool when using unstructured text data; however, most studies in the medical field have been limited to a retrospective analysis of text entered manually by humans. Little research has focused on applying natural language processing to the conversion of raw voice data generated in the clinical field into text using speech-to-text algorithms. OBJECTIVE In this study, we investigated the promptness and reliability of a real-time medical record input assistance system with voice artificial intelligence (RMIS-AI) and compared it to the manual method for triage tasks in the emergency department. METHODS From June 4, 2021, to September 12, 2021, RMIS-AI, using a machine learning engine trained with 1717 triage cases over 6 months, was prospectively applied in clinical practice in a triage unit. We analyzed a total of 1063 triage tasks performed by 19 triage nurses who agreed to participate. The primary outcome was the time for participants to perform the triage task. RESULTS The median time for participants to perform the triage task was 204 (IQR 155, 277) seconds by RMIS-AI and 231 (IQR 180, 313) seconds using manual method; this difference was statistically significant (P<.001). Most variables required for entry in the triage note showed a higher record completion rate by the manual method, but in the recording of additional chief concerns and past medical history, RMIS-AI showed a higher record completion rate than the manual method. Categorical variables entered by RMIS-AI showed less accuracy compared with continuous variables, such as vital signs. CONCLUSIONS RMIS-AI improves the promptness in performing triage tasks as compared to using the manual input method. However, to make it a reliable alternative to the conventional method, technical supplementation and additional research should be pursued.
Collapse
Affiliation(s)
- Ara Cho
- Department of Emergency Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - In Kyung Min
- Department of Research Affairs, Biostatistics Collaboration Unit, Yonsei University College, Seoul, Republic of Korea
| | - Seungkyun Hong
- CONNECT-AI Research Center, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Hyun Soo Chung
- Department of Emergency Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Hyun Sim Lee
- Department of Emergency Nursing, Yonsei University Health System, Seoul, Republic of Korea
| | - Ji Hoon Kim
- Department of Emergency Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
20
|
Zhao X, Lai JW, Wah Ho AF, Liu N, Hock Ong ME, Cheong KH. Predicting hospital emergency department visits with deep learning approaches. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.07.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
21
|
Daniel J, Rose JTA, Vinnarasi FSF, Rajinikanth V. VGG-UNet/VGG-SegNet Supported Automatic Segmentation of Endoplasmic Reticulum Network in Fluorescence Microscopy Images. SCANNING 2022; 2022:7733860. [PMID: 35800206 PMCID: PMC9200602 DOI: 10.1155/2022/7733860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 05/05/2022] [Accepted: 05/11/2022] [Indexed: 06/15/2023]
Abstract
This research work aims to implement an automated segmentation process to extract the endoplasmic reticulum (ER) network in fluorescence microscopy images (FMI) using pretrained convolutional neural network (CNN). The threshold level of the raw FMT is complex, and extraction of the ER network is a challenging task. Hence, an image conversion procedure is initially employed to reduce its complexity. This work employed the pretrained CNN schemes, such as VGG-UNet and VGG-SegNet, to mine the ER network from the chosen FMI test images. The proposed ER segmentation pipeline consists of the following phases; (i) clinical image collection, 16-bit to 8-bit conversion and resizing; (ii) implementation of pretrained VGG-UNet and VGG-SegNet; (iii) extraction of the binary form of ER network; (iv) comparing the mined ER with ground-truth; and (v) computation of image measures and validation. The considered FMI dataset consists of 223 test images, and image augmentation is then implemented to increase these images. The result of this scheme is then confirmed against other CNN methods, such as U-Net, SegNet, and Res-UNet. The experimental outcome confirms a segmentation accuracy of >98% with VGG-UNet and VGG-SegNet. The results of this research authenticate that the proposed pipeline can be considered to examine the clinical-grade FMI.
Collapse
Affiliation(s)
- Jesline Daniel
- Department of Computer Science and Engineering, St. Joseph's College of Engineering, OMR, Chennai, 600 119 Tamil Nadu, India
| | - J. T. Anita Rose
- Department of Computer Science and Engineering, St. Joseph's College of Engineering, OMR, Chennai, 600 119 Tamil Nadu, India
| | | | - Venkatesan Rajinikanth
- Department of Electronics and Instrumentation Engineering, St. Joseph's College of Engineering, OMR, Chennai, 600 119 Tamil Nadu, India
| |
Collapse
|
22
|
Etu EE, Monplaisir L, Aguwa C, Arslanturk S, Masoud S, Markevych I, Miller J. Identifying indicators influencing emergency department performance during a medical surge: A consensus-based modified fuzzy Delphi approach. PLoS One 2022; 17:e0265101. [PMID: 35446857 PMCID: PMC9022798 DOI: 10.1371/journal.pone.0265101] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Accepted: 02/22/2022] [Indexed: 11/18/2022] Open
Abstract
During a medical surge, resource scarcity and other factors influence the performance of the healthcare systems. To enhance their performance, hospitals need to identify the critical indicators that affect their operations for better decision-making. This study aims to model a pertinent set of indicators for improving emergency departments' (ED) performance during a medical surge. The framework comprises a three-stage process to survey, evaluate, and rank such indicators in a systematic approach. The first stage consists of a survey based on the literature and interviews to extract quality indicators that impact the EDs' performance. The second stage consists of forming a panel of medical professionals to complete the survey questionnaire and applying our proposed consensus-based modified fuzzy Delphi method, which integrates text mining to address the fuzziness and obtain the sentiment scores in expert responses. The final stage ranks the indicators based on their stability and convergence. Here, twenty-nine potential indicators are extracted in the first stage, categorized into five healthcare performance factors, are reduced to twenty consentaneous indicators monitoring ED's efficacy. The Mann-Whitney test confirmed the stability of the group opinions (p < 0.05). The agreement percentage indicates that ED beds (77.8%), nurse staffing per patient seen (77.3%), and length of stay (75.0%) are among the most significant indicators affecting the ED's performance when responding to a surge. This research proposes a framework that helps hospital administrators determine essential indicators to monitor, manage, and improve the performance of EDs systematically during a surge event.
Collapse
Affiliation(s)
- Egbe-Etu Etu
- Department of Industrial & Systems Engineering, Wayne State University, Detroit, Michigan, United States of America
| | - Leslie Monplaisir
- Department of Industrial & Systems Engineering, Wayne State University, Detroit, Michigan, United States of America
| | - Celestine Aguwa
- Department of Industrial & Systems Engineering, Wayne State University, Detroit, Michigan, United States of America
| | - Suzan Arslanturk
- Department of Computer Science, Wayne State University, Detroit, Michigan, United States of America
| | - Sara Masoud
- Department of Industrial & Systems Engineering, Wayne State University, Detroit, Michigan, United States of America
| | - Ihor Markevych
- School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America
| | - Joseph Miller
- Departments of Emergency Medicine and Internal Medicine, Henry Ford Hospital, Detroit, Michigan, United States of America
| |
Collapse
|
23
|
Pettit RW, Fullem R, Cheng C, Amos CI. Artificial intelligence, machine learning, and deep learning for clinical outcome prediction. Emerg Top Life Sci 2021; 5:ETLS20210246. [PMID: 34927670 PMCID: PMC8786279 DOI: 10.1042/etls20210246] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 12/03/2021] [Accepted: 12/07/2021] [Indexed: 12/12/2022]
Abstract
AI is a broad concept, grouping initiatives that use a computer to perform tasks that would usually require a human to complete. AI methods are well suited to predict clinical outcomes. In practice, AI methods can be thought of as functions that learn the outcomes accompanying standardized input data to produce accurate outcome predictions when trialed with new data. Current methods for cleaning, creating, accessing, extracting, augmenting, and representing data for training AI clinical prediction models are well defined. The use of AI to predict clinical outcomes is a dynamic and rapidly evolving arena, with new methods and applications emerging. Extraction or accession of electronic health care records and combining these with patient genetic data is an area of present attention, with tremendous potential for future growth. Machine learning approaches, including decision tree methods of Random Forest and XGBoost, and deep learning techniques including deep multi-layer and recurrent neural networks, afford unique capabilities to accurately create predictions from high dimensional, multimodal data. Furthermore, AI methods are increasing our ability to accurately predict clinical outcomes that previously were difficult to model, including time-dependent and multi-class outcomes. Barriers to robust AI-based clinical outcome model deployment include changing AI product development interfaces, the specificity of regulation requirements, and limitations in ensuring model interpretability, generalizability, and adaptability over time.
Collapse
Affiliation(s)
- Rowland W. Pettit
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
| | - Robert Fullem
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, U.S.A
| | - Chao Cheng
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
| | - Christopher I. Amos
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
- Dan L Duncan Comprehensive Cancer Center, Baylor College of Medicine, Houston, TX, U.S.A
| |
Collapse
|
24
|
Prediction across healthcare settings: a case study in predicting emergency department disposition. NPJ Digit Med 2021; 4:169. [PMID: 34912043 PMCID: PMC8674364 DOI: 10.1038/s41746-021-00537-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 10/19/2021] [Indexed: 12/24/2022] Open
Abstract
Several approaches exist today for developing predictive models across multiple clinical sites, yet there is a lack of comparative data on their performance, especially within the context of EHR-based prediction models. We set out to provide a framework for prediction across healthcare settings. As a case study, we examined an ED disposition prediction model across three geographically and demographically diverse sites. We conducted a 1-year retrospective study, including all visits in which the outcome was either discharge-to-home or hospitalization. Four modeling approaches were compared: a ready-made model trained at one site and validated at other sites, a centralized uniform model incorporating data from all sites, multiple site-specific models, and a hybrid approach of a ready-made model re-calibrated using site-specific data. Predictions were performed using XGBoost. The study included 288,962 visits with an overall admission rate of 16.8% (7.9–26.9%). Some risk factors for admission were prominent across all sites (e.g., high-acuity triage emergency severity index score, high prior admissions rate), while others were prominent at only some sites (multiple lab tests ordered at the pediatric sites, early use of ECG at the adult site). The XGBoost model achieved its best performance using the uniform and site-specific approaches (AUC = 0.9–0.93), followed by the calibrated-model approach (AUC = 0.87–0.92), and the ready-made approach (AUC = 0.62–0.85). Our results show that site-specific customization is a key driver of predictive model performance.
Collapse
|
25
|
Requirements and Architecture of a Cloud Based Insomnia Therapy and Diagnosis Platform: A Smart Cities Approach. SMART CITIES 2021. [DOI: 10.3390/smartcities4040070] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Insomnia is the most common sleep disorder worldwide. Its effects generate economic costs in the millions but could be effectively reduced using digitally provisioned cognitive behavioural therapy. However, traditional acquisition and maintenance of the necessary technical infrastructure requires high financial and personnel expenses. Sleep analysis is still mostly done in artificial settings in clinical environments. Nevertheless, innovative IT infrastructure, such as mHealth and cloud service solutions for home monitoring, are available and allow context-aware service provision following the Smart Cities paradigm. This paper aims to conceptualise a digital, cloud-based platform with context-aware data storage that supports diagnosis and therapy of non-organic insomnia. In a first step, requirements needed for a remote diagnosis, therapy, and monitoring system are identified. Then, the software architecture is drafted based on the above mentioned requirements. Lastly, an implementation concept of the software architecture is proposed through selecting and combining eleven cloud computing services. This paper shows how treatment and diagnosis of a common medical issue could be supported effectively and cost-efficiently by utilising state-of-the-art technology. The paper demonstrates the relevance of context-aware data collection and disease understanding as well as the requirements regarding health service provision in a Smart Cities context. In contrast to existing systems, we provide a cloud-based and requirement-driven reference architecture. The applied methodology can be used for the development, design, and evaluation of other remote and context-aware diagnosis and therapy systems. Considerations of additional aspects regarding cost, methods for data analytics as well as general data security and safety are discussed.
Collapse
|
26
|
Reska D, Czajkowski M, Jurczuk K, Boldak C, Kwedlo W, Bauer W, Koszelew J, Kretowski M. Integration of solutions and services for multi-omics data analysis towards personalized medicine. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.10.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
27
|
Mendo IR, Marques G, de la Torre Díez I, López-Coronado M, Martín-Rodríguez F. Machine Learning in Medical Emergencies: a Systematic Review and Analysis. J Med Syst 2021; 45:88. [PMID: 34410512 PMCID: PMC8374032 DOI: 10.1007/s10916-021-01762-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Accepted: 08/04/2021] [Indexed: 12/23/2022]
Abstract
Despite the increasing demand for artificial intelligence research in medicine, the functionalities of his methods in health emergency remain unclear. Therefore, the authors have conducted this systematic review and a global overview study which aims to identify, analyse, and evaluate the research available on different platforms, and its implementations in healthcare emergencies. The methodology applied for the identification and selection of the scientific studies and the different applications consist of two methods. On the one hand, the PRISMA methodology was carried out in Google Scholar, IEEE Xplore, PubMed ScienceDirect, and Scopus. On the other hand, a review of commercial applications found in the best-known commercial platforms (Android and iOS). A total of 20 studies were included in this review. Most of the included studies were of clinical decisions (n = 4, 20%) or medical services or emergency services (n = 4, 20%). Only 2 were focused on m-health (n = 2, 10%). On the other hand, 12 apps were chosen for full testing on different devices. These apps dealt with pre-hospital medical care (n = 3, 25%) or clinical decision support (n = 3, 25%). In total, half of these apps are based on machine learning based on natural language processing. Machine learning is increasingly applicable to healthcare and offers solutions to improve the efficiency and quality of healthcare. With the emergence of mobile health devices and applications that can use data and assess a patient's real-time health, machine learning is a growing trend in the healthcare industry.
Collapse
Affiliation(s)
- Inés Robles Mendo
- Department of Signal Theory and Communications and Telematics Engineering, University of Valladolid, Paseo de Belén, 15, 47.011 Valladolid, Spain
| | - Gonçalo Marques
- Department of Signal Theory and Communications and Telematics Engineering, University of Valladolid, Paseo de Belén, 15, 47.011 Valladolid, Spain
- Polytechnic of Coimbra, ESTGOH, Rua General Santos Costa, 3400-124 Oliveira do Hospital, Portugal
| | - Isabel de la Torre Díez
- Department of Signal Theory and Communications and Telematics Engineering, University of Valladolid, Paseo de Belén, 15, 47.011 Valladolid, Spain
| | - Miguel López-Coronado
- Department of Signal Theory and Communications and Telematics Engineering, University of Valladolid, Paseo de Belén, 15, 47.011 Valladolid, Spain
| | - Francisco Martín-Rodríguez
- Advanced Clinical Simulation Center. Faculty of Medicine, University of Valladolid, Avda. Ramón Y Cajal, 7, 47.005 Valladolid, Spain
| |
Collapse
|
28
|
A method for segmentation of tumors in breast ultrasound images using the variant enhanced deep learning. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.05.007] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
29
|
Santhosh Reddy D, Rajalakshmi P, Mateen M. A deep learning based approach for classification of abdominal organs using ultrasound images. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.05.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|