1
|
Theriault-Lauzier P, Cobin D, Tastet O, Langlais EL, Taji B, Kang G, Chong AY, So D, Tang A, Gichoya JW, Chandar S, Déziel PL, Hussin JG, Kadoury S, Avram R. A responsible framework for applying artificial intelligence on medical images and signals at the point-of-care: the PACS-AI platform. Can J Cardiol 2024:S0828-282X(24)00427-6. [PMID: 38885787 DOI: 10.1016/j.cjca.2024.05.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Revised: 05/09/2024] [Accepted: 05/26/2024] [Indexed: 06/20/2024] Open
Abstract
The potential of artificial intelligence (AI) in medicine lies in its ability to enhance clinicians' capacity to analyze medical images, thereby improving diagnostic precision and accuracy, thus enhancing current tests. However, the integration of AI within healthcare is fraught with difficulties. Heterogeneity among healthcare system applications, reliance on proprietary closed-source software, and rising cyber-security threats pose significant challenges. Moreover, prior to their deployment in clinical settings, AI models must demonstrate their effectiveness across a wide range of scenarios and must be validated by prospective studies, but doing so requires testing in an environment mirroring the clinical workflow which is difficult to achieve without dedicated software. Finally, the use of AI techniques in healthcare raises significant legal and ethical issues, such as the protection of patient privacy, the prevention of bias, and the monitoring of the device's safety and effectiveness for regulatory compliance. This review describes challenges to AI integration in healthcare and provides guidelines on how to move forward. We describe an open-source solution that we developed which integrates AI models into the Picture Archives Communication System (PACS), called PACS-AI. This approach aims to increase the evaluation of AI models by facilitating their integration and validation with existing medical imaging databases. PACS-AI may overcome many current barriers to AI deployment and offers a pathway towards responsible, fair, and effective deployment of AI models in healthcare. Additionally, we propose a list of criteria and guidelines that AI researchers should adopt when publishing a medical AI model, to enhance standardization and reproducibility.
Collapse
Affiliation(s)
- Pascal Theriault-Lauzier
- Division of Cardiovascular Medicine, Stanford School of Medicine, Palo Alto, USA;; Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Canada
| | | | | | | | - Bahareh Taji
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Canada
| | - Guson Kang
- Division of Cardiovascular Medicine, Stanford School of Medicine, Palo Alto, USA
| | - Aun-Yeong Chong
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Canada
| | - Derek So
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Canada
| | - An Tang
- Department of Radiology, Radiation Oncology and Nuclear Medicine, Université de Montréal, Montréal, Canada
| | - Judy Wawira Gichoya
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, USA
| | | | | | - Julie G Hussin
- Montreal Heart Institute, Montreal, Canada;; Mila-Quebec AI Institute, Montreal, Canada;; Faculty of Law, Université Laval, Québec, Québec, Canada
| | - Samuel Kadoury
- Department of Radiology, Radiation Oncology and Nuclear Medicine, Université de Montréal, Montréal, Canada;; Polytechnique Montréal, Montréal, Canada
| | - Robert Avram
- Montreal Heart Institute, Montreal, Canada;; Department of Medicine, Université de Montréal, Montreal, Canada;.
| |
Collapse
|
2
|
Averill SL, Woods RW, Desoky SM, Alexandre Frigini L, Chetlen AL, Oliveira AM, Desperito E, Belfi LM. NAM National Plan for Health Workforce Well-being: Applications for Radiology. Acad Radiol 2024; 31:2097-2108. [PMID: 38042622 DOI: 10.1016/j.acra.2023.10.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Revised: 10/08/2023] [Accepted: 10/10/2023] [Indexed: 12/04/2023]
Abstract
The National Academy of Medicine Plan for Health Workforce Well-Being identifies seven priority areas, including creating positive work environments, addressing burnout and stress, promoting transparency and equity in compensation, providing education and training to promote resilience, enhancing community and social support systems, addressing the stigma associated with seeking help for mental health and substance use disorders and fostering leadership commitment and accountability for workforce well-being. This paper will explore the National Plan for Health Workforce Well-Being, providing an overview of the seven priority areas and offering strategies for implementation in radiology.
Collapse
Affiliation(s)
- Sarah L Averill
- Associate Professor of Oncology and Radiology, Roswell Park Comprehensive Cancer Center, 665 Elm St, Buffalo, New York, USA (S.L.A.).
| | - Ryan W Woods
- Associate Professor of Radiology, University of Wisconsin School of Medicine and Public Health, Wisconsin, USA (R.W.W.)
| | - Sarah M Desoky
- Associate Professor of Diagnostic Radiology, OHSU, Portland, Oregon, USA (S.M.D.)
| | - L Alexandre Frigini
- Professor of Radiology, Baylor College of Medicine, Houston, Texas, USA (L.A.F.)
| | - Alison L Chetlen
- Professor of Radiology, Penn State Hershey Medical Center, Pennsylvania, USA (A.L.C.)
| | - Amy M Oliveira
- Associate Professor of Radiology, UMass Chan Medical School-Baystate, Musculoskeletal Radiology Division, Baystate Health System, Worcester, Massachusetts, USA (A.M.O.)
| | - Elise Desperito
- Associate Professor of Radiology, Columbia University, New York, New York, USA (E.D.)
| | - Lily M Belfi
- Associate Professor of Clinical Radiology, Director of Medical Student Education, Division of Emergency/ Musculoskeletal Radiology, Weill Cornell Medicine, New York, New York, USA (L.M.B.)
| |
Collapse
|
3
|
York TJ, Raj S, Ashdown T, Jones G. Clinician and computer: a study on doctors' perceptions of artificial intelligence in skeletal radiography. BMC MEDICAL EDUCATION 2023; 23:16. [PMID: 36627640 PMCID: PMC9830124 DOI: 10.1186/s12909-022-03976-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 12/19/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND Traumatic musculoskeletal injuries are a common presentation to emergency care, the first-line investigation often being plain radiography. The interpretation of this imaging frequently falls to less experienced clinicians despite well-established challenges in reporting. This study presents novel data of clinicians' confidence in interpreting trauma radiographs, their perception of AI in healthcare, and their support for the development of systems applied to skeletal radiography. METHODS A novel questionnaire was distributed through a network of collaborators to clinicians across the Southeast of England. Over a three-month period, responses were compiled into a database before undergoing statistical review. RESULTS The responses of 297 participants were included. The mean self-assessed knowledge of AI in healthcare was 3.68 out of ten, with significantly higher knowledge reported by the most senior doctors (Specialty Trainee/Specialty Registrar or above = 4.88). 13.8% of participants reported an awareness of AI in their clinical practice. Overall, participants indicated substantial favourability towards AI in healthcare (7.87) and in AI applied to skeletal radiography (7.75). There was a preference for a hypothetical system indicating positive findings rather than ruling as negative (7.26 vs 6.20). CONCLUSIONS This study identifies clear support, amongst a cross section of student and qualified doctors, for both the general use of AI technology in healthcare and in its application to skeletal radiography for trauma. The development of systems to address this demand appear well founded and popular. The engagement of a small but reticent minority should be sought, along with improving the wider education of doctors on AI.
Collapse
Affiliation(s)
- Thomas James York
- Alexander Fleming Building, Imperial College London, South Kensington Campus, London, UK.
| | | | | | - Gareth Jones
- Imperial College Healthcare NHS Trust, London, UK
| |
Collapse
|
4
|
Kawa J, Pyciński B, Smoliński M, Bożek P, Kwasecki M, Pietrzyk B, Szymański D. Design and Implementation of a Cloud PACS Architecture. SENSORS (BASEL, SWITZERLAND) 2022; 22:8569. [PMID: 36366266 PMCID: PMC9654824 DOI: 10.3390/s22218569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 10/28/2022] [Accepted: 11/04/2022] [Indexed: 06/16/2023]
Abstract
The limitations of the classic PACS (picture archiving and communication system), such as the backward-compatible DICOM network architecture and poor security and maintenance, are well-known. They are challenged by various existing solutions employing cloud-related patterns and services. However, a full-scale cloud-native PACS has not yet been demonstrated. The paper introduces a vendor-neutral cloud PACS architecture. It is divided into two main components: a cloud platform and an access device. The cloud platform is responsible for nearline (long-term) image archive, data flow, and backend management. It operates in multi-tenant mode. The access device is responsible for the local DICOM (Digital Imaging and Communications in Medicine) interface and serves as a gateway to cloud services. The cloud PACS was first implemented in an Amazon Web Services environment. It employs a number of general-purpose services designed or adapted for a cloud environment, including Kafka, OpenSearch, and Memcached. Custom services, such as a central PACS node, queue manager, or flow worker, also developed as cloud microservices, bring DICOM support, external integration, and a management layer. The PACS was verified using image traffic from, among others, computed tomography (CT), magnetic resonance (MR), and computed radiography (CR) modalities. During the test, the system was reliably storing and accessing image data. In following tests, scaling behavior differences between the monolithic Dcm4chee server and the proposed solution are shown. The growing number of parallel connections did not influence the monolithic server's overall throughput, whereas the performance of cloud PACS noticeably increased. In the final test, different retrieval patterns were evaluated to assess performance under different scenarios. The current production environment stores over 450 TB of image data and handles over 4000 DICOM nodes.
Collapse
Affiliation(s)
- Jacek Kawa
- Radpoint Sp. z o.o., Ceglana 35, 40-514 Katowice, Poland
- Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland
| | - Bartłomiej Pyciński
- Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland
| | | | - Paweł Bożek
- Radpoint Sp. z o.o., Ceglana 35, 40-514 Katowice, Poland
- Department of Radiology and Radiodiagnostics in Zabrze, Medical University of Silesia in Katowice, 3 Maja 13/15, 41-800 Zabrze, Poland
| | - Marek Kwasecki
- Radpoint Sp. z o.o., Ceglana 35, 40-514 Katowice, Poland
| | | | | |
Collapse
|
5
|
Fan X, Ding C, Liu Z. Comparison of the Utility of High-Resolution CT-DWI and T2WI-DWI Fusion Images for the Localization of Cholesteatoma. AJNR Am J Neuroradiol 2022; 43:1029-1035. [PMID: 35654492 DOI: 10.3174/ajnr.a7538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Accepted: 04/26/2022] [Indexed: 11/07/2022]
Abstract
BACKGROUND AND PURPOSE Cholesteatoma is an aggressive disease that may lead to hearing impairment. This study aimed to compare the utility of high-resolution CT and TSE-DWI fusion images with that of T2WI and TSE-DWI fusion images in the localization of middle ear cholesteatoma. MATERIALS AND METHODS Seventy-one patients with middle ear cholesteatoma were retrospectively recruited. High-resolution CT, T2WI with fat suppression, and TSE-DWI scans were obtained, and image fusion was performed using a 3D reconstruction postprocessing workstation to form CT-DWI and T2WI-DWI fusion images. The quality of the 2 fused images was subjectively evaluated using a 5-point Likert scale with the horizontal semicircular canal transverse position as the reference. Receiver operating characteristic analysis was performed, and the diagnostic efficacies of CT-DWI and T2WI-DWI fusion images in localizing middle ear cholesteatoma were calculated. RESULTS The overall quality of T2WI-DWI fusion images was slightly higher than that of CT-DWI fusion images (P < .001), and the semicircular canal was slightly less clear on T2WI-DWI than on CT-DWI (P < .001). No statistical difference was found in the diagnostic confidence between them. In the localization of middle ear cholesteatoma, the accuracy, sensitivity, and specificity of T2WI-DWI fusion images and CT-DWI fusion images were equivalent for involvement of the attic, tympanic cavity, mastoid antrum, and mastoid process, with no statistically significant differences. CONCLUSIONS T2WI-DWI fusion images could replace CT-DWI in the preoperative selection of surgical options for middle ear cholesteatoma.
Collapse
Affiliation(s)
- X Fan
- From the Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - C Ding
- From the Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Z Liu
- From the Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| |
Collapse
|
6
|
Montazeri M, Khajouei R. Determining the Effect of the Picture Archiving and Communication System (PACS) on Different Dimensions of Users' Work. Radiol Res Pract 2022; 2022:4306714. [PMID: 35265375 PMCID: PMC8901356 DOI: 10.1155/2022/4306714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2021] [Revised: 01/22/2022] [Accepted: 02/04/2022] [Indexed: 11/17/2022] Open
Abstract
The impact of the picture archiving and communication system (PACS) on healthcare costs, information access, image quality, and user workflow has been well studied. However, there is insufficient evidence on the effect of this system on different dimensions of the users' work. The objective of this study was to evaluate the impact of the PACS on different dimensions of users' work (external communication, service quality, user intention to use the PACS, daily routine, and complaints on users) and to compare the opinions of different groups of users about the PACS. This study was performed on the PACS users (n = 72) at Kerman University of Medical Sciences, including radiologists, radiology staff, ward heads, and physicians. Data were collected using a questionnaire consisting of two parts: demographic information of the participants and 5-point Likert scale questions concerning the five dimensions of users' work. Data were analyzed using descriptive statistics, ANOVA, and Pearson's correlation coefficient statistical tests. The mean of scores given by the PACS users was 4.31 ± 0.86 for external communication, 4.18 ± 0.96 for user intention to use the PACS, 3.91 ± 0.7 for service quality, 3.16 ± 0.56 for daily routine, and 3.08 ± 1.05 for complaints on users. Radiologists and radiology staff had a more positive opinion about the PACS than other clinicians such as physicians (P < 0.01, CI = 95%). Factors such as user age (P < 0.01, CI = 95%), job (P < 0.001, CI = 95%), work experience (P < 0.001, CI = 95%), and PACS training method (P=0.037, CI = 95%) were related to the impact of the PACS on different dimensions of users' work. This study showed that the PACS has a positive effect on different dimensions of users' work, especially on external communication, user intention to use the system, and service quality. It is recommended to implement PACSs in medical centers to support users' work and to maintain and strengthen the capabilities and functions of radiology departments.
Collapse
Affiliation(s)
- Mahdieh Montazeri
- Department of Health Information Sciences, Faculty of Management and Medical Information Sciences, Kerman University of Medical Sciences, Kerman, Iran
| | - Reza Khajouei
- Department of Health Information Sciences, Faculty of Management and Medical Information Sciences, Kerman University of Medical Sciences, Kerman, Iran
| |
Collapse
|
7
|
Goelz L, Arndt H, Hausmann J, Madeja C, Mutze S. Obstacles and Solutions Driving the Development of a National Teleradiology Network. Healthcare (Basel) 2021; 9:healthcare9121684. [PMID: 34946410 PMCID: PMC8701208 DOI: 10.3390/healthcare9121684] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 12/03/2021] [Accepted: 12/04/2021] [Indexed: 02/07/2023] Open
Abstract
Background: Teleradiology has the potential to link medical experts and specialties despite geographical separation. In a project report about hospital-based teleradiology, the significance of technical and human factors during the implementation and growth of a teleradiology network are explored. Evaluation: The article identifies major obstacles during the implementation and growth of the teleradiology network of the Berlin Trauma Hospital (BG Unfallkrankenhaus Berlin) between 2004 and 2020 in semi-structured interviews with senior staff members. Quantitative analysis of examination numbers, patient numbers, and profits relates the efforts of the staff members to the monetary benefits and success of the network. Identification of qualitative and quantitative factors for success: Soft and hard facilitators and solutions driving the development of the national teleradiology network are identified. Obstacles were often solved by technical innovations, but the time span between required personal efforts, endurance, and flexibility of local and external team members. The article describes innovations driven by teleradiology and hints at the impact of teleradiology on modern medical care by relating the expansion of the teleradiology network to patient transfers and profits. Conclusion: In addition to technical improvements, interpersonal collaborations were key to the success of the teleradiology network of the Berlin Trauma Hospital and remained a unique feature and selling point of this teleradiology network.
Collapse
Affiliation(s)
- Leonie Goelz
- Department of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Warener Straße 7, 12683 Berlin, Germany; (H.A.); (J.H.); (C.M.); (S.M.)
- Correspondence: ; Tel.: +49-30-56813829; Fax: +49-30-56813803
| | - Holger Arndt
- Department of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Warener Straße 7, 12683 Berlin, Germany; (H.A.); (J.H.); (C.M.); (S.M.)
| | - Jens Hausmann
- Department of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Warener Straße 7, 12683 Berlin, Germany; (H.A.); (J.H.); (C.M.); (S.M.)
| | - Christian Madeja
- Department of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Warener Straße 7, 12683 Berlin, Germany; (H.A.); (J.H.); (C.M.); (S.M.)
| | - Sven Mutze
- Department of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Warener Straße 7, 12683 Berlin, Germany; (H.A.); (J.H.); (C.M.); (S.M.)
- Institute for Diagnostic Radiology and Neuroradiology, University Medicine Greifswald, Ferdinand-Sauerbruch-Straße, 17475 Greifswald, Germany
| |
Collapse
|
8
|
Al-Kahtani N, Al-Dhaif E, Alsaihtati N, Farid K, AlKhater S. Clinicians' Perceptions of Picture Archiving and Communication System (PACS) Use in Patient Care in Eastern Province Hospitals in Saudi Arabia. J Multidiscip Healthc 2021; 14:743-750. [PMID: 33833519 PMCID: PMC8020125 DOI: 10.2147/jmdh.s296828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Accepted: 03/09/2021] [Indexed: 11/23/2022] Open
Abstract
Purpose The picture archiving and communication system (PACS) is one of the most important tools used in patient care in many hospitals worldwide. It allows clinicians to remotely communicate and consult with other clinicians on patient cases and view diagnostic images from different angles, thus facilitating patient diagnosis and treatment. Several studies have been conducted in Saudi Arabia to evaluate different aspects of PACS use; however, no comprehensive study has been conducted in its Eastern Province. This study aimed to investigate clinicians’ perceptions of the advantages and disadvantages of the use of PACS in Eastern Province hospitals in Saudi Arabia and identify the factors that affect their perceptions and its use. In addition, it aimed to gather recommendations of clinicians for improving the system and its implementation. Methods A qualitative approach with grounded theory method was employed. A sample of 18 residents, radiologists, and consultants from three Eastern Province hospitals in Saudi Arabia participated in the study. Data were collected using semi-structured interviews over a period of 7 months. Results The perceived advantages of PACS included providing quality images and the ability to manipulate their resolution, whereas the perceived barriers included low-speed internet connections and technical problems. Participants recommended providing clinicians remote access to the system and implementing a mobile PACS application. The theory that emerged from the analysis revealed that demographic, system-related, and hospital-related factors affected participants’ perspectives of PACS and its use. Conclusion The results of this study and its theoretical model can help identify areas of improvement and inform policy and strategic planning for the effective implementation of PACS in patient care in Saudi Arabia.
Collapse
Affiliation(s)
- Nouf Al-Kahtani
- Department of Health Information Management and Technology, College of Public Health, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Esra Al-Dhaif
- Department of Health Information Management and Technology, College of Public Health, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Noor Alsaihtati
- Department of Health Information Management and Technology, College of Public Health, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Khalid Farid
- Department of Health Information Management and Technology, College of Public Health, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Suzan AlKhater
- Department of Health Information Management and Technology, College of Public Health, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| |
Collapse
|
9
|
Towbin AJ, Regan J, Hulefeld D, Schwieterman E, Perry LA, O'Brien S, Dhamija A, OConnor T, Moskovitz JA. Disaster Planning During SARS-CoV-2/COVID: One Radiology Informatics Team's Story. J Digit Imaging 2021; 34:290-296. [PMID: 33604808 PMCID: PMC7891804 DOI: 10.1007/s10278-021-00420-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 11/05/2020] [Accepted: 01/11/2021] [Indexed: 12/13/2022] Open
Abstract
Disasters cause a major disruption to normal operations. Hospital information systems are often well-prepared for events such as fires or natural disasters. This type of disaster planning focuses on redundancy and manual workarounds. The SARS-CoV-2/COVID pandemic represented a new type of disaster for our radiology informatics team. In this pandemic, the information systems continued to work but the employees, and the computers that they worked with, had to be distanced. The purpose of this manuscript is to discuss the four phases of the disaster planning process: mitigation, planning, response, and recovery. We will illustrate the process with the example of how our radiology informatics team responded to the SARS-CoV-2/COVID pandemic.
Collapse
Affiliation(s)
- Alexander J Towbin
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA.
- University of Cincinnati College of Medicine, Department of Radiology, Cincinnati, OH, USA.
| | - Jennifer Regan
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
| | - David Hulefeld
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
| | - Eric Schwieterman
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
| | - Laurie A Perry
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
| | - Sarah O'Brien
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
| | - Akhil Dhamija
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
- University of Toledo College of Medicine and Life Sciences, Toledo, OH, USA
| | - Timothy OConnor
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
| | - Jay A Moskovitz
- Cincinnati Children's Hospital, Department of Radiology, Cincinnati, OH, USA
| |
Collapse
|
10
|
Sohn JH, Chillakuru YR, Lee S, Lee AY, Kelil T, Hess CP, Seo Y, Vu T, Joe BN. An Open-Source, Vender Agnostic Hardware and Software Pipeline for Integration of Artificial Intelligence in Radiology Workflow. J Digit Imaging 2020; 33:1041-1046. [PMID: 32468486 PMCID: PMC7522128 DOI: 10.1007/s10278-020-00348-8] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
Although machine learning (ML) has made significant improvements in radiology, few algorithms have been integrated into clinical radiology workflow. Complex radiology IT environments and Picture Archiving and Communication System (PACS) pose unique challenges in creating a practical ML schema. However, clinical integration and testing are critical to ensuring the safety and accuracy of ML algorithms. This study aims to propose, develop, and demonstrate a simple, efficient, and understandable hardware and software system for integrating ML models into the standard radiology workflow and PACS that can serve as a framework for testing ML algorithms. A Digital Imaging and Communications in Medicine/Graphics Processing Unit (DICOM/GPU) server and software pipeline was established at a metropolitan county hospital intranet to demonstrate clinical integration of ML algorithms in radiology. A clinical ML integration schema, agnostic to the hospital IT system and specific ML models/frameworks, was implemented and tested with a breast density classification algorithm and prospectively evaluated for time delays using 100 digital 2D mammograms. An open-source clinical ML integration schema was successfully implemented and demonstrated. This schema allows for simple uploading of custom ML models. With the proposed setup, the ML pipeline took an average of 26.52 s per second to process a batch of 100 studies. The most significant processing time delays were noted in model load and study stability times. The code is made available at " http://bit.ly/2Z121hX ". We demonstrated the feasibility to deploy and utilize ML models in radiology without disrupting existing radiology workflow.
Collapse
Affiliation(s)
- Jae Ho Sohn
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA.
| | - Yeshwant Reddy Chillakuru
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
- School of Medicine and Health Sciences, The George Washington University, Washington, DC, 20037, USA
| | - Stanley Lee
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Amie Y Lee
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Tatiana Kelil
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Christopher Paul Hess
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Youngho Seo
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Thienkhai Vu
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Bonnie N Joe
- Radiology and Biomedical Imaging, University of California San Francisco (UCSF), 505 Parnassus Ave, San Francisco, CA, 94143, USA
| |
Collapse
|
11
|
Filice RW, Ratwani RM. The Case for User-Centered Artificial Intelligence in Radiology. Radiol Artif Intell 2020; 2:e190095. [PMID: 33937824 PMCID: PMC8082296 DOI: 10.1148/ryai.2020190095] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 12/14/2019] [Accepted: 01/06/2020] [Indexed: 06/12/2023]
Abstract
Past technology transition successes and failures have demonstrated the importance of user-centered design and the science of human factors; these approaches will be critical to the success of artificial intelligence in radiology.
Collapse
|
12
|
Challenges of Implementing Picture Archiving and Communication System in Multiple Hospitals: Perspectives of Involved Staff and Users. J Med Syst 2019; 43:182. [PMID: 31093803 DOI: 10.1007/s10916-019-1319-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2018] [Accepted: 05/01/2019] [Indexed: 10/26/2022]
Abstract
Today, despite the advantages of the PACS system, its implementation in some healthcare organizations faces many challenges. One of the important factors in the successful implementation of a PACS system is identifying and prioritizing the challenges from the perspectives of involved staff and user of this system. Therefore, the aim of this study was to determine and compare the challenges of implementing PACS from perspectives these users in educational hospitals. This study was conducted on all IT and medical equipment staff, and radiology residents (n = 140) in Kerman University of Medical Sciences (KUMS) and Shiraz University of Medical Sciences (SUMS) in 2016. The data were collected through two researcher-made questionnaires. Their validity was approved by radiologists, IT staff, and medical informatics specialists and their reliability through calculation of Cronbach's Alpha (0.969 and 0.795). We used Multivariate Analysis of Variance (MANOVA) to compare the scores given by three groups of participants in the challenges and Univariate Analysis of Variance (ANOVA) to compare the scores in two universities. The participants believed that technical challenges were more important than other challenges (x̄=3.74, SD = 0.7). IT experts (x̄=3.87, SD = 1) and radiology residents (x̄=3.95, SD = 0.9) gave the higher scores to the "shortage of high quality monitors" factor and medical equipment experts (x̄=4.26, SD = 0.87) to the "low speed of communication networks" factor among all technical challenges. The mean scores given to technical (x̄=76.1, SD = 13.5) and managerial (x̄=16, SD = 5.9) challenges in SUMS were more than the scores of the same challenges in KUMS (x̄=69.9, SD = 15.7) and (x̄=11.9, SD = 6.4) (p < 0.05). The technical challenges are the most common challenges to PACS implementation, and different universities experience different levels of technical challenges. Eliminating implementation challenges can reduce the risk of failure in the utilization process. Based on the results of this study, providing necessary infrastructures such as appropriate monitors and upgraded IT equipment can prevent many of the PACS implementation challenges.
Collapse
|