1
|
Lindroth H, Nalaie K, Raghu R, Ayala IN, Busch C, Bhattacharyya A, Moreno Franco P, Diedrich DA, Pickering BW, Herasevich V. Applied Artificial Intelligence in Healthcare: A Review of Computer Vision Technology Application in Hospital Settings. J Imaging 2024; 10:81. [PMID: 38667979 PMCID: PMC11050909 DOI: 10.3390/jimaging10040081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 03/08/2024] [Accepted: 03/11/2024] [Indexed: 04/28/2024] Open
Abstract
Computer vision (CV), a type of artificial intelligence (AI) that uses digital videos or a sequence of images to recognize content, has been used extensively across industries in recent years. However, in the healthcare industry, its applications are limited by factors like privacy, safety, and ethical concerns. Despite this, CV has the potential to improve patient monitoring, and system efficiencies, while reducing workload. In contrast to previous reviews, we focus on the end-user applications of CV. First, we briefly review and categorize CV applications in other industries (job enhancement, surveillance and monitoring, automation, and augmented reality). We then review the developments of CV in the hospital setting, outpatient, and community settings. The recent advances in monitoring delirium, pain and sedation, patient deterioration, mechanical ventilation, mobility, patient safety, surgical applications, quantification of workload in the hospital, and monitoring for patient events outside the hospital are highlighted. To identify opportunities for future applications, we also completed journey mapping at different system levels. Lastly, we discuss the privacy, safety, and ethical considerations associated with CV and outline processes in algorithm development and testing that limit CV expansion in healthcare. This comprehensive review highlights CV applications and ideas for its expanded use in healthcare.
Collapse
Affiliation(s)
- Heidi Lindroth
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (R.R.); (I.N.A.); (C.B.)
- Center for Aging Research, Regenstrief Institute, School of Medicine, Indiana University, Indianapolis, IN 46202, USA
- Center for Health Innovation and Implementation Science, School of Medicine, Indiana University, Indianapolis, IN 46202, USA
| | - Keivan Nalaie
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (R.R.); (I.N.A.); (C.B.)
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (D.A.D.); (B.W.P.); (V.H.)
| | - Roshini Raghu
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (R.R.); (I.N.A.); (C.B.)
| | - Ivan N. Ayala
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (R.R.); (I.N.A.); (C.B.)
| | - Charles Busch
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (R.R.); (I.N.A.); (C.B.)
- College of Engineering, University of Wisconsin-Madison, Madison, WI 53705, USA
| | | | - Pablo Moreno Franco
- Department of Transplantation Medicine, Mayo Clinic, Jacksonville, FL 32224, USA
| | - Daniel A. Diedrich
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (D.A.D.); (B.W.P.); (V.H.)
| | - Brian W. Pickering
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (D.A.D.); (B.W.P.); (V.H.)
| | - Vitaly Herasevich
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (D.A.D.); (B.W.P.); (V.H.)
| |
Collapse
|
2
|
The Application of Artificial Intelligence in Prostate Cancer Management—What Improvements Can Be Expected? A Systematic Review. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10186428] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Artificial Intelligence (AI) is progressively remodeling our daily life. A large amount of information from “big data” now enables machines to perform predictions and improve our healthcare system. AI has the potential to reshape prostate cancer (PCa) management thanks to growing applications in the field. The purpose of this review is to provide a global overview of AI in PCa for urologists, pathologists, radiotherapists, and oncologists to consider future changes in their daily practice. A systematic review was performed, based on PubMed MEDLINE, Google Scholar, and DBLP databases for original studies published in English from January 2009 to January 2019 relevant to PCa, AI, Machine Learning, Artificial Neural Networks, Convolutional Neural Networks, and Natural-Language Processing. Only articles with full text accessible were considered. A total of 1008 articles were reviewed, and 48 articles were included. AI has potential applications in all fields of PCa management: analysis of genetic predispositions, diagnosis in imaging, and pathology to detect PCa or to differentiate between significant and non-significant PCa. AI also applies to PCa treatment, whether surgical intervention or radiotherapy, skills training, or assessment, to improve treatment modalities and outcome prediction. AI in PCa management has the potential to provide a useful role by predicting PCa more accurately, using a multiomic approach and risk-stratifying patients to provide personalized medicine.
Collapse
|
3
|
Daniel M, Kuess P, Andrzejewski P, Nyholm T, Helbich T, Polanec S, Dragschitz F, Goldner G, Georg D, Baltzer P. Impact of androgen deprivation therapy on apparent diffusion coefficient and T2w MRI for histogram and texture analysis with respect to focal radiotherapy of prostate cancer. Strahlenther Onkol 2019; 195:402-411. [PMID: 30478670 PMCID: PMC6488548 DOI: 10.1007/s00066-018-1402-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2018] [Accepted: 11/12/2018] [Indexed: 12/20/2022]
Abstract
PURPOSE Accurate prostate cancer (PCa) detection is essential for planning focal external beam radiotherapy (EBRT). While biparametric MRI (bpMRI) including T2-weighted (T2w) and diffusion-weighted images (DWI) is an accurate tool to localize PCa, its value is less clear in the case of additional androgen deprivation therapy (ADT). The aim of this study was to investigate the value of a textural feature (TF) approach on bpMRI analysis in prostate cancer patients with and without neoadjuvant ADT with respect to future dose-painting applications. METHODS 28 PCa patients (54-80 years) with (n = 14) and without (n = 14) ADT who underwent bpMRI with T2w and DWI were analyzed retrospectively. Lesions, central gland (CG), and peripheral zone (PZ) were delineated by an experienced urogenital radiologist based on localized pre-therapeutic histopathology. Histogram parameters and 20 Haralick TF were calculated. Regional differences (i. e., tumor vs. PZ, tumor vs. CG) were analyzed for all imaging parameters. Receiver-operating characteristic (ROC) analysis was performed to measure diagnostic performance to distinguish PCa from benign prostate tissue and to identify the features with best discriminative power in both patient groups. RESULTS The obtained sensitivities were equivalent or superior when utilizing the TF in the no-ADT group, while specificity was higher for the histogram parameters. However, in the ADT group, TF outperformed the conventional histogram parameters in both specificity and sensitivity. Rule-in and rule-out criteria for ADT patients could exclusively be defined with the aid of TF. CONCLUSIONS The TF approach has the potential for quantitative image-assisted boost volume delineation in PCa patients even if they are undergoing neoadjuvant ADT.
Collapse
Affiliation(s)
- M Daniel
- Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna, Vienna, Austria.
- Department of Radiotherapy, Comprehensive Cancer Center, Medical University of Vienna/Vienna General Hospital, Vienna, Austria.
| | - P Kuess
- Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna, Vienna, Austria
- Department of Radiotherapy, Comprehensive Cancer Center, Medical University of Vienna/Vienna General Hospital, Vienna, Austria
| | - P Andrzejewski
- Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna, Vienna, Austria
- Medical Physics, EBG MedAustron GmbH, Wiener Neustadt, Austria
| | - T Nyholm
- Department of Radiation Sciences, Umeå University, Umeå, Sweden
| | - T Helbich
- Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna, Vienna, Austria
| | - S Polanec
- Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna, Vienna, Austria
- Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna/Vienna General Hospital, Vienna, Austria
| | - F Dragschitz
- Department of Radiotherapy, Comprehensive Cancer Center, Medical University of Vienna/Vienna General Hospital, Vienna, Austria
| | - G Goldner
- Department of Radiotherapy, Comprehensive Cancer Center, Medical University of Vienna/Vienna General Hospital, Vienna, Austria
| | - D Georg
- Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna, Vienna, Austria
- Department of Radiotherapy, Comprehensive Cancer Center, Medical University of Vienna/Vienna General Hospital, Vienna, Austria
| | - P Baltzer
- Christian Doppler Laboratory for Medical Radiation Research for Radiation Oncology, Medical University of Vienna, Vienna, Austria
- Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna/Vienna General Hospital, Vienna, Austria
| |
Collapse
|
4
|
Gautam D, Ahmed M, Meena YK, Ul Haq A. Machine learning-based diagnosis of melanoma using macro images. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2018; 34:e2953. [PMID: 29266819 DOI: 10.1002/cnm.2953] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Cancer bears a poisoning threat to human society. Melanoma, the skin cancer, originates from skin layers and penetrates deep into subcutaneous layers. There exists an extensive research in melanoma diagnosis using dermatoscopic images captured through a dermatoscope. While designing a diagnostic model for general handheld imaging systems is an emerging trend, this article proposes a computer-aided decision support system for macro images captured by a general-purpose camera. General imaging conditions are adversely affected by nonuniform illumination, which further affects the extraction of relevant information. To mitigate it, we process an image to define a smooth illumination surface using the multistage illumination compensation approach, and the infected region is extracted using the proposed multimode segmentation method. The lesion information is numerated as a feature set comprising geometry, photometry, border series, and texture measures. The redundancy in feature set is reduced using information theory methods, and a classification boundary is modeled to distinguish benign and malignant samples using support vector machine, random forest, neural network, and fast discriminative mixed-membership-based naive Bayesian classifiers. Moreover, the experimental outcome is supported by hypothesis testing and boxplot representation for classification losses. The simulation results prove the significance of the proposed model that shows an improved performance as compared with competing arts.
Collapse
Affiliation(s)
- Diwakar Gautam
- Malaviya National Institute of Technology, Jaipur, India
| | - Mushtaq Ahmed
- Malaviya National Institute of Technology, Jaipur, India
| | | | | |
Collapse
|
5
|
Abraham B, Nair MS. Computer-aided diagnosis of clinically significant prostate cancer from MRI images using sparse autoencoder and random forest classifier. Biocybern Biomed Eng 2018. [DOI: 10.1016/j.bbe.2018.06.009] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
6
|
|
7
|
Rampun A, Tiddeman B, Zwiggelaar R, Malcolm P. Computer aided diagnosis of prostate cancer: A texton based approach. Med Phys 2016; 43:5412. [PMID: 27782724 PMCID: PMC5035312 DOI: 10.1118/1.4962031] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2016] [Revised: 08/02/2016] [Accepted: 08/19/2016] [Indexed: 12/19/2022] Open
Abstract
PURPOSE In this paper the authors propose a texton based prostate computer aided diagnosis approach which bypasses the typical feature extraction process such as filtering and convolution which can be computationally expensive. The study focuses the peripheral zone because 75% of prostate cancers start within this region and the majority of prostate cancers arising within this region are more aggressive than those arising in the transitional zone. METHODS For the model development, square patches were extracted at random locations from malignant and benign regions. Subsequently, extracted patches were aggregated and clustered using k-means clustering to generate textons that represent both regions. All textons together form a texton dictionary, which was used to construct a texton map for every peripheral zone in the training images. Based on the texton map, histogram models for each malignant and benign tissue samples were constructed and used as a feature vector to train our classifiers. In the testing phase, four machine learning algorithms were employed to classify each unknown sample tissue based on its corresponding feature vector. RESULTS The proposed method was tested on 418 T2-W MR images taken from 45 patients. Evaluation results show that the best three classifiers were Bayesian network (Az = 92.8% ± 5.9%), random forest (89.5% ± 7.1%), and k-NN (86.9% ± 7.5%). These results are comparable to the state-of-the-art in the literature. CONCLUSIONS The authors have developed a prostate computer aided diagnosis method based on textons using a single modality of T2-W MRI without the need for the typical feature extraction methods, such as filtering and convolution. The proposed method could form a solid basis for a multimodality magnetic resonance imaging based systems.
Collapse
Affiliation(s)
- Andrik Rampun
- Department of Computer Science, Aberystwyth University, Aberystwyth, Ceredigion SY23 3DB, United Kingdom
| | - Bernie Tiddeman
- Department of Computer Science, Aberystwyth University, Aberystwyth, Ceredigion SY23 3DB, United Kingdom
| | - Reyer Zwiggelaar
- Department of Computer Science, Aberystwyth University, Aberystwyth, Ceredigion SY23 3DB, United Kingdom
| | - Paul Malcolm
- Department of Radiology, Norfolk & Norwich University Hospital, Norwich NR4 7UY, United Kingdom
| |
Collapse
|