1
|
Liao X, Yao C, Zhang J, Liu LZ. Recent advancement in integrating artificial intelligence and information technology with real-world data for clinical decision-making in China: A scoping review. J Evid Based Med 2023; 16:534-546. [PMID: 37772921 DOI: 10.1111/jebm.12549] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 08/31/2023] [Indexed: 09/30/2023]
Abstract
OBJECTIVE Striking innovations and advancements have been achieved with the use of artificial intelligence and healthcare information technology being integrated into clinical real-world data. The current scoping review aimed to provide an overview of the current status of artificial intelligence-/information technology-based clinical decision support tools in China. METHODS PubMed/MEDLINE, Embase, China National Knowledge Internet, and Wanfang data were searched for both English and Chinese literature. The gray literature search was conducted for commercially available tools. Original studies that focused on clinical decision support tools driven by artificial intelligence or information technology in China and were published between 2010 and February 2022 were included. Information extracted from each article was further synthesized by themes based on three types of clinical decision-making. RESULTS A total of 37 peer-reviewed publications and 13 commercially available tools were included in the final analysis. Among them, 32.0% were developed for disease diagnosis, 54.0% for risk prediction and classification, and 14.0% for disease management. Chronic diseases were the most popular therapeutic areas of exploration, with particular emphasis on cardiovascular and cerebrovascular diseases. Single-center electronic medical records were the mainstream data sources leveraged to inform clinical decision-making, with internal validation being predominately used for model evaluation. CONCLUSIONS To effectively promote the extensive use of real-world data and drive a paradigm shift in clinical decision-making in China, multidisciplinary collaboration of key stakeholders is urgently needed.
Collapse
Affiliation(s)
- Xiwen Liao
- Peking University Clinical Research Institute, Peking University First Hospital, Beijing, China
| | - Chen Yao
- Peking University Clinical Research Institute, Peking University First Hospital, Beijing, China
- Hainan Institute of Real World Data, Qionghai, Hainan, China
| | - Jun Zhang
- Center for Observational and Real-world Evidence (CORE), MSD R&D (China) Co., Ltd., Beijing, China
| | - Larry Z Liu
- Center for Observational and Real-world Evidence (CORE), Merck & Co Inc, Rahway, Rahway, New Jersey, USA
- Department of Population Health Sciences, Weill Cornell Medical College, New York City, New York, USA
| |
Collapse
|
2
|
Jimenez-Mesa C, Arco JE, Martinez-Murcia FJ, Suckling J, Ramirez J, Gorriz JM. Applications of machine learning and deep learning in SPECT and PET imaging: General overview, challenges and future prospects. Pharmacol Res 2023; 197:106984. [PMID: 37940064 DOI: 10.1016/j.phrs.2023.106984] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 10/04/2023] [Accepted: 11/04/2023] [Indexed: 11/10/2023]
Abstract
The integration of positron emission tomography (PET) and single-photon emission computed tomography (SPECT) imaging techniques with machine learning (ML) algorithms, including deep learning (DL) models, is a promising approach. This integration enhances the precision and efficiency of current diagnostic and treatment strategies while offering invaluable insights into disease mechanisms. In this comprehensive review, we delve into the transformative impact of ML and DL in this domain. Firstly, a brief analysis is provided of how these algorithms have evolved and which are the most widely applied in this domain. Their different potential applications in nuclear imaging are then discussed, such as optimization of image adquisition or reconstruction, biomarkers identification, multimodal fusion and the development of diagnostic, prognostic, and disease progression evaluation systems. This is because they are able to analyse complex patterns and relationships within imaging data, as well as extracting quantitative and objective measures. Furthermore, we discuss the challenges in implementation, such as data standardization and limited sample sizes, and explore the clinical opportunities and future horizons, including data augmentation and explainable AI. Together, these factors are propelling the continuous advancement of more robust, transparent, and reliable systems.
Collapse
Affiliation(s)
- Carmen Jimenez-Mesa
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain
| | - Juan E Arco
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain; Department of Communications Engineering, University of Malaga, 29010, Spain
| | | | - John Suckling
- Department of Psychiatry, University of Cambridge, Cambridge CB21TN, UK
| | - Javier Ramirez
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain
| | - Juan Manuel Gorriz
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain; Department of Psychiatry, University of Cambridge, Cambridge CB21TN, UK.
| |
Collapse
|
3
|
Lin C, Chang YC, Chiu HY, Cheng CH, Huang HM. Differentiation between normal and abnormal kidneys using 99mTc-DMSA SPECT with deep learning in paediatric patients. Clin Radiol 2023; 78:584-589. [PMID: 37244824 DOI: 10.1016/j.crad.2023.04.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 04/24/2023] [Accepted: 04/26/2023] [Indexed: 05/29/2023]
Abstract
AIM To investigate the feasibility of using deep learning (DL) to differentiate normal from abnormal (or scarred) kidneys using technetium-99m dimercaptosuccinic acid (99mTc-DMSA) single-photon-emission computed tomography (SPECT) in paediatric patients. MATERIAL AND METHODS Three hundred and one 99mTc-DMSA renal SPECT examinations were reviewed retrospectively. The 301 patients were split randomly into 261, 20, and 20 for training, validation, and testing data, respectively. The DL model was trained using three-dimensional (3D) SPECT images, two-dimensional (2D) maximum intensity projections (MIPs), and 2.5-dimensional (2.5D) MIPs (i.e., transverse, sagittal, and coronal views). Each DL model was trained to determine renal SPECT images into either normal or abnormal. Consensus reading results by two nuclear medicine physicians served as the reference standard. RESULTS The DL model trained by 2.5D MIPs outperformed that trained by either 3D SPECT images or 2D MIPs. The accuracy, sensitivity, and specificity of the 2.5D model for the differentiation between normal and abnormal kidneys were 92.5%, 90% and 95%, respectively. CONCLUSION The experimental results suggest that DL has the potential to differentiate normal from abnormal kidneys in children using 99mTc-DMSA SPECT imaging.
Collapse
Affiliation(s)
- C Lin
- Department of Nuclear Medicine, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Gueishan District, Taoyuan 33305, Taiwan; School of Chinese Medicine, Chang Gung University, No. 259, Wenhua 1st Rd, Guishan District, Taoyuan 33302, Taiwan
| | - Y-C Chang
- Department of Nuclear Medicine, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Gueishan District, Taoyuan 33305, Taiwan; Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, No. 259, Wenhua 1st Rd, Guishan District, Taoyuan 33302, Taiwan
| | - H-Y Chiu
- Department of Nuclear Medicine, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Gueishan District, Taoyuan 33305, Taiwan
| | - C-H Cheng
- Department of Pediatrics, Chang Gung University, No. 259, Wenhua 1st Rd, Guishan District, Taoyuan 33302, Taiwan; Department of Pediatrics, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Gueishan District, Taoyuan 33305, Taiwan
| | - H-M Huang
- Institute of Medical Device and Imaging, College of Medicine, National Taiwan University, No. 1, Sec. 1, Jen Ai Rd, Zhongzheng District, Taipei City 100, Taiwan.
| |
Collapse
|
4
|
Garcea F, Serra A, Lamberti F, Morra L. Data augmentation for medical imaging: A systematic literature review. Comput Biol Med 2023; 152:106391. [PMID: 36549032 DOI: 10.1016/j.compbiomed.2022.106391] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Revised: 11/22/2022] [Accepted: 11/29/2022] [Indexed: 12/13/2022]
Abstract
Recent advances in Deep Learning have largely benefited from larger and more diverse training sets. However, collecting large datasets for medical imaging is still a challenge due to privacy concerns and labeling costs. Data augmentation makes it possible to greatly expand the amount and variety of data available for training without actually collecting new samples. Data augmentation techniques range from simple yet surprisingly effective transformations such as cropping, padding, and flipping, to complex generative models. Depending on the nature of the input and the visual task, different data augmentation strategies are likely to perform differently. For this reason, it is conceivable that medical imaging requires specific augmentation strategies that generate plausible data samples and enable effective regularization of deep neural networks. Data augmentation can also be used to augment specific classes that are underrepresented in the training set, e.g., to generate artificial lesions. The goal of this systematic literature review is to investigate which data augmentation strategies are used in the medical domain and how they affect the performance of clinical tasks such as classification, segmentation, and lesion detection. To this end, a comprehensive analysis of more than 300 articles published in recent years (2018-2022) was conducted. The results highlight the effectiveness of data augmentation across organs, modalities, tasks, and dataset sizes, and suggest potential avenues for future research.
Collapse
Affiliation(s)
- Fabio Garcea
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy
| | - Alessio Serra
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy
| | - Fabrizio Lamberti
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy
| | - Lia Morra
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy.
| |
Collapse
|
5
|
Integrating Transfer Learning and Feature Aggregation into Self-defined Convolutional Neural Network for Automated Detection of Lung Cancer Bone Metastasis. J Med Biol Eng 2022. [DOI: 10.1007/s40846-022-00770-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
|
6
|
Lin Q, Gao R, Luo M, Wang H, Cao Y, Man Z, Wang R. Semi-supervised segmentation of metastasis lesions in bone scan images. Front Mol Biosci 2022; 9:956720. [DOI: 10.3389/fmolb.2022.956720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 10/13/2022] [Indexed: 11/13/2022] Open
Abstract
To develop a deep image segmentation model that automatically identifies and delineates lesions of skeletal metastasis in bone scan images, facilitating clinical diagnosis of lung cancer–caused bone metastasis by nuclear medicine physicians. A semi-supervised segmentation model is proposed, comprising the feature extraction subtask and pixel classification subtask. During the feature extraction stage, cascaded layers which include the dilated residual convolution, inception connection, and feature aggregation learn the hierarchal representations of low-resolution bone scan images. During the pixel classification stage, each pixel is first classified into categories in a semi-supervised manner, and the boundary of pixels belonging to an individual lesion is then delineated using a closed curve. Experimental evaluation conducted on 2,280 augmented samples (112 original images) demonstrates that the proposed model performs well for automated segmentation of metastasis lesions, with a score of 0.692 for DSC if the model is trained using 37% of the labeled samples. The self-defined semi-supervised segmentation model can be utilized as an automated clinical tool to detect and delineate metastasis lesions in bone scan images, using only a few manually labeled image samples. Nuclear medicine physicians need only attend to those segmented lesions while ignoring the background when they diagnose bone metastasis using low-resolution images. More images of patients from multiple centers are typically needed to further improve the scalability and performance of the model via mitigating the impacts of variability in size, shape, and intensity of bone metastasis lesions.
Collapse
|
7
|
Guo Y, Lin Q, Zhao S, Li T, Cao Y, Man Z, Zeng X. Automated detection of lung cancer-caused metastasis by classifying scintigraphic images using convolutional neural network with residual connection and hybrid attention mechanism. Insights Imaging 2022; 13:24. [PMID: 35138479 PMCID: PMC8828823 DOI: 10.1186/s13244-022-01162-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Accepted: 01/20/2022] [Indexed: 12/03/2022] Open
Abstract
Background Whole-body bone scan is the widely used tool for surveying bone metastases caused by various primary solid tumors including lung cancer. Scintigraphic images are characterized by low specificity, bringing a significant challenge to manual analysis of images by nuclear medicine physicians. Convolutional neural network can be used to develop automated classification of images by automatically extracting hierarchal features and classifying high-level features into classes. Results Using convolutional neural network, a multi-class classification model has been developed to detect skeletal metastasis caused by lung cancer using clinical whole-body scintigraphic images. The proposed method consisted of image aggregation, hierarchal feature extraction, and high-level feature classification. Experimental evaluations on a set of clinical scintigraphic images have shown that the proposed multi-class classification network is workable for automated detection of lung cancer-caused metastasis, with achieving average scores of 0.7782, 0.7799, 0.7823, 0.7764, and 0.8364 for accuracy, precision, recall, F-1 score, and AUC value, respectively. Conclusions The proposed multi-class classification model can not only predict whether an image contains lung cancer-caused metastasis, but also differentiate between subclasses of lung cancer (i.e., adenocarcinoma and non-adenocarcinoma). On the context of two-class (i.e., the metastatic and non-metastatic) classification, the proposed model obtained a higher score of 0.8310 for accuracy metric.
Collapse
Affiliation(s)
- Yanru Guo
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China
| | - Qiang Lin
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China. .,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China. .,Key Laboratory of China's Ethnic Languages and Information Technology of Ministry of Education, Northwest Minzu University, Lanzhou, Gansu, China.
| | - Shaofang Zhao
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China
| | - Tongtong Li
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China
| | - Yongchun Cao
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of China's Ethnic Languages and Information Technology of Ministry of Education, Northwest Minzu University, Lanzhou, Gansu, China
| | - Zhengxing Man
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of China's Ethnic Languages and Information Technology of Ministry of Education, Northwest Minzu University, Lanzhou, Gansu, China
| | - Xianwu Zeng
- Department of Nuclear Medicine, Gansu Provincial Tumor Hospital, Lanzhou, Gansu, China.
| |
Collapse
|
8
|
Li T, Lin Q, Guo Y, Zhao S, Zeng X, Man Z, Cao Y, Hu Y. Automated detection of skeletal metastasis of lung cancer with bone scans using convolutional nuclear network. Phys Med Biol 2021; 67. [PMID: 34933282 DOI: 10.1088/1361-6560/ac4565] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Accepted: 12/21/2021] [Indexed: 11/12/2022]
Abstract
Bone scan is widely used for surveying bone metastases caused by various solid tumors. Scintigraphic images are characterized by inferior spatial resolution, bringing a significant challenge to manual analysis of images by nuclear medicine physicians. We present in this work a new framework for automatically classifying scintigraphic images collected from patients clinically diagnosed with lung cancer. The framework consists of data preparation and image classification. In the data preparation stage, data augmentation is used to enlarge the dataset, followed by image fusion and thoracic region extraction. In the image classification stage, we use a self-defined convolutional neural network consisting of feature extraction, feature aggregation, and feature classification sub-networks. The developed multi-class classification network can not only predict whether a bone scan image contains bone metastasis but also tell which subcategory of lung cancer that a bone metastasis metastasized from is present in the image. Experimental evaluations on a set of clinical bone scan images have shown that the proposed multi-class classification network is workable for automated classification of metastatic images, with achieving average scores of 0.7392, 0.7592, 0.7242, and 0.7292 for accuracy, precision, recall, and F-1 score, respectively.
Collapse
Affiliation(s)
- Tongtong Li
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Qiang Lin
- School of Mathematics and Computer Science, Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, 730030, CHINA
| | - Yanru Guo
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Shaofang Zhao
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Xianwu Zeng
- Gansu Provincial Cancer Hospital, No. 2, Dongjie Rd., Lanzhou, Gansu, 730050, CHINA
| | - Zhengxing Man
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Yongchun Cao
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Yonghua Hu
- Gansu University of Chinese Medicine, No. 35, Dingxi Donglu Rd., Lanzhou, 730000, CHINA
| |
Collapse
|