1
|
Wen X, Liang B, Zhao B, Hu X, Yuan M, Hu W, Liu T, Yang Y, Xing D. Application of FGD-BCEL loss function in segmenting temporal lobes on localized CT images for radiotherapy. Front Oncol 2023; 13:1204044. [PMID: 37869086 PMCID: PMC10585164 DOI: 10.3389/fonc.2023.1204044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 09/13/2023] [Indexed: 10/24/2023] Open
Abstract
Objectives The aim of this study was to find a new loss function to automatically segment temporal lobes on localized CT images for radiotherapy with more accuracy and a solution to dealing with the classification of class-imbalanced samples in temporal lobe segmentation. Methods Localized CT images for radiotherapy of 70 patients with nasopharyngeal carcinoma were selected. Radiation oncologists sketched mask maps. The dataset was randomly divided into the training set (n = 49), the validation set (n = 7), and the test set (n = 14). The training set was expanded by rotation, flipping, zooming, and shearing, and the models were evaluated using Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), positive predictive value (PPV), sensitivity (SE), and Hausdorff distance (HD). This study presented an improved loss function, focal generalized Dice-binary cross-entropy loss (FGD-BCEL), and compared it with four other loss functions, Dice loss (DL), generalized Dice loss (GDL), Tversky loss (TL), and focal Tversky loss (FTL), using the U-Net model framework. Results With the U-Net model based on FGD-BCEL, the DSC, JSC, PPV, SE, and HD were 0.87 ± 0.11, 0.78 ± 0.11, 0.90 ± 0.10, 0.87 ± 0.13, and 4.11 ± 0.75, respectively. Except for the SE, all the other evaluation metric values of the temporal lobes segmented by the FGD-BCEL-based U-Net model were improved compared to the DL, GDL, TL, and FTL loss function-based U-Net models. Moreover, the FGD-BCEL-based U-Net model was morphologically more similar to the mask maps. The over- and under-segmentation was lessened, and it effectively segmented the tiny structures in the upper and lower poles of the temporal lobe with a limited number of samples. Conclusions For the segmentation of the temporal lobe on localized CT images for radiotherapy, the U-Net model based on the FGD-BCEL can meet the basic clinical requirements and effectively reduce the over- and under-segmentation compared with the U-Net models based on the other four loss functions. However, there still exists some over- and under-segmentation in the results, and further improvement is needed.
Collapse
Affiliation(s)
- Xiaobo Wen
- The Affiliated Hospital of Qingdao University, Qingdao University, Qingdao, China
- Department of Radiotherapy, Yunnan Cancer Hospital, the Third Affiliated Hospital of Kunming Medical University, Kunming, Yunnan, China
- School of Pharmacy, Qingdao University, Qingdao, China
- Qingdao Cancer Institute, Qingdao University, Qingdao, China
| | - Bing Liang
- The Affiliated Hospital of Qingdao University, Qingdao University, Qingdao, China
- Qingdao Cancer Institute, Qingdao University, Qingdao, China
- School of Basic Medicine, Qingdao University, Qingdao, China
| | - Biao Zhao
- Department of Radiotherapy, Yunnan Cancer Hospital, the Third Affiliated Hospital of Kunming Medical University, Kunming, Yunnan, China
| | - Xiaokun Hu
- Affiliated Hospital of Qingdao University, Interventional Medicine Center, Qingdao, Shandong, China
| | - Meifang Yuan
- Department of Radiotherapy, Yunnan Cancer Hospital, the Third Affiliated Hospital of Kunming Medical University, Kunming, Yunnan, China
| | - Wenchao Hu
- Department of Endocrinology Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University, Qingdao, Shandong, China
| | - Ting Liu
- The Affiliated Hospital of Qingdao University, Qingdao University, Qingdao, China
- School of Pharmacy, Qingdao University, Qingdao, China
- Qingdao Cancer Institute, Qingdao University, Qingdao, China
| | - Yi Yang
- Department of Radiotherapy, Yunnan Cancer Hospital, the Third Affiliated Hospital of Kunming Medical University, Kunming, Yunnan, China
| | - Dongming Xing
- The Affiliated Hospital of Qingdao University, Qingdao University, Qingdao, China
- School of Pharmacy, Qingdao University, Qingdao, China
- Qingdao Cancer Institute, Qingdao University, Qingdao, China
- School of Basic Medicine, Qingdao University, Qingdao, China
- School of Life Sciences, Tsinghua University, Beijing, China
| |
Collapse
|
2
|
Wen X, Zhao B, Yuan M, Li J, Sun M, Ma L, Sun C, Yang Y. Application of Multi-Scale Fusion Attention U-Net to Segment the Thyroid Gland on Localized Computed Tomography Images for Radiotherapy. Front Oncol 2022; 12:844052. [PMID: 35720003 PMCID: PMC9204279 DOI: 10.3389/fonc.2022.844052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Accepted: 04/26/2022] [Indexed: 12/24/2022] Open
Abstract
Objective To explore the performance of Multi-scale Fusion Attention U-Net (MSFA-U-Net) in thyroid gland segmentation on localized computed tomography (CT) images for radiotherapy. Methods We selected localized radiotherapeutic CT images from 80 patients with breast cancer or head and neck tumors; label images were manually delineated by experienced radiologists. The data set was randomly divided into the training set (n = 60), the validation set (n = 10), and the test set (n = 10). We expanded the data in the training set and evaluated the performance of the MSFA-U-Net model using the evaluation indices Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), positive predictive value (PPV), sensitivity (SE), and Hausdorff distance (HD). Results For the MSFA-U-Net model, the DSC, JSC, PPV, SE, and HD values of the segmented thyroid gland in the test set were 0.90 ± 0.09, 0.82± 0.11, 0.91 ± 0.09, 0.90 ± 0.11, and 2.39 ± 0.54, respectively. Compared with U-Net, HRNet, and Attention U-Net, MSFA-U-Net increased DSC by 0.04, 0.06, and 0.04, respectively; increased JSC by 0.05, 0.08, and 0.04, respectively; increased SE by 0.04, 0.11, and 0.09, respectively; and reduced HD by 0.21, 0.20, and 0.06, respectively. The test set image results showed that the thyroid edges segmented by the MSFA-U-Net model were closer to the standard thyroid edges delineated by the experts than were those segmented by the other three models. Moreover, the edges were smoother, over-anti-noise interference was stronger, and oversegmentation and undersegmentation were reduced. Conclusion The MSFA-U-Net model could meet basic clinical requirements and improve the efficiency of physicians' clinical work.
Collapse
Affiliation(s)
- Xiaobo Wen
- Department of Radiotherapy, Yunnan Cancer Hospital, Kunming, China
| | - Biao Zhao
- Department of Radiotherapy, Yunnan Cancer Hospital, Kunming, China
| | - Meifang Yuan
- Department of Radiotherapy, Yunnan Cancer Hospital, Kunming, China
| | - Jinzhi Li
- Department of Radiotherapy, Yunnan Cancer Hospital, Kunming, China
| | - Mengzhen Sun
- Department of Radiotherapy, Yunnan Cancer Hospital, Kunming, China
| | - Lishuang Ma
- Department of Radiotherapy, Yunnan Cancer Hospital, Kunming, China
| | - Chaoxi Sun
- Department of Neurosurgery, Yunnan Cancer Hospital, Kunming, China
| | - Yi Yang
- Department of Radiotherapy, Yunnan Cancer Hospital, Kunming, China
| |
Collapse
|
3
|
Ng WT, But B, Choi HCW, de Bree R, Lee AWM, Lee VHF, López F, Mäkitie AA, Rodrigo JP, Saba NF, Tsang RKY, Ferlito A. Application of Artificial Intelligence for Nasopharyngeal Carcinoma Management - A Systematic Review. Cancer Manag Res 2022; 14:339-366. [PMID: 35115832 PMCID: PMC8801370 DOI: 10.2147/cmar.s341583] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 12/25/2021] [Indexed: 12/15/2022] Open
Abstract
INTRODUCTION Nasopharyngeal carcinoma (NPC) is endemic to Eastern and South-Eastern Asia, and, in 2020, 77% of global cases were diagnosed in these regions. Apart from its distinct epidemiology, the natural behavior, treatment, and prognosis are different from other head and neck cancers. With the growing trend of artificial intelligence (AI), especially deep learning (DL), in head and neck cancer care, we sought to explore the unique clinical application and implementation direction of AI in the management of NPC. METHODS The search protocol was performed to collect publications using AI, machine learning (ML) and DL in NPC management from PubMed, Scopus and Embase. The articles were filtered using inclusion and exclusion criteria, and the quality of the papers was assessed. Data were extracted from the finalized articles. RESULTS A total of 78 articles were reviewed after removing duplicates and papers that did not meet the inclusion and exclusion criteria. After quality assessment, 60 papers were included in the current study. There were four main types of applications, which were auto-contouring, diagnosis, prognosis, and miscellaneous applications (especially on radiotherapy planning). The different forms of convolutional neural networks (CNNs) accounted for the majority of DL algorithms used, while the artificial neural network (ANN) was the most frequent ML model implemented. CONCLUSION There is an overall positive impact identified from AI implementation in the management of NPC. With improving AI algorithms, we envisage AI will be available as a routine application in a clinical setting soon.
Collapse
Affiliation(s)
- Wai Tong Ng
- Clinical Oncology Center, The University of Hong Kong-Shenzhen Hospital, Shenzhen, People’s Republic of China
- Department of Clinical Oncology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China
| | - Barton But
- Department of Clinical Oncology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China
| | - Horace C W Choi
- Department of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China
| | - Remco de Bree
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Anne W M Lee
- Clinical Oncology Center, The University of Hong Kong-Shenzhen Hospital, Shenzhen, People’s Republic of China
- Department of Clinical Oncology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China
| | - Victor H F Lee
- Clinical Oncology Center, The University of Hong Kong-Shenzhen Hospital, Shenzhen, People’s Republic of China
- Department of Clinical Oncology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China
| | - Fernando López
- Department of Otolaryngology, Hospital Universitario Central de Asturias (HUCA), Instituto de Investigación Sanitaria del Principado de Asturias (ISPA), Instituto Universitario de Oncología del Principado de Asturias (IUOPA), University of Oviedo, Oviedo, 33011, Spain
- Spanish Biomedical Research Network Centre in Oncology, CIBERONC, Madrid, 28029, Spain
| | - Antti A Mäkitie
- Department of Otorhinolaryngology - Head and Neck Surgery, HUS Helsinki University Hospital and University of Helsinki, Helsinki, Finland
- Research Program in Systems Oncology, Faculty of Medicine, University of Helsinki, Helsinki, Finland
- Division of Ear, Nose and Throat Diseases, Department of Clinical Sciences, Intervention and Technology, Karolinska Institutet and Karolinska University Hospital, Stockholm, Sweden
| | - Juan P Rodrigo
- Department of Otolaryngology, Hospital Universitario Central de Asturias (HUCA), Instituto de Investigación Sanitaria del Principado de Asturias (ISPA), Instituto Universitario de Oncología del Principado de Asturias (IUOPA), University of Oviedo, Oviedo, 33011, Spain
- Spanish Biomedical Research Network Centre in Oncology, CIBERONC, Madrid, 28029, Spain
| | - Nabil F Saba
- Department of Hematology and Medical Oncology, Emory University School of Medicine, Atlanta, GA, USA
| | - Raymond K Y Tsang
- Division of Otorhinolaryngology, Department of Surgery, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, People's Republic of China
| | - Alfio Ferlito
- Coordinator of the International Head and Neck Scientific Group, Padua, Italy
| |
Collapse
|
4
|
张 利, 方 智, 唐 宇, 杨 丰. [Regional classification-guided wavelet Y-Net network for hard exudate segmentation in fundus images]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2021; 41:1250-1259. [PMID: 34549718 PMCID: PMC8527217 DOI: 10.12122/j.issn.1673-4254.2021.08.18] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVE We propose an hard exudate(EX)segmentation algorithm based on regional classification-guided wavelet Y-Net network to eliminate the influence of optic disc on EX segmentation process. METHODS The wavelet Y-Net network was an end-to-end fundus image EX segmentation network, which combined the regional detection of optic disc and hard exudates segmentation by regional classification-guided EX segmentation to effectively reduce the interference of optic disc in EX segmentation.To avoid failure of small EX region segmentation caused by information loss due to down-sampling operation, discrete wavelet transform (DWT) and inverse discrete wavelet transform (IDWT) were introduced to replace the traditional pooling down-sampling and up-sampling operations.Meanwhile, the inception module based on residual connection was used to obtain the multi-scale features.The proposed algorithm was trained and tested on the IDRiD and e-ophtha EX datasets and evaluated at the pixel level. RESULTS For IDRiD and e-ophtha EX datasets, the proposed algorithm achieved accuracy rates of 0.9858 and 0.9938 with AUC values of 0.9880 and 0.9986, respectively. CONCLUSION The proposed method can effectively avoid the influence of the optic disc, retain the image details, and improve the effect of EX segmentation.
Collapse
Affiliation(s)
- 利云 张
- />南方医科大学生物医学工程学院//广东省医学图像处理重点实验室, 广东 广州 510515School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| | - 智文 方
- />南方医科大学生物医学工程学院//广东省医学图像处理重点实验室, 广东 广州 510515School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| | - 宇姣 唐
- />南方医科大学生物医学工程学院//广东省医学图像处理重点实验室, 广东 广州 510515School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| | - 丰 杨
- />南方医科大学生物医学工程学院//广东省医学图像处理重点实验室, 广东 广州 510515School of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| |
Collapse
|