1
|
Yan Q, Wu M, Zhang J, Yang J, Lv G, Qu B, Zhang Y, Yan X, Song J. MRI radiomics and nutritional-inflammatory biomarkers: a powerful combination for predicting progression-free survival in cervical cancer patients undergoing concurrent chemoradiotherapy. Cancer Imaging 2024; 24:144. [PMID: 39449107 PMCID: PMC11515587 DOI: 10.1186/s40644-024-00789-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Accepted: 10/09/2024] [Indexed: 10/26/2024] Open
Abstract
OBJECTIVE This study aims to develop and validate a predictive model that integrates clinical features, MRI radiomics, and nutritional-inflammatory biomarkers to forecast progression-free survival (PFS) in cervical cancer (CC) patients undergoing concurrent chemoradiotherapy (CCRT). The goal is to identify high-risk patients and guide personalized treatment. METHODS We performed a retrospective analysis of 188 patients from two centers, divided into training (132) and validation (56) sets. Clinical data, systemic inflammatory markers, and immune-nutritional indices were collected. Radiomic features from three MRI sequences were extracted and selected for predictive value. We developed and evaluated five models incorporating clinical features, nutritional-inflammatory indicators, and radiomics using C-index. The best-performing model was used to create a nomogram, which was validated through ROC curves, calibration plots, and decision curve analysis (DCA). RESULTS Model 5, which integrates clinical features, Systemic Immune-Inflammation Index (SII), Prognostic Nutritional Index (PNI), and MRI radiomics, showed the highest performance. It achieved a C-index of 0.833 (95% CI: 0.792-0.874) in the training set and 0.789 (95% CI: 0.679-0.899) in the validation set. The nomogram derived from Model 5 effectively stratified patients into risk groups, with AUCs of 0.833, 0.941, and 0.973 for 1-year, 3-year, and 5-year PFS in the training set, and 0.812, 0.940, and 0.944 in the validation set. CONCLUSIONS The integrated model combining clinical features, nutritional-inflammatory biomarkers, and radiomics offers a robust tool for predicting PFS in CC patients undergoing CCRT. The nomogram provides precise predictions, supporting its application in personalized patient management.
Collapse
Affiliation(s)
- Qi Yan
- Cancer Center, Shanxi Bethune Hospital, Third Hospital of Shanxi Medical University, Shanxi Academy of Medical Sciences Tongji Shanxi Hospital, Longcheng Street No.99, Taiyuan, China
| | - Menghan- Wu
- Cancer Center, Tongji Shanxi Hospital, Shanxi Bethune Hospital, Shanxi Academy of Medical Sciences, Third Hospital of Shanxi Medical University, Taiyuan, Shanxi, China
| | - Jing Zhang
- China institute for radiation protection, Taiyuan, China
| | - Jiayang- Yang
- Cancer Center, Tongji Shanxi Hospital, Shanxi Bethune Hospital, Shanxi Academy of Medical Sciences, Third Hospital of Shanxi Medical University, Taiyuan, Shanxi, China
| | - Guannan- Lv
- Gynecological Tumor Treatment Center, the Second People's Hospital of Datong, Cancer Hospital, Datong, China
| | - Baojun- Qu
- Gynecological Tumor Treatment Center, the Second People's Hospital of Datong, Cancer Hospital, Datong, China
| | - Yanping- Zhang
- Imaging Department, the Second People's Hospital of Datong, Cancer Hospital, Datong, China
| | - Xia Yan
- Cancer Center, Tongji Shanxi Hospital, Shanxi Bethune Hospital, Shanxi Academy of Medical Sciences, Third Hospital of Shanxi Medical University, Taiyuan, Shanxi, China.
- Shanxi Provincial Key Laboratory for Translational Nuclear Medicine and Precision Protection, Taiyuan, China.
| | - Jianbo- Song
- Cancer Center, Shanxi Bethune Hospital, Third Hospital of Shanxi Medical University, Shanxi Academy of Medical Sciences Tongji Shanxi Hospital, Longcheng Street No.99, Taiyuan, China.
- Shanxi Provincial Key Laboratory for Translational Nuclear Medicine and Precision Protection, Taiyuan, China.
| |
Collapse
|
2
|
Wu M, Morganti AG, Du H. Editorial: Advances in imaging of cervical cancer. Front Oncol 2024; 14:1421476. [PMID: 38887230 PMCID: PMC11180897 DOI: 10.3389/fonc.2024.1421476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Accepted: 05/24/2024] [Indexed: 06/20/2024] Open
Affiliation(s)
- Mingfu Wu
- Department of Obstetrics and Gynecology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Alessio G. Morganti
- Radiation Oncology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Bologna, Italy
- Radiation Oncology, DIMEC, Alma Mater Studiorum, Bologna University, Bologna, Italy
| | - He Du
- Central Hospital of Enshi Tujia and Miao Autonomous Prefecture, Wuhan University, Enshi, China
| |
Collapse
|
3
|
Wu TC, Liu YL, Chen JH, Chen TY, Ko CC, Lin CY, Kao CY, Yeh LR, Su MY. Radiomics analysis for the prediction of locoregional recurrence of locally advanced oropharyngeal cancer and hypopharyngeal cancer. Eur Arch Otorhinolaryngol 2024; 281:1473-1481. [PMID: 38127096 DOI: 10.1007/s00405-023-08380-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Accepted: 11/27/2023] [Indexed: 12/23/2023]
Abstract
PURPOSE By radiomic analysis of the postcontrast CT images, this study aimed to predict locoregional recurrence (LR) of locally advanced oropharyngeal cancer (OPC) and hypopharyngeal cancer (HPC). METHODS A total of 192 patients with stage III-IV OPC or HPC from two independent cohort were randomly split into a training cohort with 153 cases and a testing cohort with 39 cases. Only primary tumor mass was manually segmented. Radiomic features were extracted using PyRadiomics, and then the support vector machine was used to build the radiomic model with fivefold cross-validation process in the training data set. For each case, a radiomics score was generated to indicate the probability of LR. RESULTS There were 94 patients with LR assigned in the progression group and 98 patients without LR assigned in the stable group. There was no significant difference of TNM staging, treatment strategies and common risk factors between these two groups. For the training data set, the radiomics model to predict LR showed 83.7% accuracy and 0.832 (95% CI 0.72, 0.87) area under the ROC curve (AUC). For the test data set, the accuracy and AUC slightly declined to 79.5% and 0.770 (95% CI 0.64, 0.80), respectively. The sensitivity/specificity of training and test data set for LR prediction were 77.6%/89.6%, and 66.7%/90.5%, respectively. CONCLUSIONS The image-based radiomic approach could provide a reliable LR prediction model in locally advanced OPC and HPC. Early identification of those prone to post-treatment recurrence would be helpful for appropriate adjustments to treatment strategies and post-treatment surveillance.
Collapse
Affiliation(s)
- Te-Chang Wu
- Department of Medical Imaging, Chi-Mei Medical Center, Tainan, Taiwan
- Department of Medical Sciences Industry, Chang Jung Christian University, Tainan, Taiwan
| | - Yan-Lin Liu
- Department of Radiological Sciences, University of California, Irvine, Irvine, CA, USA
| | - Jeon-Hor Chen
- Department of Radiological Sciences, University of California, Irvine, Irvine, CA, USA
- Department of Medical Imaging, E-DA Hospital, Kaohsiung, Taiwan
| | - Tai-Yuan Chen
- Department of Medical Imaging, Chi-Mei Medical Center, Tainan, Taiwan
- Graduate Institute of Medical Sciences, Chang Jung Christian University, Tainan, Taiwan
| | - Ching-Chung Ko
- Department of Medical Imaging, Chi-Mei Medical Center, Tainan, Taiwan
- Center of General Education, Chia Nan University of Pharmacy and Science, Tainan, Taiwan
| | - Chiao-Yun Lin
- Department of Medical Imaging, E-DA Hospital, Kaohsiung, Taiwan
- College of Medicine, I-Shou University, Kaohsiung, Taiwan
| | - Cheng-Yi Kao
- College of Medicine, I-Shou University, Kaohsiung, Taiwan
- Division of Medical Radiology, E-DA Cancer Hospital, Kaohsiung, Taiwan
| | - Lee-Ren Yeh
- Department of Medical Imaging, E-DA Hospital, Kaohsiung, Taiwan.
- Department of Medical Imaging and Radiological Sciences, College of Medicine, I-Shou University, No. 1 Yida Road, Jiaosu Village, Yanchao District, Kaohsiung, 824, Taiwan.
| | - Min-Ying Su
- Department of Radiological Sciences, University of California, Irvine, Irvine, CA, USA
| |
Collapse
|
4
|
Liu H, Cui Y, Chang C, Zhou Z, Zhang Y, Ma C, Yin Y, Wang R. Development and validation of a 18F-FDG PET/CT radiomics nomogram for predicting progression free survival in locally advanced cervical cancer: a retrospective multicenter study. BMC Cancer 2024; 24:150. [PMID: 38291351 PMCID: PMC10826285 DOI: 10.1186/s12885-024-11917-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 01/24/2024] [Indexed: 02/01/2024] Open
Abstract
BACKGROUND The existing staging system cannot meet the needs of accurate survival prediction. Accurate survival prediction for locally advanced cervical cancer (LACC) patients who have undergone concurrent radiochemotherapy (CCRT) can improve their treatment management. Thus, this present study aimed to develop and validate radiomics models based on pretreatment 18Fluorine-fluorodeoxyglucose (18F-FDG) positron emission tomography (PET)-computed tomography (CT) images to accurately predict the prognosis in patients. METHODS The data from 190 consecutive patients with LACC who underwent pretreatment 18F-FDG PET-CT and CCRT at two cancer hospitals were retrospectively analyzed; 176 patients from the same hospital were randomly divided into training (n = 117) and internal validation (n = 50) cohorts. Clinical features were selected from the training cohort using univariate and multivariate Cox proportional hazards models; radiomic features were extracted from PET and CT images and filtered using least absolute shrinkage and selection operator and Cox proportional hazard regression. Three prediction models and a nomogram were then constructed using the previously selected clinical, CT and PET radiomics features. The external validation cohort that was used to validate the models included 23 patients with LACC from another cancer hospital. The predictive performance of the constructed models was evaluated using receiver operator characteristic curves, Kaplan Meier curves, and a nomogram. RESULTS In total, one clinical, one PET radiomics, and three CT radiomics features were significantly associated with progression-free survival in the training cohort. Across all three cohorts, the combined model displayed better efficacy and clinical utility than any of these parameters alone in predicting 3-year progression-free survival (area under curve: 0.661, 0.718, and 0.775; C-index: 0.698, 0.724, and 0.705, respectively) and 5-year progression-free survival (area under curve: 0.661, 0.711, and 0.767; C-index, 0.698, 0.722, and 0.676, respectively). On subsequent construction of a nomogram, the calibration curve demonstrated good agreement between actually observed and nomogram-predicted values. CONCLUSIONS In this study, a clinico-radiomics prediction model was developed and successfully validated using an independent external validation cohort. The nomogram incorporating radiomics and clinical features could be a useful clinical tool for the early and accurate assessment of long-term prognosis in patients with LACC patients who undergo concurrent chemoradiotherapy.
Collapse
Affiliation(s)
- Huiling Liu
- Department of Radiation Oncology, The Third Affillated Teaching Hospital of Xinjiang Medical University, Affilated Cancer Hospital, Urumuqi, China
| | - Yongbin Cui
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University, Shandong Academy of Medical Sciences, Jinan, China
| | - Cheng Chang
- Department of Nuclear Medicine, Third Affiliated Hospital of Xinjiang Medical University, State Key Laboratory of Pathogenesis, Prevention and Treatment of High Incidence Diseases in Central Asia, Urumqi, China
| | - Zichun Zhou
- School of Mechanical, Electrical and Information Engineering, Shandong University, Weihai, China
| | - Yalin Zhang
- Department of Radiation Oncology, The Third Affillated Teaching Hospital of Xinjiang Medical University, Affilated Cancer Hospital, Urumuqi, China
- Xinjiang Key Laboratory of Oncology, Urumqi, China
- Key Laboratory of Cancer Immunotherapy and Radiotherapy, Chinese Academy of Medical Sciences, Urumqi, China
| | - Changsheng Ma
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University, Shandong Academy of Medical Sciences, Jinan, China
| | - Yong Yin
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University, Shandong Academy of Medical Sciences, Jinan, China.
| | - Ruozheng Wang
- Department of Radiation Oncology, The Third Affillated Teaching Hospital of Xinjiang Medical University, Affilated Cancer Hospital, Urumuqi, China.
- Xinjiang Key Laboratory of Oncology, Urumqi, China.
- Key Laboratory of Cancer Immunotherapy and Radiotherapy, Chinese Academy of Medical Sciences, Urumqi, China.
| |
Collapse
|
5
|
Li J, Zhou H, Lu X, Wang Y, Pang H, Cesar D, Liu A, Zhou P. Preoperative prediction of cervical cancer survival using a high-resolution MRI-based radiomics nomogram. BMC Med Imaging 2023; 23:153. [PMID: 37821840 PMCID: PMC10568765 DOI: 10.1186/s12880-023-01111-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Accepted: 09/25/2023] [Indexed: 10/13/2023] Open
Abstract
BACKGROUND Cervical cancer patients receiving radiotherapy and chemotherapy require accurate survival prediction methods. The objective of this study was to develop a prognostic analysis model based on a radiomics score to predict overall survival (OS) in cervical cancer patients. METHODS Predictive models were developed using data from 62 cervical cancer patients who underwent radical hysterectomy between June 2020 and June 2021. Radiological features were extracted from T2-weighted (T2W), T1-weighted (T1W), and diffusion-weighted (DW) magnetic resonance images prior to treatment. We obtained the radiomics score (rad-score) using least absolute shrinkage and selection operator (LASSO) regression and Cox's proportional hazard model. We divided the patients into low- and high-risk groups according to the critical rad-score value, and generated a nomogram incorporating radiological features. We evaluated the model's prediction performance using area under the receiver operating characteristic (ROC) curve (AUC) and classified the participants into high- and low-risk groups based on radiological characteristics. RESULTS The 62 patients were divided into high-risk (n = 43) and low-risk (n = 19) groups based on the rad-score. Four feature parameters were selected via dimensionality reduction, and the scores were calculated after modeling. The AUC values of ROC curves for prediction of 3- and 5-year OS using the model were 0.84 and 0.93, respectively. CONCLUSION Our nomogram incorporating a combination of radiological features demonstrated good performance in predicting cervical cancer OS. This study highlights the potential of radiomics analysis in improving survival prediction for cervical cancer patients. However, further studies on a larger scale and external validation cohorts are necessary to validate its potential clinical utility.
Collapse
Affiliation(s)
- Jia Li
- Department of Radiology, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Hao Zhou
- Department of Cardiology, West China Hospital, Sichuan University/West China School of Nursing, Sichuan University, Chengdu, China
| | - Xiaofei Lu
- Department of Radiology, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Yiren Wang
- School of Nursing, Southwest Medical University, Luzhou, China
| | - Haowen Pang
- Department of Oncology, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Daniel Cesar
- Department of Gynecology Oncology, National Cancer Institute, Rio de Janeiro, Brazil
| | - Aiai Liu
- Department of Radiology, The Affiliated Hospital of Southwest Medical University, Luzhou, China.
| | - Ping Zhou
- Department of Radiology, The Affiliated Hospital of Southwest Medical University, Luzhou, China.
| |
Collapse
|
6
|
Bizzarri N, Russo L, Dolciami M, Zormpas-Petridis K, Boldrini L, Querleu D, Ferrandina G, Pedone Anchora L, Gui B, Sala E, Scambia G. Radiomics systematic review in cervical cancer: gynecological oncologists' perspective. Int J Gynecol Cancer 2023; 33:1522-1541. [PMID: 37714669 DOI: 10.1136/ijgc-2023-004589] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/17/2023] Open
Abstract
OBJECTIVE Radiomics is the process of extracting quantitative features from radiological images, and represents a relatively new field in gynecological cancers. Cervical cancer has been the most studied gynecological tumor for what concerns radiomics analysis. The aim of this study was to report on the clinical applications of radiomics combined and/or compared with clinical-pathological variables in patients with cervical cancer. METHODS A systematic review of the literature from inception to February 2023 was performed, including studies on cervical cancer analysing a predictive/prognostic radiomics model, which was combined and/or compared with a radiological or a clinical-pathological model. RESULTS A total of 57 of 334 (17.1%) screened studies met inclusion criteria. The majority of studies used magnetic resonance imaging (MRI), but positron emission tomography (PET)/computed tomography (CT) scan, CT scan, and ultrasound scan also underwent radiomics analysis. In apparent early-stage disease, the majority of studies (16/27, 59.3%) analysed the role of radiomics signature in predicting lymph node metastasis; six (22.2%) investigated the prediction of radiomics to detect lymphovascular space involvement, one (3.7%) investigated depth of stromal infiltration, and one investigated (3.7%) parametrial infiltration. Survival prediction was evaluated both in early-stage and locally advanced settings. No study focused on the application of radiomics in metastatic or recurrent disease. CONCLUSION Radiomics signatures were predictive of pathological and oncological outcomes, particularly if combined with clinical variables. These may be integrated in a model using different clinical-pathological and translational characteristics, with the aim to tailor and personalize the treatment of each patient with cervical cancer.
Collapse
Affiliation(s)
- Nicolò Bizzarri
- UOC Ginecologia Oncologica, Dipartimento per la salute della Donna e del Bambino e della Salute Pubblica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Luca Russo
- Department of Bioimaging, Radiation Oncology and Hematology, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Miriam Dolciami
- Department of Bioimaging, Radiation Oncology and Hematology, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Konstantinos Zormpas-Petridis
- Department of Bioimaging, Radiation Oncology and Hematology, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Luca Boldrini
- Department of Bioimaging, Radiation Oncology and Hematology, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Denis Querleu
- UOC Ginecologia Oncologica, Dipartimento per la salute della Donna e del Bambino e della Salute Pubblica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Gabriella Ferrandina
- UOC Ginecologia Oncologica, Dipartimento per la salute della Donna e del Bambino e della Salute Pubblica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Università Cattolica del Sacro Cuore, Rome, Italy
| | - Luigi Pedone Anchora
- UOC Ginecologia Oncologica, Dipartimento per la salute della Donna e del Bambino e della Salute Pubblica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Benedetta Gui
- Department of Bioimaging, Radiation Oncology and Hematology, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Evis Sala
- Department of Bioimaging, Radiation Oncology and Hematology, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Università Cattolica del Sacro Cuore, Rome, Italy
| | - Giovanni Scambia
- UOC Ginecologia Oncologica, Dipartimento per la salute della Donna e del Bambino e della Salute Pubblica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Università Cattolica del Sacro Cuore, Rome, Italy
| |
Collapse
|
7
|
Wagner‐Larsen KS, Hodneland E, Fasmer KE, Lura N, Woie K, Bertelsen BI, Salvesen Ø, Halle MK, Smit N, Krakstad C, Haldorsen IS. MRI-based radiomic signatures for pretreatment prognostication in cervical cancer. Cancer Med 2023; 12:20251-20265. [PMID: 37840437 PMCID: PMC10652318 DOI: 10.1002/cam4.6526] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 08/16/2023] [Accepted: 08/31/2023] [Indexed: 10/17/2023] Open
Abstract
BACKGROUND Accurate pretherapeutic prognostication is important for tailoring treatment in cervical cancer (CC). PURPOSE To investigate whether pretreatment MRI-based radiomic signatures predict disease-specific survival (DSS) in CC. STUDY TYPE Retrospective. POPULATION CC patients (n = 133) allocated into training(T) (nT = 89)/validation(V) (nV = 44) cohorts. FIELD STRENGTH/SEQUENCE T2-weighted imaging (T2WI) and diffusion-weighted imaging (DWI) at 1.5T or 3.0T. ASSESSMENT Radiomic features from segmented tumors were extracted from T2WI and DWI (high b-value DWI and apparent diffusion coefficient (ADC) maps). STATISTICAL TESTS Radiomic signatures for prediction of DSS from T2WI (T2rad ) and T2WI with DWI (T2 + DWIrad ) were constructed by least absolute shrinkage and selection operator (LASSO) Cox regression. Area under time-dependent receiver operating characteristics curves (AUC) were used to evaluate and compare the prognostic performance of the radiomic signatures, MRI-derived maximum tumor size ≤/> 4 cm (MAXsize ), and 2018 International Federation of Gynecology and Obstetrics (FIGO) stage (I-II/III-IV). Survival was analyzed using Cox model estimating hazard ratios (HR) and Kaplan-Meier method with log-rank tests. RESULTS The radiomic signatures T2rad and T2 + DWIrad yielded AUCT /AUCV of 0.80/0.62 and 0.81/0.75, respectively, for predicting 5-year DSS. Both signatures yielded better or equal prognostic performance to that of MAXsize (AUCT /AUCV : 0.69/0.65) and FIGO (AUCT /AUCV : 0.77/0.64) and were significant predictors of DSS after adjusting for FIGO (HRT /HRV for T2rad : 4.0/2.5 and T2 + DWIrad : 4.8/2.1). Adding T2rad and T2 + DWIrad to FIGO significantly improved DSS prediction compared to FIGO alone in cohort(T) (AUCT 0.86 and 0.88 vs. 0.77), and FIGO with T2 + DWIrad tended to the same in cohort(V) (AUCV 0.75 vs. 0.64, p = 0.07). High radiomic score for T2 + DWIrad was significantly associated with reduced DSS in both cohorts. DATA CONCLUSION Radiomic signatures from T2WI and T2WI with DWI may provide added value for pretreatment risk assessment and for guiding tailored treatment strategies in CC.
Collapse
Affiliation(s)
- Kari S. Wagner‐Larsen
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of RadiologyHaukeland University HospitalBergenNorway
- Section for Radiology, Department of Clinical MedicineUniversity of BergenBergenNorway
| | - Erlend Hodneland
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of RadiologyHaukeland University HospitalBergenNorway
- Department of MathematicsUniversity of BergenBergenNorway
| | - Kristine E. Fasmer
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of RadiologyHaukeland University HospitalBergenNorway
- Section for Radiology, Department of Clinical MedicineUniversity of BergenBergenNorway
| | - Njål Lura
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of RadiologyHaukeland University HospitalBergenNorway
- Section for Radiology, Department of Clinical MedicineUniversity of BergenBergenNorway
| | - Kathrine Woie
- Department of Obstetrics and GynecologyHaukeland University HospitalBergenNorway
| | | | - Øyvind Salvesen
- Clinical Research Unit, Department of Clinical and Molecular MedicineNorwegian University of Science and TechnologyTrondheimNorway
| | - Mari K. Halle
- Department of Obstetrics and GynecologyHaukeland University HospitalBergenNorway
- Centre for Cancer Biomarkers (CCBIO), Department of Clinical ScienceUniversity of BergenBergenNorway
| | - Noeska Smit
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of RadiologyHaukeland University HospitalBergenNorway
- Department of InformaticsUniversity of BergenBergenNorway
| | - Camilla Krakstad
- Department of Obstetrics and GynecologyHaukeland University HospitalBergenNorway
- Centre for Cancer Biomarkers (CCBIO), Department of Clinical ScienceUniversity of BergenBergenNorway
| | - Ingfrid S. Haldorsen
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of RadiologyHaukeland University HospitalBergenNorway
- Section for Radiology, Department of Clinical MedicineUniversity of BergenBergenNorway
| |
Collapse
|
8
|
Chen Z, Ying MTC, Wang Y, Chen J, Wu C, Han X, Su Z. Ultrasound-based radiomics analysis in the assessment of renal fibrosis in patients with chronic kidney disease. Abdom Radiol (NY) 2023; 48:2649-2657. [PMID: 37256330 DOI: 10.1007/s00261-023-03965-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 05/13/2023] [Accepted: 05/16/2023] [Indexed: 06/01/2023]
Abstract
PURPOSE Assessment of renal fibrosis non-invasively in chronic kidney disease (CKD) patients is still a clinical challenge. In this study, we aimed to establish a radiomics model integrating radiomics features derived from ultrasound (US) images with clinical characteristics for the assessment of renal fibrosis severity in CKD patients. METHODS A total of 160 patients with CKD who underwent kidney biopsy and renal US examination were prospectively enrolled. Patients were classified into the mild or moderate-severe fibrosis group based on pathology results. Radiomics features were extracted from the US images, and a radiomics signature was constructed using the maximum relevance minimum redundancy (mRMR) and least absolute shrinkage and selection operator (LASSO) regression algorithms. Multivariable logistic regression was employed to construct the radiomics model, which incorporated the radiomics signature and the selected clinical variables. The established model was evaluated for discrimination, calibration, and clinical utility in the derivation cohort and internal cross-validation (CV) analysis, respectively. RESULTS The radiomics signature, consisting of nine identified fibrosis-related features, achieved moderate discriminatory ability with an area under the receiver operating characteristic curve (AUC) of 0.72 (95% confidence interval (CI) 0.64-0.79). By combining the radiomics signature with significant clinical risk factors, the radiomics model showed satisfactory discrimination performance, yielding an AUC of 0.85 (95% CI 0.79-0.91) in the derivation cohort and a mean AUC of 0.84 (95% CI 0.77-0.92) in the internal CV analysis. It also demonstrated fine accuracy via the calibration curve. Furthermore, the decision curve analysis indicated that the model was clinically useful. CONCLUSION The proposed radiomics model showed favorable performance in determining the individualized risk of moderate-severe renal fibrosis in patients with CKD, which may facilitate more effective clinical decision-making.
Collapse
Affiliation(s)
- Ziman Chen
- Department of Ultrasound, Fifth Affiliated Hospital of Sun Yat-sen University, Zhuhai, China
- Department of Health Technology and Informatics, Hong Kong Polytechnic University, Kowloon, Hong Kong
| | - Michael Tin Cheung Ying
- Department of Health Technology and Informatics, Hong Kong Polytechnic University, Kowloon, Hong Kong.
| | - Yingli Wang
- Ultrasound Department, EDAN Instruments, Inc., Shenzhen, China
| | - Jiaxin Chen
- Department of Ultrasound, Fifth Affiliated Hospital of Sun Yat-sen University, Zhuhai, China
| | - Chaoqun Wu
- Department of Ultrasound, Fifth Affiliated Hospital of Sun Yat-sen University, Zhuhai, China
| | - Xinyang Han
- Department of Health Technology and Informatics, Hong Kong Polytechnic University, Kowloon, Hong Kong
| | - Zhongzhen Su
- Department of Ultrasound, Fifth Affiliated Hospital of Sun Yat-sen University, Zhuhai, China.
| |
Collapse
|
9
|
Jiang S, Locatello LG, Maggiore G, Gallo O. Radiomics-Based Analysis in the Prediction of Occult Lymph Node Metastases in Patients with Oral Cancer: A Systematic Review. J Clin Med 2023; 12:4958. [PMID: 37568363 PMCID: PMC10419487 DOI: 10.3390/jcm12154958] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 07/23/2023] [Accepted: 07/26/2023] [Indexed: 08/13/2023] Open
Abstract
BACKGROUND Tumor extension and metastatic cervical lymph nodes' (LNs) number and dimensions are major prognostic factors in patients with oral squamous cell carcinoma (OSCC). Radiomics-based models are being integrated into clinical practice in the prediction of LN status prior to surgery in order to optimize the treatment, yet their value is still debated. METHODS A systematic review of the literature was conducted according to the PRISMA guideline. Baseline study characteristics, and methodological items were extracted and summarized. RESULTS A total of 10 retrospective studies were included into the present study, each of them exploiting a single imaging modality. Data from a cohort of 1489 patients were analyzed: the highest AUC value was 99.5%, ACC ranges from 68% to 97.5%, and sensibility and specificity were over 0.65 and 0.70, respectively. CONCLUSION Radiomics may be a noninvasive tool to predict occult LN metastases (LNM) in OSCC patients prior to treatment; further prospective studies are warranted to create a reproducible and reliable method for the detection of LNM in OSCC.
Collapse
Affiliation(s)
- Serena Jiang
- Department of Otorhinolaryngology, Careggi University Hospital, Largo Brambilla 3, 50134 Florence, Italy
| | - Luca Giovanni Locatello
- Department of Otorhinolaryngology, University Hospital “Santa Maria Della Misericordia”, Azienda Sanitaria Universitaria Friuli Centrale (ASUFC), 33100 Udine, Italy;
| | - Giandomenico Maggiore
- Department of Otorhinolaryngology, Careggi University Hospital, Largo Brambilla 3, 50134 Florence, Italy
| | - Oreste Gallo
- Department of Otorhinolaryngology, Careggi University Hospital, Largo Brambilla 3, 50134 Florence, Italy
| |
Collapse
|
10
|
Pan L, He T, Huang Z, Chen S, Zhang J, Zheng S, Chen X. Radiomics approach with deep learning for predicting T4 obstructive colorectal cancer using CT image. Abdom Radiol (NY) 2023; 48:1246-1259. [PMID: 36859730 DOI: 10.1007/s00261-023-03838-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 01/27/2023] [Accepted: 01/27/2023] [Indexed: 03/03/2023]
Abstract
OBJECTIVES Patients with T4 obstructive colorectal cancer (OCC) have a high mortality rate. Therefore, an accurate distinction between T4 and T1-T3 (NT4) in OCC is an important part of preoperative evaluation, especially in the emergency setting. This paper introduces three models of radiomics, deep learning, and deep learning-based radiomics to identify T4 OCC. METHODS We established a dataset of computed tomography (CT) images of 164 patients with pathologically confirmed OCC, from which 2537 slides were extracted. First, since T4 tumors penetrate the bowel wall and involve adjacent organs, we explored whether the peritumoral region contributes to the assessment of T4 OCC. Furthermore, we visualized the radiomics and deep learning features using the t-distributed stochastic neighbor embedding technique (t-SNE). Finally, we built a merged model by fusing radiomic features with deep learning features. In this experiment, the performance of each model was evaluated by the area under the receiver operating characteristic curve (AUC). RESULTS In the test cohort, the AUC values predicted by the radiomics model in the dilated region of interest (dROI) was 0.770. And the AUC value of the deep learning model with the patches extended 20-pixel reached 0.936. Combining the characteristics of radiomics and deep learning, our method achieved an AUC value of 0.947 in the T4 and non-T4 (NT4) classification, and increased the AUC value to 0.950 after the addition of clinical features. CONCLUSION The prediction results of our merged model of deep learning radiomics outperformed the deep learning model and significantly outperformed the radiomics model. The experimental results demonstrate that combining the peritumoral region improves the prediction performance of the radiomics model and the deep learning model.
Collapse
Affiliation(s)
- Lin Pan
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Tian He
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Zihan Huang
- School of Future Technology, Harbin Institute of Technology, Harbin, 150000, China
| | - Shuai Chen
- Department of Emergency Surgery, Fujian Medical University Union Hospital, Fuzhou, 350001, China
| | - Junrong Zhang
- Department of Emergency Surgery, Fujian Medical University Union Hospital, Fuzhou, 350001, China
| | - Shaohua Zheng
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China.
| | - Xianqiang Chen
- Department of Emergency Surgery, Fujian Medical University Union Hospital, Fuzhou, 350001, China.
| |
Collapse
|
11
|
Chen W, Wang L, Hou Y, Li L, Chang L, Li Y, Xie K, Qiu L, Mao D, Li W, Xia Y. Combined Radiomics-Clinical Model to Predict Radiotherapy Response in Inoperable Stage III and IV Non-Small-Cell Lung Cancer. Technol Cancer Res Treat 2022; 21:15330338221142400. [PMID: 36476110 PMCID: PMC9742722 DOI: 10.1177/15330338221142400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Purpose: Radiotherapy is a promising treatment option for lung cancer, but patients' responses vary. The purpose of the study was to investigate the potential of radiomics and clinical signature for predicting the radiotherapy sensitivity and overall survival of inoperable stage III and IV non-small-cell lung cancer (NSCLC) patients. Materials: This retrospective study collected 104 inoperable stage III and IV NSCLC patients at the Yunnan Cancer Hospital from October 2016 to September 2020. They were divided into radiation-sensitive and non-sensitive groups. We used analysis of variance (ANOVA) to select features and support vector machine (SVM) to build the radiomic model. Furthermore, the logistic regression method was used to screen out clinically relevant predictive factors and construct the combined model of radiomics-clinical features. Finally, survival was estimated using the Kaplan-Meier method. Results: There were 40 patients in the radiation-sensitive group and 64 in the non-sensitive group. These patients were divided into training set (73 cases) and testing set (31 cases) according to the ratio of 7:3. Nine radiomics features and one clinical feature were significantly associated with radiotherapy sensitivity. Both the radiomics model and combined model have good predictive performance (the areas under the curve (AUC) values of the testing set were 0.864 (95% confidence interval [CI]: 0.683-0.996) and 0.868 (95% CI: 0.689-1.000), respectively). Only platelet level status was associated with overall survival. Conclusion: The combined model constructed based on radiomics and clinical features can effectively identify the radiation-sensitive population and provide valuable clinical information. Patients with higher platelet levels may have a poor prognosis.
Collapse
Affiliation(s)
- Wenrui Chen
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Li Wang
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Yu Hou
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Lan Li
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Li Chang
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Yunfen Li
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Kun Xie
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Linbo Qiu
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Dan Mao
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Wenhui Li
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China,Wenhui Li, PhD, Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, 519 Kunzhou Rd., Kunming, Yunnan 650118, China.
| | - Yaoxiong Xia
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| |
Collapse
|
12
|
Ren J, Li Y, Yang JJ, Zhao J, Xiang Y, Xia C, Cao Y, Chen B, Guan H, Qi YF, Tang W, Chen K, He YL, Jin ZY, Xue HD. MRI-based radiomics analysis improves preoperative diagnostic performance for the depth of stromal invasion in patients with early stage cervical cancer. Insights Imaging 2022; 13:17. [PMID: 35092505 PMCID: PMC8800977 DOI: 10.1186/s13244-022-01156-0] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Accepted: 12/31/2021] [Indexed: 11/10/2022] Open
Abstract
Background The depth of cervical stromal invasion is one of the important prognostic factors affecting decision-making for early stage cervical cancer (CC). This study aimed to develop and validate a T2-weighted imaging (T2WI)-based radiomics model and explore independent risk factors (factors with statistical significance in both univariate and multivariate analyses) of middle or deep stromal invasion in early stage CC. Methods Between March 2017 and March 2021, a total of 234 International Federation of Gynecology and Obstetrics IB1-IIA1 CC patients were enrolled and randomly divided into a training cohort (n = 188) and a validation cohort (n = 46). The radiomics features of each patient were extracted from preoperative sagittal T2WI, and key features were selected. After independent risk factors were identified, a combined model and nomogram incorporating radiomics signature and independent risk factors were developed. Diagnostic accuracy of radiologists was also evaluated. Results The maximal tumor diameter (MTD) on magnetic resonance imaging was identified as an independent risk factor. In the validation cohort, the radiomics model, MTD, and combined model showed areas under the curve of 0.879, 0.844, and 0.886. The radiomics model and combined model showed the same sensitivity and specificity of 87.9% and 84.6%, which were better than radiologists (sensitivity, senior = 75.7%, junior = 63.6%; specificity, senior = 69.2%, junior = 53.8%) and MTD (sensitivity = 69.7%, specificity = 76.9%). Conclusion MRI-based radiomics analysis outperformed radiologists for the preoperative diagnosis of middle or deep stromal invasion in early stage CC, and the probability can be individually evaluated by a nomogram.
Collapse
|
13
|
Liu B, Sun Z, Xu ZL, Zhao HL, Wen DD, Li YA, Zhang F, Hou BX, Huan Y, Wei LC, Zheng MW. Predicting Disease-Free Survival With Multiparametric MRI-Derived Radiomic Signature in Cervical Cancer Patients Underwent CCRT. Front Oncol 2022; 11:812993. [PMID: 35145910 PMCID: PMC8821662 DOI: 10.3389/fonc.2021.812993] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 12/30/2021] [Indexed: 11/13/2022] Open
Abstract
Prognostic biomarkers that can reliably predict the disease-free survival (DFS) of locally advanced cervical cancer (LACC) are needed for identifying those patients at high risk for progression, who may benefit from a more aggressive treatment. In the present study, we aimed to construct a multiparametric MRI-derived radiomic signature for predicting DFS of LACC patients who underwent concurrent chemoradiotherapy (CCRT).
Collapse
Affiliation(s)
- Bing Liu
- Department of Radiology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
| | - Zhen Sun
- Department of Orthopaedics, Xijing Hospital, Airforce Military Medical University, Xi’an, China
| | - Zi-Liang Xu
- Department of Radiology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
| | - Hong-Liang Zhao
- Department of Radiology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
| | - Di-Di Wen
- Department of Radiology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
| | - Yong-Ai Li
- Department of Radiology, Jinshan Hospital, Fudan University, Shanghai, China
| | - Fan Zhang
- Department of Radiology, Shanxi Traditional Chinese Medical Hospital, Taiyuan, China
| | - Bing-Xin Hou
- Department of Radiation Oncology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
| | - Yi Huan
- Department of Radiology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
- *Correspondence: Yi Huan, ; Li-Chun Wei, ; Min-Wen Zheng,
| | - Li-Chun Wei
- Department of Radiation Oncology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
- *Correspondence: Yi Huan, ; Li-Chun Wei, ; Min-Wen Zheng,
| | - Min-Wen Zheng
- Department of Radiology, Xijing Hospital, Airforce Military Medical University, Xi’an, China
- *Correspondence: Yi Huan, ; Li-Chun Wei, ; Min-Wen Zheng,
| |
Collapse
|
14
|
Shiinoki T, Fujimoto K, Kawazoe Y, Yuasa Y, Kajima M, Manabe Y, Ono T, Hirano T, Matsunaga K, Tanaka H. Predicting programmed death-ligand 1 expression level in non-small cell lung cancer using a combination of peritumoral and intratumoral radiomic features on computed tomography. Biomed Phys Eng Express 2022; 8. [PMID: 35051908 DOI: 10.1088/2057-1976/ac4d43] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 01/20/2022] [Indexed: 12/24/2022]
Abstract
In this study, we investigated the possibility of predicting expression levels of programmed death-ligand 1 (PD-L1) using radiomic features of intratumoral and peritumoral tumors on computed tomography (CT) images. We retrospectively analyzed 161 patients with non-small cell lung cancer. We extracted radiomics features for intratumoral and peritumoral regions on CT images. The null importance, least absolute shrinkage, and selection operator model were used to select the optimized feature subset to build the prediction models for the PD-L1 expression level. LightGBM with five-fold cross-validation was used to construct the prediction model and evaluate the receiver operating characteristics. The corresponding area under the curve (AUC) was calculated for the training and testing cohorts. The proportion of ambiguously clustered pairs was calculated based on consensus clustering to evaluate the validity of the selected features. In addition, Radscore was calculated for the training and test cohorts. For expression level of PD-L1 above 1%, prediction models that included radiomic features from the intratumoral region and a combination of radiomic features from intratumoral and peritumoral regions yielded an AUC of 0.83 and 0.87 and 0.64 and 0.74 in the training and test cohorts, respectively. In contrast, the models above 50% prediction yielded an AUC of 0.80, 0.97, and 0.74, 0.83, respectively. The selected features were divided into two subgroups based on PD-L1 expression levels ≥ 50% or ≥ 1%. Radscore was statistically higher for subgroup one than subgroup two when radiomic features for intratumoral and peritumoral regions were combined. We constructed a predictive model for PD-L1 expression level using CT images. The model using a combination of intratumoral and peritumoral radiomic features had a higher accuracy than the model with only intratumoral radiomic features.
Collapse
Affiliation(s)
- Takehiro Shiinoki
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Koya Fujimoto
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Yusuke Kawazoe
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Yuki Yuasa
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Miki Kajima
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Yuki Manabe
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Taiki Ono
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Tsunahiko Hirano
- Department of Respiratory Medicine and Infectious Disease, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Kazuto Matsunaga
- Department of Respiratory Medicine and Infectious Disease, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| | - Hidekazu Tanaka
- Department of Radiation Oncology, Yamaguchi University, Minamikogushi 1-1-1, Ube, Yamaguchi, 7558505, JAPAN
| |
Collapse
|