1
|
Bang C, Bernard G, Le WT, Lalonde A, Kadoury S, Bahig H. Artificial intelligence to predict outcomes of head and neck radiotherapy. Clin Transl Radiat Oncol 2023; 39:100590. [PMID: 36935854 PMCID: PMC10014342 DOI: 10.1016/j.ctro.2023.100590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 01/28/2023] [Accepted: 01/28/2023] [Indexed: 02/01/2023] Open
Abstract
Head and neck radiotherapy induces important toxicity, and its efficacy and tolerance vary widely across patients. Advancements in radiotherapy delivery techniques, along with the increased quality and frequency of image guidance, offer a unique opportunity to individualize radiotherapy based on imaging biomarkers, with the aim of improving radiation efficacy while reducing its toxicity. Various artificial intelligence models integrating clinical data and radiomics have shown encouraging results for toxicity and cancer control outcomes prediction in head and neck cancer radiotherapy. Clinical implementation of these models could lead to individualized risk-based therapeutic decision making, but the reliability of the current studies is limited. Understanding, validating and expanding these models to larger multi-institutional data sets and testing them in the context of clinical trials is needed to ensure safe clinical implementation. This review summarizes the current state of the art of machine learning models for prediction of head and neck cancer radiotherapy outcomes.
Collapse
Key Words
- ADASYN, adaptive synthetic sampling
- AI, artificial intelligence
- ANN, artificial neural network
- AUC, Area Under the ROC Curve
- Artificial intelligence
- BMI, body mass index
- C-Index, concordance index
- CART, Classification and Regression Tree
- CBCT, cone-beam computed tomography
- CIFE, conditional informax feature extraction
- CNN, convolutional neural network
- CRT, chemoradiation
- CT, computed tomography
- Cancer outcomes
- DL, deep learning
- DM, distant metastasis
- DSC, Dice Similarity Coefficient
- DSS, clinical decision support systems
- DT, Decision Tree
- DVH, Dose-volume histogram
- GANs, Generative Adversarial Networks
- GB, Gradient boosting
- GPU, graphical process units
- HNC, head and neck cancer
- HPV, human papillomavirus
- HR, hazard ratio
- Head and neck cancer
- IAMB, incremental association Markov blanket
- IBDM, image based data mining
- IBMs, image biomarkers
- IMRT, intensity-modulated RT
- KNN, k nearest neighbor
- LLR, Local linear forest
- LR, logistic regression
- LRR, loco-regional recurrence
- MIFS, mutual information based feature selection
- ML, machine learning
- MRI, Magnetic resonance imaging
- MRMR, Minimum redundancy feature selection
- Machine learning
- N-MLTR, Neural Multi-Task Logistic Regression
- NPC, nasopharynx
- NTCP, Normal Tissue Complication Probability
- OPC, oropharyngeal cancer
- ORN, osteoradionecrosis
- OS, overall survival
- PCA, Principal component analysis
- PET, Positron emission tomography
- PG, parotid glands
- PLR, Positive likelihood ratio
- PM, pharyngeal mucosa
- PTV, Planning target volumes
- PreSANet, deep preprocessor module and self-attention
- Predictive modeling
- QUANTEC, Quantitative Analyses of Normal Tissue Effects in the Clinic
- RF, random forest
- RFC, random forest classifier
- RFS, recurrence free survival
- RLR, Rigid logistic regression
- RRF, Regularized random forest
- RSF, random survival forest
- RT, radiotherapy
- RTLI, radiation-induced temporal lobe injury
- Radiomic
- SDM, shared decision making
- SMG, submandibular glands
- SMOTE, synthetic minority over-sampling technique
- STIC, sticky saliva
- SVC, support vector classifier
- SVM, support vector machine
- XGBoost, extreme gradient boosting
Collapse
Affiliation(s)
- Chulmin Bang
- Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
- Corresponding author at: Centre Hospitalier de l'Université de Montréal, 3840 Rue Saint-Urbain, Montréal, QC H2W 1T8, Canada.
| | - Galaad Bernard
- Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
| | - William T. Le
- Centre de recherche du Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
- Polytechnique Montréal, Montreal, QC, Canada
| | - Arthur Lalonde
- Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
- Centre de recherche du Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
- Université de Montréal, Montreal, QC, Canada
| | - Samuel Kadoury
- Centre de recherche du Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
- Polytechnique Montréal, Montreal, QC, Canada
| | - Houda Bahig
- Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
- Centre de recherche du Centre Hospitalier de l’Université de Montréal, Montreal, QC, Canada
| |
Collapse
|
2
|
Carrera-Escalé L, Benali A, Rathert AC, Martín-Pinardel R, Bernal-Morales C, Alé-Chilet A, Barraso M, Marín-Martinez S, Feu-Basilio S, Rosinés-Fonoll J, Hernandez T, Vilá I, Castro-Dominguez R, Oliva C, Vinagre I, Ortega E, Gimenez M, Vellido A, Romero E, Zarranz-Ventura J. Radiomics-Based Assessment of OCT Angiography Images for Diabetic Retinopathy Diagnosis. Ophthalmol Sci 2022; 3:100259. [PMID: 36578904 PMCID: PMC9791596 DOI: 10.1016/j.xops.2022.100259] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 10/25/2022] [Accepted: 11/14/2022] [Indexed: 11/23/2022]
Abstract
Purpose To evaluate the diagnostic accuracy of machine learning (ML) techniques applied to radiomic features extracted from OCT and OCT angiography (OCTA) images for diabetes mellitus (DM), diabetic retinopathy (DR), and referable DR (R-DR) diagnosis. Design Cross-sectional analysis of a retinal image dataset from a previous prospective OCTA study (ClinicalTrials.govNCT03422965). Participants Patients with type 1 DM and controls included in the progenitor study. Methods Radiomic features were extracted from fundus retinographies, OCT, and OCTA images in each study eye. Logistic regression, linear discriminant analysis, support vector classifier (SVC)-linear, SVC-radial basis function, and random forest models were created to evaluate their diagnostic accuracy for DM, DR, and R-DR diagnosis in all image types. Main Outcome Measures Area under the receiver operating characteristic curve (AUC) mean and standard deviation for each ML model and each individual and combined image types. Results A dataset of 726 eyes (439 individuals) were included. For DM diagnosis, the greatest AUC was observed for OCT (0.82, 0.03). For DR detection, the greatest AUC was observed for OCTA (0.77, 0.03), especially in the 3 × 3 mm superficial capillary plexus OCTA scan (0.76, 0.04). For R-DR diagnosis, the greatest AUC was observed for OCTA (0.87, 0.12) and the deep capillary plexus OCTA scan (0.86, 0.08). The addition of clinical variables (age, sex, etc.) improved most models AUC for DM, DR and R-DR diagnosis. The performance of the models was similar in unilateral and bilateral eyes image datasets. Conclusions Radiomics extracted from OCT and OCTA images allow identification of patients with DM, DR, and R-DR using standard ML classifiers. OCT was the best test for DM diagnosis, OCTA for DR and R-DR diagnosis and the addition of clinical variables improved most models. This pioneer study demonstrates that radiomics-based ML techniques applied to OCT and OCTA images may be an option for DR screening in patients with type 1 DM. Financial Disclosures Proprietary or commercial disclosure may be found after the references.
Collapse
Key Words
- AI, artificial intelligence
- AUC, area under the curve
- Artificial intelligence
- DCP, deep capillary plexus
- DM, diabetes mellitus
- DR, diabetic retinopathy
- Diabetic retinopathy
- FR, fundus retinographies
- LDA, linear discriminant analysis
- LR, logistic regression
- ML, machine learning
- Machine learning
- OCT angiography
- OCTA, OCT angiography
- R-DR, referable DR
- RF, random forest
- Radiomics
- SCP, superficial capillary plexus
- SVC, support vector classifier
- rbf, radial basis function
Collapse
Affiliation(s)
- Laura Carrera-Escalé
- Intelligent Data Science and Artificial Intelligence (IDEAI) Research Center,Department of Computer Science, Facultat d’Informàtica de Barcelona (FIB), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Anass Benali
- Intelligent Data Science and Artificial Intelligence (IDEAI) Research Center,Department of Computer Science, Facultat d’Informàtica de Barcelona (FIB), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Ann-Christin Rathert
- Intelligent Data Science and Artificial Intelligence (IDEAI) Research Center,Department of Computer Science, Facultat d’Informàtica de Barcelona (FIB), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Ruben Martín-Pinardel
- Intelligent Data Science and Artificial Intelligence (IDEAI) Research Center,Department of Computer Science, Facultat d’Informàtica de Barcelona (FIB), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain,August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain
| | | | - Anibal Alé-Chilet
- Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | - Marina Barraso
- Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | - Sara Marín-Martinez
- Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | - Silvia Feu-Basilio
- Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | - Josep Rosinés-Fonoll
- Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | - Teresa Hernandez
- August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain,Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | - Irene Vilá
- August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain,Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | | | - Cristian Oliva
- August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain,Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain
| | - Irene Vinagre
- August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain,Diabetes Unit, Hospital Clínic de Barcelona, Spain,Institut Clínic de Malalties Digestives i Metaboliques (ICMDM), Hospital Clínic de Barcelona, Spain
| | - Emilio Ortega
- August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain,Diabetes Unit, Hospital Clínic de Barcelona, Spain,Institut Clínic de Malalties Digestives i Metaboliques (ICMDM), Hospital Clínic de Barcelona, Spain
| | - Marga Gimenez
- August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain,Diabetes Unit, Hospital Clínic de Barcelona, Spain,Institut Clínic de Malalties Digestives i Metaboliques (ICMDM), Hospital Clínic de Barcelona, Spain
| | - Alfredo Vellido
- Intelligent Data Science and Artificial Intelligence (IDEAI) Research Center,Department of Computer Science, Facultat d’Informàtica de Barcelona (FIB), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Enrique Romero
- Intelligent Data Science and Artificial Intelligence (IDEAI) Research Center,Department of Computer Science, Facultat d’Informàtica de Barcelona (FIB), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Javier Zarranz-Ventura
- August Pi i Sunyer Biomedical Research Institute (IDIBAPS), Barcelona, Spain,Institut Clínic d´Oftalmología (ICOF), Hospital Clínic de Barcelona, Barcelona, Spain,Diabetes Unit, Hospital Clínic de Barcelona, Spain,School of Medicine, Universitat de Barcelona, Spain,Correspondence: Javier Zarranz-Ventura, MD, PhD, C/ Sabino Arana 1, Barcelona 08028, Spain.
| |
Collapse
|