1
|
Kriukova E, LaRochelle E, Pfefer TJ, Kanniyappan U, Gioux S, Pogue B, Ntziachristos V, Gorpas D. Impact of signal-to-noise ratio and contrast definition on the sensitivity assessment and benchmarking of fluorescence molecular imaging systems. JOURNAL OF BIOMEDICAL OPTICS 2025; 30:S13703. [PMID: 39034959 PMCID: PMC11256003 DOI: 10.1117/1.jbo.30.s1.s13703] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 06/20/2024] [Accepted: 06/25/2024] [Indexed: 07/23/2024]
Abstract
Significance Standardization of fluorescence molecular imaging (FMI) is critical for ensuring quality control in guiding surgical procedures. To accurately evaluate system performance, two metrics, the signal-to-noise ratio (SNR) and contrast, are widely employed. However, there is currently no consensus on how these metrics can be computed. Aim We aim to examine the impact of SNR and contrast definitions on the performance assessment of FMI systems. Approach We quantified the SNR and contrast of six near-infrared FMI systems by imaging a multi-parametric phantom. Based on approaches commonly used in the literature, we quantified seven SNRs and four contrast values considering different background regions and/or formulas. Then, we calculated benchmarking (BM) scores and respective rank values for each system. Results We show that the performance assessment of an FMI system changes depending on the background locations and the applied quantification method. For a single system, the different metrics can vary up to ∼ 35 dB (SNR), ∼ 8.65 a . u . (contrast), and ∼ 0.67 a . u . (BM score). Conclusions The definition of precise guidelines for FMI performance assessment is imperative to ensure successful clinical translation of the technology. Such guidelines can also enable quality control for the already clinically approved indocyanine green-based fluorescence image-guided surgery.
Collapse
Affiliation(s)
- Elena Kriukova
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Technical University of Munich, School of Medicine and Health, Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), Munich, Germany
| | - Ethan LaRochelle
- QUEL Imaging, White River Junction, Vermont, United States
- Thayer School of Engineering at Dartmouth College, Hanover, New Hampshire, United States
| | - T. Joshua Pfefer
- Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, Maryland, United States
| | - Udayakumar Kanniyappan
- Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, Maryland, United States
| | - Sylvain Gioux
- Intuitive Surgical, Aubonne, Switzerland
- University of Strasbourg, ICube Laboratory, Strasbourg, France
| | - Brian Pogue
- University of Wisconsin Madison, Department of Medical Physics, Madison, Wisconsin, United States
| | - Vasilis Ntziachristos
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Technical University of Munich, School of Medicine and Health, Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), Munich, Germany
- Technical University of Munich, Munich Institute of Robotics and Machine Intelligence (MIRMI), Munich, Germany
| | - Dimitris Gorpas
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Technical University of Munich, School of Medicine and Health, Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), Munich, Germany
| |
Collapse
|
2
|
Wertheim KY, Chisholm R, Richmond P, Walker D. Multicellular model of neuroblastoma proposes unconventional therapy based on multiple roles of p53. PLoS Comput Biol 2024; 20:e1012648. [PMID: 39715281 DOI: 10.1371/journal.pcbi.1012648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Accepted: 11/18/2024] [Indexed: 12/25/2024] Open
Abstract
Neuroblastoma is the most common extra-cranial solid tumour in children. Over half of all high-risk cases are expected to succumb to the disease even after chemotherapy, surgery, and immunotherapy. Although the importance of MYCN amplification in this disease is indisputable, the mechanistic details remain enigmatic. Here, we present a multicellular model of neuroblastoma comprising a continuous automaton, discrete cell agents, and a centre-based mechanical model, as well as the simulation results we obtained with it. The continuous automaton represents the tumour microenvironment as a grid-like structure, where each voxel is associated with continuous variables such as the oxygen level therein. Each discrete cell agent is defined by several attributes, including its cell cycle position, mutations, gene expression pattern, and more with behaviours such as cell cycling and cell death being stochastically dependent on these attributes. The centre-based mechanical model represents the properties of these agents as physical objects, describing how they repel each other as soft spheres. By implementing a stochastic simulation algorithm on modern GPUs, we simulated the dynamics of over one million neuroblastoma cells over a period of months. Specifically, we set up 1200 heterogeneous tumours and tracked the MYCN-amplified clone's dynamics in each, revealed the conditions that favour its growth, and tested its responses to 5000 drug combinations. Our results are in agreement with those reported in the literature and add new insights into how the MYCN-amplified clone's reproductive advantage in a tumour, its gene expression profile, the tumour's other clones (with different mutations), and the tumour's microenvironment are inter-related. Based on the results, we formulated a hypothesis, which argues that there are two distinct populations of neuroblastoma cells in the tumour; the p53 protein is pro-survival in one and pro-apoptosis in the other. It follows that alternating between inhibiting MDM2 to restore p53 activity and inhibiting ARF to attenuate p53 activity is a promising, if unorthodox, therapeutic strategy. The multicellular model has the advantages of modularity, high resolution, and scalability, making it a potential foundation for creating digital twins of neuroblastoma patients.
Collapse
Affiliation(s)
- Kenneth Y Wertheim
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield, United Kingdom
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
- Centre of Excellence for Data Science, Artificial Intelligence, and Modelling, University of Hull, Kingston upon Hull, United Kingdom
- School of Computer Science, University of Hull, Kingston upon Hull, United Kingdom
| | - Robert Chisholm
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
| | - Paul Richmond
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
| | - Dawn Walker
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield, United Kingdom
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
3
|
Juergensen L, Rischen R, Hasselmann J, Toennemann M, Pollmanns A, Gosheger G, Schulze M. Insights into geometric deviations of medical 3d-printing: a phantom study utilizing error propagation analysis. 3D Print Med 2024; 10:38. [PMID: 39576468 PMCID: PMC11583775 DOI: 10.1186/s41205-024-00242-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 10/18/2024] [Indexed: 11/25/2024] Open
Abstract
BACKGROUND The use of 3D-printing in medicine requires a context-specific quality assurance program to ensure patient safety. The process of medical 3D-printing involves several steps, each of which might be prone to its own set of errors. The segmentation error (SegE), the digital editing error (DEE) and the printing error (PrE) are the most important partial errors. Approaches to evaluate these have not yet been implemented in a joint concept. Consequently, information on the stability of the overall process is often lacking and possible process optimizations are difficult to implement. In this study, SegE, DEE, and PrE are evaluated individually, and error propagation is used to examine the cumulative effect of the partial errors. METHODS The partial errors were analyzed employing surface deviation analyses. The effects of slice thickness, kernel, threshold, software and printers were investigated. The total error was calculated as the sum of SegE, DEE and PrE. RESULTS The higher the threshold value was chosen, the smaller were the segmentation results. The deviation values varied more when the CT slices were thicker and when the threshold was more distant from a value of around -400 HU. Bone kernel-based segmentations were prone to artifact formation. The relative reduction in STL file size [as a proy for model complexity] was greater for higher levels of smoothing and thinner slice thickness of the DICOM datasets. The slice thickness had a minor effect on the surface deviation caused by smoothing, but it was affected by the level of smoothing. The PrE was mainly influenced by the adhesion of the printed part to the build plate. Based on the experiments, the total error was calculated for an optimal and a worst-case parameter configuration. Deviations of 0.0093 mm ± 0.2265 mm and 0.3494 mm ± 0.8001 mm were calculated for the total error. CONCLUSIONS Various parameters affecting geometric deviations in medical 3D-printing were analyzed. Especially, soft reconstruction kernels seem to be advantageous for segmentation. The concept of error propagation can contribute to a better understanding of the process specific errors and enable future analytical approaches to calculate the total error based on process parameters.
Collapse
Affiliation(s)
- Lukas Juergensen
- Department of General Orthopedics and Tumor Orthopedics, University Hospital Muenster, Münster, 48149, Germany
| | - Robert Rischen
- Clinic for Radiology, University Hospital Muenster, Muenster, 48149, Germany
| | - Julian Hasselmann
- Department of General Orthopedics and Tumor Orthopedics, University Hospital Muenster, Münster, 48149, Germany
- Materials Engineering Laboratory, Department of Mechanical Engineering, University of Applied Sciences Muenster, Steinburg, 48565, Germany
| | - Max Toennemann
- Department of General Orthopedics and Tumor Orthopedics, University Hospital Muenster, Münster, 48149, Germany
| | - Arne Pollmanns
- Materials Engineering Laboratory, Department of Mechanical Engineering, University of Applied Sciences Muenster, Steinburg, 48565, Germany
| | - Georg Gosheger
- Department of General Orthopedics and Tumor Orthopedics, University Hospital Muenster, Münster, 48149, Germany
| | - Martin Schulze
- Department of General Orthopedics and Tumor Orthopedics, University Hospital Muenster, Münster, 48149, Germany.
| |
Collapse
|
4
|
Choi SH, Park JW, Cho Y, Yang G, Yoon HI. Automated Organ Segmentation for Radiation Therapy: A Comparative Analysis of AI-Based Tools Versus Manual Contouring in Korean Cancer Patients. Cancers (Basel) 2024; 16:3670. [PMID: 39518109 PMCID: PMC11544936 DOI: 10.3390/cancers16213670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2024] [Revised: 10/24/2024] [Accepted: 10/28/2024] [Indexed: 11/16/2024] Open
Abstract
BACKGROUND Accurate delineation of tumors and organs at risk (OARs) is crucial for intensity-modulated radiation therapy. This study aimed to evaluate the performance of OncoStudio, an AI-based auto-segmentation tool developed for Korean patients, compared with Protégé AI, a globally developed tool that uses data from Korean cancer patients. METHODS A retrospective analysis of 1200 Korean cancer patients treated with radiotherapy was conducted. Auto-contours generated via OncoStudio and Protégé AI were compared with manual contours across the head and neck and thoracic, abdominal, and pelvic organs. Accuracy was assessed using the Dice similarity coefficient (DSC), mean surface distance (MSD), and 95% Hausdorff distance (HD). Feedback was obtained from 10 participants, including radiation oncologists, residents, and radiation therapists, via an online survey with a Turing test component. RESULTS OncoStudio outperformed Protégé AI in 85% of the evaluated OARs (p < 0.001). For head and neck organs, OncoStudio achieved a similar DSC (0.70 vs. 0.70, p = 0.637) but significantly lower MSD and 95% HD values (p < 0.001). In thoracic organs, OncoStudio performed excellently in 90% of cases, with a significantly greater DSC (male: 0.87 vs. 0.82, p < 0.001; female: 0.95 vs. 0.87, p < 0.001). OncoStudio also demonstrated superior accuracy in abdominal (DSC 0.88 vs. 0.81, p < 0.001) and pelvic organs (male: DSC 0.95 vs. 0.85, p < 0.001; female: DSC 0.82 vs. 0.73, p < 0.001). Clinicians favored OncoStudio in 70% of cases, with 90% endorsing its clinical suitability for Korean patients. CONCLUSIONS OncoStudio, which is tailored for Korean patients, demonstrated superior segmentation accuracy across multiple anatomical regions, suggesting its suitability for radiotherapy planning in this population.
Collapse
Affiliation(s)
- Seo Hee Choi
- Department of Radiation Oncology, Yonsei Cancer Center, Heavy Ion Therapy Research Institute, Yonsei University College of Medicine, Seoul 03722, Republic of Korea; (S.H.C.)
| | - Jong Won Park
- Department of Radiation Oncology, Yonsei Cancer Center, Heavy Ion Therapy Research Institute, Yonsei University College of Medicine, Seoul 03722, Republic of Korea; (S.H.C.)
| | - Yeona Cho
- Department of Radiation Oncology, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Republic of Korea
| | - Gowoon Yang
- Department of Radiation Oncology, Yonsei Cancer Center, Heavy Ion Therapy Research Institute, Yonsei University College of Medicine, Seoul 03722, Republic of Korea; (S.H.C.)
- Department of Radiation Oncology, Cha University Ilsan Cha Hospital, Cha University School of Medicine, Goyang 10414, Republic of Korea
| | - Hong In Yoon
- Department of Radiation Oncology, Yonsei Cancer Center, Heavy Ion Therapy Research Institute, Yonsei University College of Medicine, Seoul 03722, Republic of Korea; (S.H.C.)
| |
Collapse
|
5
|
Toniolo A, Agostini E, Ceccato F, Tizianel I, Cabrelle G, Lupi A, Pepe A, Campi C, Quaia E, Crimì F. Could CT Radiomic Analysis of Benign Adrenal Incidentalomas Suggest the Need for Further Endocrinological Evaluation? Curr Oncol 2024; 31:4917-4926. [PMID: 39329992 PMCID: PMC11431504 DOI: 10.3390/curroncol31090364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2024] [Revised: 08/14/2024] [Accepted: 08/24/2024] [Indexed: 09/28/2024] Open
Abstract
We studied the application of CT texture analysis in adrenal incidentalomas with baseline characteristics of benignity that are highly suggestive of adenoma to find whether there is a correlation between the extracted features and clinical data. Patients with hormonal hypersecretion may require medical attention, even if it does not cause any symptoms. A total of 206 patients affected by adrenal incidentaloma were retrospectively enrolled and divided into non-functioning adrenal adenomas (NFAIs, n = 115) and mild autonomous cortisol secretion (MACS, n = 91). A total of 136 texture parameters were extracted in the unenhanced phase for each volume of interest (VOI). Random Forest was used in the training and validation cohorts to test the accuracy of CT textural features and cortisol-related comorbidities in identifying MACS patients. Twelve parameters were retained in the Random Forest radiomic model, and in the validation cohort, a high specificity (81%) and positive predictive value (74%) were achieved. Notably, if the clinical data were added to the model, the results did not differ. Radiomic analysis of adrenal incidentalomas, in unenhanced CT scans, could screen with a good specificity those patients who will need a further endocrinological evaluation for mild autonomous cortisol secretion, regardless of the clinical information about the cortisol-related comorbidities.
Collapse
Affiliation(s)
- Alessandro Toniolo
- Department of Medicine (DIMED), Institute of Radiology, University of Padova, 35122 Padua, Italy
| | - Elena Agostini
- Department of Medicine (DIMED), Institute of Radiology, University of Padova, 35122 Padua, Italy
| | - Filippo Ceccato
- Endocrinology Unit, Department of Medicine (DIMED), University of Padova, 35122 Padua, Italy
| | - Irene Tizianel
- Endocrinology Unit, Department of Medicine (DIMED), University of Padova, 35122 Padua, Italy
| | - Giulio Cabrelle
- Department of Medicine (DIMED), Institute of Radiology, University of Padova, 35122 Padua, Italy
| | - Amalia Lupi
- Department of Medicine (DIMED), Institute of Radiology, University of Padova, 35122 Padua, Italy
| | - Alessia Pepe
- Department of Medicine (DIMED), Institute of Radiology, University of Padova, 35122 Padua, Italy
| | - Cristina Campi
- Department of Mathematics (DIMA), University of Genova, 16126 Genoa, Italy
| | - Emilio Quaia
- Department of Medicine (DIMED), Institute of Radiology, University of Padova, 35122 Padua, Italy
| | - Filippo Crimì
- Department of Medicine (DIMED), Institute of Radiology, University of Padova, 35122 Padua, Italy
| |
Collapse
|
6
|
Brown EE, Guy AA, Holroyd NA, Sweeney PW, Gourmet L, Coleman H, Walsh C, Markaki AE, Shipley R, Rajendram R, Walker-Samuel S. Physics-informed deep generative learning for quantitative assessment of the retina. Nat Commun 2024; 15:6859. [PMID: 39127778 PMCID: PMC11316734 DOI: 10.1038/s41467-024-50911-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Accepted: 07/25/2024] [Indexed: 08/12/2024] Open
Abstract
Disruption of retinal vasculature is linked to various diseases, including diabetic retinopathy and macular degeneration, leading to vision loss. We present here a novel algorithmic approach that generates highly realistic digital models of human retinal blood vessels, based on established biophysical principles, including fully-connected arterial and venous trees with a single inlet and outlet. This approach, using physics-informed generative adversarial networks (PI-GAN), enables the segmentation and reconstruction of blood vessel networks with no human input and which out-performs human labelling. Segmentation of DRIVE and STARE retina photograph datasets provided near state-of-the-art vessel segmentation, with training on only a small (n = 100) simulated dataset. Our findings highlight the potential of PI-GAN for accurate retinal vasculature characterization, with implications for improving early disease detection, monitoring disease progression, and improving patient care.
Collapse
Affiliation(s)
- Emmeline E Brown
- Centre for Computational Medicine, University College London, London, UK
- Moorfields Eye Hospital, London, UK
| | - Andrew A Guy
- Centre for Computational Medicine, University College London, London, UK
- Department of Engineering, University of Cambridge, Cambridge, UK
| | - Natalie A Holroyd
- Centre for Computational Medicine, University College London, London, UK
| | - Paul W Sweeney
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK
| | - Lucie Gourmet
- Centre for Computational Medicine, University College London, London, UK
| | - Hannah Coleman
- Centre for Computational Medicine, University College London, London, UK
| | - Claire Walsh
- Centre for Computational Medicine, University College London, London, UK
- Department of Mechanical Engineering, University College London, London, UK
| | - Athina E Markaki
- Department of Engineering, University of Cambridge, Cambridge, UK
| | - Rebecca Shipley
- Centre for Computational Medicine, University College London, London, UK
- Department of Mechanical Engineering, University College London, London, UK
| | - Ranjan Rajendram
- Moorfields Eye Hospital, London, UK
- Institute of Ophthalmology, University College London, London, UK
| | | |
Collapse
|
7
|
Veiga-Canuto D, Fernández-Patón M, Cerdà Alberich L, Jiménez Pastor A, Gomis Maya A, Carot Sierra JM, Sangüesa Nebot C, Martínez de las Heras B, Pötschger U, Taschner-Mandl S, Neri E, Cañete A, Ladenstein R, Hero B, Alberich-Bayarri Á, Martí-Bonmatí L. Reproducibility Analysis of Radiomic Features on T2-weighted MR Images after Processing and Segmentation Alterations in Neuroblastoma Tumors. Radiol Artif Intell 2024; 6:e230208. [PMID: 38864742 PMCID: PMC11294951 DOI: 10.1148/ryai.230208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 04/22/2024] [Accepted: 05/30/2024] [Indexed: 06/13/2024]
Abstract
Purpose To evaluate the reproducibility of radiomics features extracted from T2-weighted MR images in patients with neuroblastoma. Materials and Methods A retrospective study included 419 patients (mean age, 29 months ± 34 [SD]; 220 male, 199 female) with neuroblastic tumors diagnosed between 2002 and 2023, within the scope of the PRedictive In-silico Multiscale Analytics to support cancer personalized diaGnosis and prognosis, Empowered by imaging biomarkers (ie, PRIMAGE) project, involving 746 T2/T2*-weighted MRI sequences at diagnosis and/or after initial chemotherapy. Images underwent processing steps (denoising, inhomogeneity bias field correction, normalization, and resampling). Tumors were automatically segmented, and 107 shape, first-order, and second-order radiomics features were extracted, considered as the reference standard. Subsequently, the previous image processing settings were modified, and volumetric masks were applied. New radiomics features were extracted and compared with the reference standard. Reproducibility was assessed using the concordance correlation coefficient (CCC); intrasubject repeatability was measured using the coefficient of variation (CoV). Results When normalization was omitted, only 5% of the radiomics features demonstrated high reproducibility. Statistical analysis revealed significant changes in the normalization and resampling processes (P < .001). Inhomogeneities removal had the least impact on radiomics (83% of parameters remained stable). Shape features remained stable after mask modifications, with a CCC greater than 0.90. Mask modifications were the most favorable changes for achieving high CCC values, with a radiomics features stability of 70%. Only 7% of second-order radiomics features showed an excellent CoV of less than 0.10. Conclusion Modifications in the T2-weighted MRI preparation process in patients with neuroblastoma resulted in changes in radiomics features, with normalization identified as the most influential factor for reproducibility. Inhomogeneities removal had the least impact on radiomics features. Keywords: Pediatrics, MR Imaging, Oncology, Radiomics, Reproducibility, Repeatability, Neuroblastic Tumors Supplemental material is available for this article. © RSNA, 2024 See also the commentary by Safdar and Galaria in this issue.
Collapse
Affiliation(s)
- Diana Veiga-Canuto
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Matías Fernández-Patón
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Leonor Cerdà Alberich
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Ana Jiménez Pastor
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Armando Gomis Maya
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Jose Miguel Carot Sierra
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Cinta Sangüesa Nebot
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Blanca Martínez de las Heras
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Ulrike Pötschger
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Sabine Taschner-Mandl
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Emanuele Neri
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Adela Cañete
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Ruth Ladenstein
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Barbara Hero
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Ángel Alberich-Bayarri
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| | - Luis Martí-Bonmatí
- From the Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026 Valencia, Spain (D.V.C., M.F.P., L.C.A., A.G.M., L.M.B.); Área Clínica de Imagen Médica (D.V.C., C.S.N., L.M.B.) and Department of Pediatric Oncology (B.M.d.l.H., A.C.), Hospital Universitari i Politècnic La Fe, Valencia, Spain; Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, Valencia, Spain (A.J.P., A.A.B.); Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Valencia, Spain (J.M.C.S.); St. Anna Children’s Cancer Research Institute, Vienna, Austria (U.P., S.T.M., R.L.); Division of Academic Radiology, Department of Translational Research, University of Pisa, Pisa, Italy (E.N.); and Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical 18 Faculty, University of Cologne, Cologne, Germany (B.H.)
| |
Collapse
|
8
|
Veiga-Canuto D, Cerdá Alberich L, Fernández-Patón M, Jiménez Pastor A, Lozano-Montoya J, Miguel Blanco A, Martínez de Las Heras B, Sangüesa Nebot C, Martí-Bonmatí L. Imaging biomarkers and radiomics in pediatric oncology: a view from the PRIMAGE (PRedictive In silico Multiscale Analytics to support cancer personalized diaGnosis and prognosis, Empowered by imaging biomarkers) project. Pediatr Radiol 2024; 54:562-570. [PMID: 37747582 DOI: 10.1007/s00247-023-05770-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 09/01/2023] [Accepted: 09/03/2023] [Indexed: 09/26/2023]
Abstract
This review paper presents the practical development of imaging biomarkers in the scope of the PRIMAGE (PRedictive In silico Multiscale Analytics to support cancer personalized diaGnosis and prognosis, Empowered by imaging biomarkers) project, as a noninvasive and reliable way to improve the diagnosis and prognosis in pediatric oncology. The PRIMAGE project is a European multi-center research initiative that focuses on developing medical imaging-derived artificial intelligence (AI) solutions designed to enhance overall management and decision-making for two types of pediatric cancer: neuroblastoma and diffuse intrinsic pontine glioma. To allow this, the PRIMAGE project has created an open-cloud platform that combines imaging, clinical, and molecular data together with AI models developed from this data, creating a comprehensive decision support environment for clinicians managing patients with these two cancers. In order to achieve this, a standardized data processing and analysis workflow was implemented to generate robust and reliable predictions for different clinical endpoints. Magnetic resonance (MR) image harmonization and registration was performed as part of the workflow. Subsequently, an automated tool for the detection and segmentation of tumors was trained and internally validated. The Dice similarity coefficient obtained for the independent validation dataset was 0.997, indicating compatibility with the manual segmentation variability. Following this, radiomics and deep features were extracted and correlated with clinical endpoints. Finally, reproducible and relevant imaging quantitative features were integrated with clinical and molecular data to enrich both the predictive models and a set of visual analytics tools, making the PRIMAGE platform a complete clinical decision aid system. In order to ensure the advancement of research in this field and to foster engagement with the wider research community, the PRIMAGE data repository and platform are currently being integrated into the European Federation for Cancer Images (EUCAIM), which is the largest European cancer imaging research infrastructure created to date.
Collapse
Affiliation(s)
- Diana Veiga-Canuto
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026, Valencia, Spain.
- Área Clínica de Imagen Médica, Área Clínica de Imagen Médica, Hospital Universitari i Politècnic La Fe, Avinguda Fernando Abril Martorell, 106 Torre E planta 0, 46026, València, Spain.
| | - Leonor Cerdá Alberich
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026, Valencia, Spain
| | - Matías Fernández-Patón
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026, Valencia, Spain
| | | | | | - Ana Miguel Blanco
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026, Valencia, Spain
| | - Blanca Martínez de Las Heras
- Pediatric Oncology Department, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre G planta 2, 46026, Valencia, Spain
| | - Cinta Sangüesa Nebot
- Área Clínica de Imagen Médica, Área Clínica de Imagen Médica, Hospital Universitari i Politècnic La Fe, Avinguda Fernando Abril Martorell, 106 Torre E planta 0, 46026, València, Spain
| | - Luis Martí-Bonmatí
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A planta 7, 46026, Valencia, Spain
- Área Clínica de Imagen Médica, Área Clínica de Imagen Médica, Hospital Universitari i Politècnic La Fe, Avinguda Fernando Abril Martorell, 106 Torre E planta 0, 46026, València, Spain
| |
Collapse
|
9
|
Gandhi DB, Khalili N, Familiar AM, Gottipati A, Khalili N, Tu W, Haldar S, Anderson H, Viswanathan K, Storm PB, Ware JB, Resnick A, Vossough A, Nabavizadeh A, Fathi Kazerooni A. Automated pediatric brain tumor imaging assessment tool from CBTN: Enhancing suprasellar region inclusion and managing limited data with deep learning. Neurooncol Adv 2024; 6:vdae190. [PMID: 39717438 PMCID: PMC11664259 DOI: 10.1093/noajnl/vdae190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2024] Open
Abstract
Background Fully automatic skull-stripping and tumor segmentation are crucial for monitoring pediatric brain tumors (PBT). Current methods, however, often lack generalizability, particularly for rare tumors in the sellar/suprasellar regions and when applied to real-world clinical data in limited data scenarios. To address these challenges, we propose AI-driven techniques for skull-stripping and tumor segmentation. Methods Multi-institutional, multi-parametric MRI scans from 527 pediatric patients (n = 336 for skull-stripping, n = 489 for tumor segmentation) with various PBT histologies were processed to train separate nnU-Net-based deep learning models for skull-stripping, whole tumor (WT), and enhancing tumor (ET) segmentation. These models utilized single (T2/FLAIR) or multiple (T1-Gd and T2/FLAIR) input imaging sequences. Performance was evaluated using Dice scores, sensitivity, and 95% Hausdorff distances. Statistical comparisons included paired or unpaired 2-sample t-tests and Pearson's correlation coefficient based on Dice scores from different models and PBT histologies. Results Dice scores for the skull-stripping models for whole brain and sellar/suprasellar region segmentation were 0.98 ± 0.01 (median 0.98) for both multi- and single-parametric models, with significant Pearson's correlation coefficient between single- and multi-parametric Dice scores (r > 0.80; P < .05 for all). Whole tumor Dice scores for single-input tumor segmentation models were 0.84 ± 0.17 (median = 0.90) for T2 and 0.82 ± 0.19 (median = 0.89) for FLAIR inputs. Enhancing tumor Dice scores were 0.65 ± 0.35 (median = 0.79) for T1-Gd+FLAIR and 0.64 ± 0.36 (median = 0.79) for T1-Gd+T2 inputs. Conclusion Our skull-stripping models demonstrate excellent performance and include sellar/suprasellar regions, using single- or multi-parametric inputs. Additionally, our automated tumor segmentation models can reliably delineate whole lesions and ET regions, adapting to MRI sessions with missing sequences in limited data context.
Collapse
Affiliation(s)
- Deep B Gandhi
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Nastaran Khalili
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Ariana M Familiar
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Anurag Gottipati
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Neda Khalili
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Wenxin Tu
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Shuvanjan Haldar
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Hannah Anderson
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Karthik Viswanathan
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Phillip B Storm
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Department of Neurosurgery, The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Jeffrey B Ware
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Adam Resnick
- Department of Neurosurgery, The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Arastoo Vossough
- Division of Radiology, Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Ali Nabavizadeh
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Anahita Fathi Kazerooni
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Department of Neurosurgery, The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Center for Data-Driven Discovery in Biomedicine (Db), The Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| |
Collapse
|
10
|
Wang H, Chen X, He L. A narrative review of radiomics and deep learning advances in neuroblastoma: updates and challenges. Pediatr Radiol 2023; 53:2742-2755. [PMID: 37945937 DOI: 10.1007/s00247-023-05792-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 10/09/2023] [Accepted: 10/10/2023] [Indexed: 11/12/2023]
Abstract
Neuroblastoma is an extremely heterogeneous tumor that commonly occurs in children. The diagnosis and treatment of this tumor pose considerable challenges due to its varied clinical presentations and intricate genetic aberrations. Presently, various imaging modalities, including computed tomography, magnetic resonance imaging, and positron emission tomography, are utilized to assess neuroblastoma. Nevertheless, these conventional imaging modalities have limitations in providing quantitative information for accurate diagnosis and prognosis. Radiomics, an emerging technique, can extract intricate medical imaging information that is imperceptible to the human eye and transform it into quantitative data. In conjunction with deep learning algorithms, radiomics holds great promise in complementing existing imaging modalities. The aim of this review is to showcase the potential of radiomics and deep learning advancements to enhance the diagnostic capabilities of current imaging modalities for neuroblastoma.
Collapse
Affiliation(s)
- Haoru Wang
- Department of Radiology, Children's Hospital of Chongqing Medical University, 136 Zhongshan Road 2, Yuzhong District, Chongqing, 400014, China
- National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
| | - Xin Chen
- Department of Radiology, Children's Hospital of Chongqing Medical University, 136 Zhongshan Road 2, Yuzhong District, Chongqing, 400014, China
- National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
| | - Ling He
- Department of Radiology, Children's Hospital of Chongqing Medical University, 136 Zhongshan Road 2, Yuzhong District, Chongqing, 400014, China.
- National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China.
- Chongqing Key Laboratory of Pediatrics, Chongqing, China.
| |
Collapse
|
11
|
Wang MM, Li JQ, Dou SH, Li HJ, Qiu ZB, Zhang C, Yang XW, Zhang JT, Qiu XH, Xie HS, Tang WF, Cheng ML, Yan HH, Yang XN, Wu YL, Zhang XG, Yang L, Zhong WZ. Lack of incremental value of three-dimensional measurement in assessing invasiveness for lung cancer. Eur J Cardiothorac Surg 2023; 64:ezad373. [PMID: 37975876 PMCID: PMC10753921 DOI: 10.1093/ejcts/ezad373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 06/22/2023] [Accepted: 11/16/2023] [Indexed: 11/19/2023] Open
Abstract
OBJECTIVES The aim of this study was to evaluate the performance of consolidation-to-tumour ratio (CTR) and the radiomic models in two- and three-dimensional modalities for assessing radiological invasiveness in early-stage lung adenocarcinoma. METHODS A retrospective analysis was conducted on patients with early-stage lung adenocarcinoma from Guangdong Provincial People's Hospital and Shenzhen People's Hospital. Manual delineation of pulmonary nodules along the boundary was performed on cross-sectional images to extract radiomic features. Clinicopathological characteristics and radiomic signatures were identified in both cohorts. CTR and radiomic score for every patient were calculated. The performance of CTR and radiomic models were tested and validated in the respective cohorts. RESULTS A total of 818 patients from Guangdong Provincial People's Hospital were included in the primary cohort, while 474 patients from Shenzhen People's Hospital constituted an independent validation cohort. Both CTR and radiomic score were identified as independent factors for predicting pathological invasiveness. CTR in two- and three-dimensional modalities exhibited comparable results with areas under the receiver operating characteristic curves and were demonstrated in the validation cohort (area under the curve: 0.807 vs 0.826, P = 0.059) Furthermore, both CTR in two- and three-dimensional modalities was able to stratify patients with significant relapse-free survival (P < 0.000 vs P < 0.000) and overall survival (P = 0.003 vs P = 0.001). The radiomic models in two- and three-dimensional modalities demonstrated favourable discrimination and calibration in independent cohorts (P = 0.189). CONCLUSIONS Three-dimensional measurement provides no additional clinical benefit compared to two-dimensional.
Collapse
Affiliation(s)
- Meng-Min Wang
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Jia-Qi Li
- Bioinformatics Division, BNRIST and MOE Key Lab of Bioinformatics, Department of Automation, Tsinghua University, Beijing, China
| | - Shi-Hua Dou
- Department of Thoracic Surgery, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen, China
| | - Hong-Ji Li
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Zhen-Bin Qiu
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Chao Zhang
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Xiong-Wen Yang
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Jia-Tao Zhang
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Xin-Hua Qiu
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Hong-Sheng Xie
- Department of Thoracic Surgery, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen, China
| | - Wen-Fang Tang
- Department of Cardiothoracic Surgery, Zhongshan City People's Hospital, Zhongshan, China
| | - Mei-Ling Cheng
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Hong-Hong Yan
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Xue-Ning Yang
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Yi-Long Wu
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Xue-Gong Zhang
- Bioinformatics Division, BNRIST and MOE Key Lab of Bioinformatics, Department of Automation, Tsinghua University, Beijing, China
- School of Medicine, Tsinghua University, Beijing, China
| | - Lin Yang
- Department of Thoracic Surgery, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen, China
| | - Wen-Zhao Zhong
- Guangdong Lung Cancer Institute, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| |
Collapse
|
12
|
Lilieholm T, McMillan A, Ahmed A, Henningsen M, Larson M, Block WF. Neural network for autonomous segmentation and volumetric assessment of clot and edema in acute and subacute intracerebral hemorrhages. Magn Reson Imaging 2023; 103:162-168. [PMID: 37541456 PMCID: PMC10528387 DOI: 10.1016/j.mri.2023.07.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 07/28/2023] [Accepted: 07/31/2023] [Indexed: 08/06/2023]
Abstract
INTRODUCTION Minimally-invasive surgical techniques for intracerebral hemorrhage (ICH) evacuation use imaging to guide the suction, lysing and/or drainage from the hemorrhage site via various designs. A previous international surgical study has shown that reduction of hematoma volume below 15 ml is indicative of improved long term patient outcomes. The study noted a need for tools to periodically visualize remaining clot during intervention to increase the likelihood of evacuating sufficient clot volumes without endangering rebleeds. Robust segmentation of MRI could guide surgeons and radiologists regarding remaining regions and approaches for prudent evacuation. We thus propose a Convolutional Neural Network (CNN) to identify and autonomously segment clot and peripheral edema in MR images of the brain and generate an estimate of the remaining clot volume. MATERIALS AND METHODS We used a retrospective, locally-acquired dataset of ICH patient scans taken on 3 T MRI scanners. Three sets of ground truth manual segmentations were independently generated by two imaging scientists and one radiology fellow. Evaluation of clot age was determined based on relative contrast of hemorrhage components and reviewed by a neurosurgeon. Model accuracy was determined by pixel-wise Dice coefficient (DC) calculations between each ground truth manual segmentation and the machine-derived autonomous segmentations. RESULTS The model produced autonomous segmentations of clot core with an average DC of 0.75 ± 0.21 relative to manual segmentations of the same scans. For edema, it produced segmentations with an average DC of 0.68 ± 0.16 relative to manual. From these pixel-wise segmentations, clot volume can be calculated. Model-produced segmentations underestimated clot volumes by an average of 17% relative to ground-truth. CONCLUSION The machine learning models were able to identify and segment volumes of ICH components swiftly and accurately.
Collapse
Affiliation(s)
- Thomas Lilieholm
- Department of Medical Physics, University of Wisconsin at Madison, Madison, WI, USA.
| | - Alan McMillan
- Department of Medical Physics, University of Wisconsin at Madison, Madison, WI, USA; Department of Radiology, University of Wisconsin at Madison, Madison, WI, USA; Deparment of Biomedical Engineering, University of Wisconsin at Madison, Madison, WI, USA
| | - Azam Ahmed
- Department of Neurosurgery, University of Wisconsin at Madison, Madison, WI, USA
| | - Matthew Henningsen
- Department of Electrical Engineering, University of Wisconsin at Madison, Madison, WI, USA
| | - Matthew Larson
- Department of Radiology, University of Wisconsin at Madison, Madison, WI, USA
| | - Walter F Block
- Department of Medical Physics, University of Wisconsin at Madison, Madison, WI, USA; Department of Radiology, University of Wisconsin at Madison, Madison, WI, USA; Deparment of Biomedical Engineering, University of Wisconsin at Madison, Madison, WI, USA
| |
Collapse
|
13
|
Borau C, Wertheim KY, Hervas-Raluy S, Sainz-DeMena D, Walker D, Chisholm R, Richmond P, Varella V, Viceconti M, Montero A, Gregori-Puigjané E, Mestres J, Kasztelnik M, García-Aznar JM. A multiscale orchestrated computational framework to reveal emergent phenomena in neuroblastoma. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 241:107742. [PMID: 37572512 DOI: 10.1016/j.cmpb.2023.107742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 07/19/2023] [Accepted: 07/31/2023] [Indexed: 08/14/2023]
Abstract
Neuroblastoma is a complex and aggressive type of cancer that affects children. Current treatments involve a combination of surgery, chemotherapy, radiotherapy, and stem cell transplantation. However, treatment outcomes vary due to the heterogeneous nature of the disease. Computational models have been used to analyse data, simulate biological processes, and predict disease progression and treatment outcomes. While continuum cancer models capture the overall behaviour of tumours, and agent-based models represent the complex behaviour of individual cells, multiscale models represent interactions at different organisational levels, providing a more comprehensive understanding of the system. In 2018, the PRIMAGE consortium was formed to build a cloud-based decision support system for neuroblastoma, including a multi-scale model for patient-specific simulations of disease progression. In this work we have developed this multi-scale model that includes data such as patient's tumour geometry, cellularity, vascularization, genetics and type of chemotherapy treatment, and integrated it into an online platform that runs the simulations on a high-performance computation cluster using Onedata and Kubernetes technologies. This infrastructure will allow clinicians to optimise treatment regimens and reduce the number of costly and time-consuming clinical trials. This manuscript outlines the challenging framework's model architecture, data workflow, hypothesis, and resources employed in its development.
Collapse
Affiliation(s)
- C Borau
- Multiscale in Mechanical and Biological Engineering (M2BE), Aragon Institute of Engineering Research (I3A), Mechanical Engineering Department, University of Zaragoza, Zaragoza, Spain.
| | - K Y Wertheim
- Department of Computer Science and InsigneoInstitute for In Silico Medicine, University of Sheffield, Sheffield, United Kingdom; Centre of Excellence for Data Science, Artificial Intelligence and Modelling and School of Computer Science, University of Hull, Kingston upon Hull, United Kingdom
| | - S Hervas-Raluy
- Multiscale in Mechanical and Biological Engineering (M2BE), Aragon Institute of Engineering Research (I3A), Mechanical Engineering Department, University of Zaragoza, Zaragoza, Spain
| | - D Sainz-DeMena
- Multiscale in Mechanical and Biological Engineering (M2BE), Aragon Institute of Engineering Research (I3A), Mechanical Engineering Department, University of Zaragoza, Zaragoza, Spain
| | - D Walker
- Department of Computer Science and InsigneoInstitute for In Silico Medicine, University of Sheffield, Sheffield, United Kingdom
| | - R Chisholm
- Department of Computer Science and InsigneoInstitute for In Silico Medicine, University of Sheffield, Sheffield, United Kingdom
| | - P Richmond
- Department of Computer Science and InsigneoInstitute for In Silico Medicine, University of Sheffield, Sheffield, United Kingdom
| | - V Varella
- Department of Industrial Engineering, Alma Mater Studiorum - University of Bologna, Bologna, Italy; Medical Technology Lab, IRCCS Istituto Ortopedico Rizzoli, Bologna, Italy
| | - M Viceconti
- Department of Industrial Engineering, Alma Mater Studiorum - University of Bologna, Bologna, Italy; Medical Technology Lab, IRCCS Istituto Ortopedico Rizzoli, Bologna, Italy
| | - A Montero
- Chemotargets SL, Baldiri Reixac 4, Parc Cientific de Barcelona (PCB), Barcelona, Spain
| | - E Gregori-Puigjané
- Chemotargets SL, Baldiri Reixac 4, Parc Cientific de Barcelona (PCB), Barcelona, Spain
| | - J Mestres
- Chemotargets SL, Baldiri Reixac 4, Parc Cientific de Barcelona (PCB), Barcelona, Spain
| | - M Kasztelnik
- ACC Cyfronet, AGH University of Science and Technology, Kraków, Poland
| | - J M García-Aznar
- Multiscale in Mechanical and Biological Engineering (M2BE), Aragon Institute of Engineering Research (I3A), Mechanical Engineering Department, University of Zaragoza, Zaragoza, Spain
| |
Collapse
|
14
|
Kawula M, Vagni M, Cusumano D, Boldrini L, Placidi L, Corradini S, Belka C, Landry G, Kurz C. Prior knowledge based deep learning auto-segmentation in magnetic resonance imaging-guided radiotherapy of prostate cancer. Phys Imaging Radiat Oncol 2023; 28:100498. [PMID: 37928618 PMCID: PMC10624570 DOI: 10.1016/j.phro.2023.100498] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 10/03/2023] [Accepted: 10/04/2023] [Indexed: 11/07/2023] Open
Abstract
Background and purpose Automation is desirable for organ segmentation in radiotherapy. This study compared deep learning methods for auto-segmentation of organs-at-risk (OARs) and clinical target volume (CTV) in prostate cancer patients undergoing fractionated magnetic resonance (MR)-guided adaptive radiation therapy. Models predicting dense displacement fields (DDFMs) between planning and fraction images were compared to patient-specific (PSM) and baseline (BM) segmentation models. Materials and methods A dataset of 92 patients with planning and fraction MR images (MRIs) from two institutions were used. DDFMs were trained to predict dense displacement fields (DDFs) between the planning and fraction images, which were subsequently used to propagate the planning contours of the bladder, rectum, and CTV to the daily MRI. The training was performed either with true planning-fraction image pairs or with planning images and their counterparts deformed by known DDFs. The BMs were trained on 53 planning images, while to generate PSMs, the BMs were fine-tuned using the planning image of a given single patient. The evaluation included Dice similarity coefficient (DSC), the average (HDavg) and the 95th percentile (HD95) Hausdorff distance (HD). Results The DDFMs with DSCs for bladder/rectum of 0.76/0.76 performed worse than PSMs (0.91/0.90) and BMs (0.89/0.88). The same trend was observed for HDs. For CTV, DDFM and PSM performed similarly yielding DSCs of 0.87 and 0.84, respectively. Conclusions DDFMs were found suitable for CTV delineation after rigid alignment. However, for OARs they were outperformed by PSMs, as they predicted only limited deformations even in the presence of substantial anatomical changes.
Collapse
Affiliation(s)
- Maria Kawula
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Munich, Germany
| | - Marica Vagni
- Fondazione Policlinico Universitario “Agostino Gemelli” IRCCS, Rome, Italy
| | - Davide Cusumano
- Fondazione Policlinico Universitario “Agostino Gemelli” IRCCS, Rome, Italy
- Mater Olbia Hospital, Olbia (SS), Italy
| | - Luca Boldrini
- Fondazione Policlinico Universitario “Agostino Gemelli” IRCCS, Rome, Italy
| | - Lorenzo Placidi
- Fondazione Policlinico Universitario “Agostino Gemelli” IRCCS, Rome, Italy
| | - Stefanie Corradini
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Munich, Germany
| | - Claus Belka
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Munich, Germany
- German Cancer Consortium (DKTK), Partner Site Munich, A Partnership Between DKFZ and LMU University Hospital Munich, Germany
- Bavarian Cancer Research Center (BZKF), Munich, Germany
| | - Guillaume Landry
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Munich, Germany
| | - Christopher Kurz
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Munich, Germany
| |
Collapse
|
15
|
Isaksson LJ, Summers P, Mastroleo F, Marvaso G, Corrao G, Vincini MG, Zaffaroni M, Ceci F, Petralia G, Orecchia R, Jereczek-Fossa BA. Automatic Segmentation with Deep Learning in Radiotherapy. Cancers (Basel) 2023; 15:4389. [PMID: 37686665 PMCID: PMC10486603 DOI: 10.3390/cancers15174389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 08/28/2023] [Accepted: 08/30/2023] [Indexed: 09/10/2023] Open
Abstract
This review provides a formal overview of current automatic segmentation studies that use deep learning in radiotherapy. It covers 807 published papers and includes multiple cancer sites, image types (CT/MRI/PET), and segmentation methods. We collect key statistics about the papers to uncover commonalities, trends, and methods, and identify areas where more research might be needed. Moreover, we analyzed the corpus by posing explicit questions aimed at providing high-quality and actionable insights, including: "What should researchers think about when starting a segmentation study?", "How can research practices in medical image segmentation be improved?", "What is missing from the current corpus?", and more. This allowed us to provide practical guidelines on how to conduct a good segmentation study in today's competitive environment that will be useful for future research within the field, regardless of the specific radiotherapeutic subfield. To aid in our analysis, we used the large language model ChatGPT to condense information.
Collapse
Affiliation(s)
- Lars Johannes Isaksson
- Division of Radiation Oncology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy; (L.J.I.); (F.M.); (G.C.); (M.G.V.); (M.Z.); (B.A.J.-F.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20141 Milan, Italy; (F.C.); (G.P.)
| | - Paul Summers
- Division of Radiology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy;
| | - Federico Mastroleo
- Division of Radiation Oncology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy; (L.J.I.); (F.M.); (G.C.); (M.G.V.); (M.Z.); (B.A.J.-F.)
- Department of Translational Medicine, University of Piemonte Orientale (UPO), 20188 Novara, Italy
| | - Giulia Marvaso
- Division of Radiation Oncology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy; (L.J.I.); (F.M.); (G.C.); (M.G.V.); (M.Z.); (B.A.J.-F.)
| | - Giulia Corrao
- Division of Radiation Oncology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy; (L.J.I.); (F.M.); (G.C.); (M.G.V.); (M.Z.); (B.A.J.-F.)
| | - Maria Giulia Vincini
- Division of Radiation Oncology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy; (L.J.I.); (F.M.); (G.C.); (M.G.V.); (M.Z.); (B.A.J.-F.)
| | - Mattia Zaffaroni
- Division of Radiation Oncology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy; (L.J.I.); (F.M.); (G.C.); (M.G.V.); (M.Z.); (B.A.J.-F.)
| | - Francesco Ceci
- Department of Oncology and Hemato-Oncology, University of Milan, 20141 Milan, Italy; (F.C.); (G.P.)
- Division of Nuclear Medicine, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy
| | - Giuseppe Petralia
- Department of Oncology and Hemato-Oncology, University of Milan, 20141 Milan, Italy; (F.C.); (G.P.)
- Precision Imaging and Research Unit, Department of Medical Imaging and Radiation Sciences, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy
| | - Roberto Orecchia
- Scientific Directorate, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy;
| | - Barbara Alicja Jereczek-Fossa
- Division of Radiation Oncology, IEO European Institute of Oncology IRCCS, 20141 Milan, Italy; (L.J.I.); (F.M.); (G.C.); (M.G.V.); (M.Z.); (B.A.J.-F.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20141 Milan, Italy; (F.C.); (G.P.)
| |
Collapse
|
16
|
Italia M, Wertheim KY, Taschner-Mandl S, Walker D, Dercole F. Mathematical Model of Clonal Evolution Proposes a Personalised Multi-Modal Therapy for High-Risk Neuroblastoma. Cancers (Basel) 2023; 15:cancers15071986. [PMID: 37046647 PMCID: PMC10093626 DOI: 10.3390/cancers15071986] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 03/15/2023] [Accepted: 03/24/2023] [Indexed: 03/29/2023] Open
Abstract
Neuroblastoma is the most common extra-cranial solid tumour in children. Despite multi-modal therapy, over half of the high-risk patients will succumb. One contributing factor is the one-size-fits-all nature of multi-modal therapy. For example, during the first step (induction chemotherapy), the standard regimen (rapid COJEC) administers fixed doses of chemotherapeutic agents in eight two-week cycles. Perhaps because of differences in resistance, this standard regimen results in highly heterogeneous outcomes in different tumours. In this study, we formulated a mathematical model comprising ordinary differential equations. The equations describe the clonal evolution within a neuroblastoma tumour being treated with vincristine and cyclophosphamide, which are used in the rapid COJEC regimen, including genetically conferred and phenotypic drug resistance. The equations also describe the agents’ pharmacokinetics. We devised an optimisation algorithm to find the best chemotherapy schedules for tumours with different pre-treatment clonal compositions. The optimised chemotherapy schedules exploit the cytotoxic difference between the two drugs and intra-tumoural clonal competition to shrink the tumours as much as possible during induction chemotherapy and before surgical removal. They indicate that induction chemotherapy can be improved by finding and using personalised schedules. More broadly, we propose that the overall multi-modal therapy can be enhanced by employing targeted therapies against the mutations and oncogenic pathways enriched and activated by the chemotherapeutic agents. To translate the proposed personalised multi-modal therapy into clinical use, patient-specific model calibration and treatment optimisation are necessary. This entails a decision support system informed by emerging medical technologies such as multi-region sequencing and liquid biopsies. The results and tools presented in this paper could be the foundation of this decision support system.
Collapse
Affiliation(s)
- Matteo Italia
- Department of Electronic, Information, and Bioengineering, Politecnico di Milano, 20133 Milano, Italy
- Correspondence:
| | - Kenneth Y. Wertheim
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield S10 2TN, UK
- Department of Computer Science, University of Sheffield, Sheffield S10 2TN, UK
- Centre of Excellence for Data Science, Artificial Intelligence, and Modelling, University of Hull, Kingston upon Hull HU6 7RX, UK
- School of Computer Science, University of Hull, Kingston upon Hull HU6 7RX, UK
| | | | - Dawn Walker
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield S10 2TN, UK
- Department of Computer Science, University of Sheffield, Sheffield S10 2TN, UK
| | - Fabio Dercole
- Department of Electronic, Information, and Bioengineering, Politecnico di Milano, 20133 Milano, Italy
| |
Collapse
|
17
|
Whole-tumor radiomics analysis of T2-weighted imaging in differentiating neuroblastoma from ganglioneuroblastoma/ganglioneuroma in children: an exploratory study. Abdom Radiol (NY) 2023; 48:1372-1382. [PMID: 36892608 DOI: 10.1007/s00261-023-03862-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Revised: 02/15/2023] [Accepted: 02/16/2023] [Indexed: 03/10/2023]
Abstract
PURPOSE To examine the potential of whole-tumor radiomics analysis of T2-weighted imaging (T2WI) in differentiating neuroblastoma (NB) from ganglioneuroblastoma/ganglioneuroma (GNB/GN) in children. MATERIALS AND METHODS This study included 102 children with peripheral neuroblastic tumors, comprising 47 NB patients and 55 GNB/GN patients, which were randomly divided into a training group (n = 72) and a test group (n = 30). Radiomics features were extracted from T2WI images, and feature dimensionality reduction was applied. Linear discriminant analysis was used to construct radiomics models, and one-standard error role combined with leave-one-out cross-validation was used to choose the optimal radiomics model with the least predictive error. Subsequently, the patient age at initial diagnosis and the selected radiomics features were incorporated to construct a combined model. The receiver operator characteristic (ROC) curve, decision curve analysis (DCA) and clinical impact curve (CIC) were applied to evaluate the diagnostic performance and clinical utility of the models. RESULTS Fifteen radiomics features were eventually chosen to construct the optimal radiomics model. The area under the curve (AUC) of the radiomics model in the training group and test group was 0.940 [95% confidence interval (CI) 0.886, 0.995] and 0.799 (95%CI 0.632, 0.966), respectively. The combined model, which incorporated patient age and radiomics features, achieved an AUC of 0.963 (95%CI 0.925, 1.000) in the training group and 0.871 (95%CI 0.744, 0.997) in the test group. DCA and CIC demonstrated that the radiomics model and combined model could provide benefits at various thresholds, with the combined model being superior to the radiomics model. CONCLUSION Radiomics features derived from T2WI, in combination with the age of the patient at initial diagnosis, may offer a quantitative method for distinguishing NB from GNB/GN, thus aiding in the pathological differentiation of peripheral neuroblastic tumors in children.
Collapse
|
18
|
Veiga-Canuto D, Cerdà-Alberich L, Jiménez-Pastor A, Carot Sierra JM, Gomis-Maya A, Sangüesa-Nebot C, Fernández-Patón M, Martínez de las Heras B, Taschner-Mandl S, Düster V, Pötschger U, Simon T, Neri E, Alberich-Bayarri Á, Cañete A, Hero B, Ladenstein R, Martí-Bonmatí L. Independent Validation of a Deep Learning nnU-Net Tool for Neuroblastoma Detection and Segmentation in MR Images. Cancers (Basel) 2023; 15:cancers15051622. [PMID: 36900410 PMCID: PMC10000775 DOI: 10.3390/cancers15051622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 02/22/2023] [Accepted: 03/05/2023] [Indexed: 03/08/2023] Open
Abstract
OBJECTIVES To externally validate and assess the accuracy of a previously trained fully automatic nnU-Net CNN algorithm to identify and segment primary neuroblastoma tumors in MR images in a large children cohort. METHODS An international multicenter, multivendor imaging repository of patients with neuroblastic tumors was used to validate the performance of a trained Machine Learning (ML) tool to identify and delineate primary neuroblastoma tumors. The dataset was heterogeneous and completely independent from the one used to train and tune the model, consisting of 300 children with neuroblastic tumors having 535 MR T2-weighted sequences (486 sequences at diagnosis and 49 after finalization of the first phase of chemotherapy). The automatic segmentation algorithm was based on a nnU-Net architecture developed within the PRIMAGE project. For comparison, the segmentation masks were manually edited by an expert radiologist, and the time for the manual editing was recorded. Different overlaps and spatial metrics were calculated to compare both masks. RESULTS The median Dice Similarity Coefficient (DSC) was high 0.997; 0.944-1.000 (median; Q1-Q3). In 18 MR sequences (6%), the net was not able neither to identify nor segment the tumor. No differences were found regarding the MR magnetic field, type of T2 sequence, or tumor location. No significant differences in the performance of the net were found in patients with an MR performed after chemotherapy. The time for visual inspection of the generated masks was 7.9 ± 7.5 (mean ± Standard Deviation (SD)) seconds. Those cases where manual editing was needed (136 masks) required 124 ± 120 s. CONCLUSIONS The automatic CNN was able to locate and segment the primary tumor on the T2-weighted images in 94% of cases. There was an extremely high agreement between the automatic tool and the manually edited masks. This is the first study to validate an automatic segmentation model for neuroblastic tumor identification and segmentation with body MR images. The semi-automatic approach with minor manual editing of the deep learning segmentation increases the radiologist's confidence in the solution with a minor workload for the radiologist.
Collapse
Affiliation(s)
- Diana Veiga-Canuto
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Área Clínica de Imagen Médica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Correspondence: (D.V.-C.); (L.M.-B.)
| | - Leonor Cerdà-Alberich
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Ana Jiménez-Pastor
- Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, 46026 Valencia, Spain
| | - José Miguel Carot Sierra
- Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Camí de Vera s/n, 46022 Valencia, Spain
| | - Armando Gomis-Maya
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Cinta Sangüesa-Nebot
- Área Clínica de Imagen Médica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Matías Fernández-Patón
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Blanca Martínez de las Heras
- Unidad de Oncohematología Pediátrica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Sabine Taschner-Mandl
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Vanessa Düster
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Ulrike Pötschger
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Thorsten Simon
- Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical Faculty, University of Cologne, 50937 Cologne, Germany
| | - Emanuele Neri
- Academic Radiology, Department of Translational Research, University of Pisa, Via Roma, 67, 56126 Pisa, Italy
| | | | - Adela Cañete
- Unidad de Oncohematología Pediátrica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Barbara Hero
- Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical Faculty, University of Cologne, 50937 Cologne, Germany
| | - Ruth Ladenstein
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Luis Martí-Bonmatí
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Área Clínica de Imagen Médica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Correspondence: (D.V.-C.); (L.M.-B.)
| |
Collapse
|