1
|
Multi-view convolutional neural networks for automated ocular structure and tumor segmentation in retinoblastoma. Sci Rep 2021; 11:14590. [PMID: 34272413 PMCID: PMC8285489 DOI: 10.1038/s41598-021-93905-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Accepted: 06/29/2021] [Indexed: 11/08/2022] Open
Abstract
In retinoblastoma, accurate segmentation of ocular structure and tumor tissue is important when working towards personalized treatment. This retrospective study serves to evaluate the performance of multi-view convolutional neural networks (MV-CNNs) for automated eye and tumor segmentation on MRI in retinoblastoma patients. Forty retinoblastoma and 20 healthy-eyes from 30 patients were included in a train/test (N = 29 retinoblastoma-, 17 healthy-eyes) and independent validation (N = 11 retinoblastoma-, 3 healthy-eyes) set. Imaging was done using 3.0 T Fast Imaging Employing Steady-state Acquisition (FIESTA), T2-weighted and contrast-enhanced T1-weighted sequences. Sclera, vitreous humour, lens, retinal detachment and tumor were manually delineated on FIESTA images to serve as a reference standard. Volumetric and spatial performance were assessed by calculating intra-class correlation (ICC) and dice similarity coefficient (DSC). Additionally, the effects of multi-scale, sequences and data augmentation were explored. Optimal performance was obtained by using a three-level pyramid MV-CNN with FIESTA, T2 and T1c sequences and data augmentation. Eye and tumor volumetric ICC were 0.997 and 0.996, respectively. Median [Interquartile range] DSC for eye, sclera, vitreous, lens, retinal detachment and tumor were 0.965 [0.950-0.975], 0.847 [0.782-0.893], 0.975 [0.930-0.986], 0.909 [0.847-0.951], 0.828 [0.458-0.962] and 0.914 [0.852-0.958], respectively. MV-CNN can be used to obtain accurate ocular structure and tumor segmentations in retinoblastoma.
Collapse
|
2
|
Niendorf T, Beenakker JWM, Langner S, Erb-Eigner K, Bach Cuadra M, Beller E, Millward JM, Niendorf TM, Stachs O. Ophthalmic Magnetic Resonance Imaging: Where Are We (Heading To)? Curr Eye Res 2021; 46:1251-1270. [PMID: 33535828 DOI: 10.1080/02713683.2021.1874021] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Magnetic resonance imaging of the eye and orbit (MReye) is a cross-domain research field, combining (bio)physics, (bio)engineering, physiology, data sciences and ophthalmology. A growing number of reports document technical innovations of MReye and promote their application in preclinical research and clinical science. Realizing the progress and promises, this review outlines current trends in MReye. Examples of MReye strategies and their clinical relevance are demonstrated. Frontier applications in ocular oncology, refractive surgery, ocular muscle disorders and orbital inflammation are presented and their implications for explorations into ophthalmic diseases are provided. Substantial progress in anatomically detailed, high-spatial resolution MReye of the eye, orbit and optic nerve is demonstrated. Recent developments in MReye of ocular tumors are explored, and its value for personalized eye models derived from machine learning in the treatment planning of uveal melanoma and evaluation of retinoblastoma is highlighted. The potential of MReye for monitoring drug distribution and for improving treatment management and the assessment of individual responses is discussed. To open a window into the eye and into (patho)physiological processes that in the past have been largely inaccessible, advances in MReye at ultrahigh magnetic field strengths are discussed. A concluding section ventures a glance beyond the horizon and explores future directions of MReye across multiple scales, including in vivo electrolyte mapping of sodium and other nuclei. This review underscores the need for the (bio)medical imaging and ophthalmic communities to expand efforts to find solutions to the remaining unsolved problems and technical obstacles of MReye, with the objective to transfer methodological advancements driven by MR physics into genuine clinical value.
Collapse
Affiliation(s)
- Thoralf Niendorf
- MRI.TOOLS GmbH, Berlin, Germany.,Berlin Ultrahigh Field Facility, Max Delbrueck Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany
| | - Jan-Willem M Beenakker
- Department of Ophthalmology and Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands
| | - Sönke Langner
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, Rostock University Medical Center, Rostock, Germany
| | - Katharina Erb-Eigner
- Department of Radiology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität Zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Meritxell Bach Cuadra
- Center for Biomedical Imaging (CIBM), Lausanne, Switzerland.,Department of Radiology, Lausanne University and University Hospital, Lausanne, Switzerland
| | - Ebba Beller
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, Rostock University Medical Center, Rostock, Germany
| | - Jason M Millward
- Berlin Ultrahigh Field Facility, Max Delbrueck Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany
| | | | - Oliver Stachs
- Department Life, Light & Matter, University Rostock, Rostock, Germany.,Department of Ophthalmology, Rostock University Medical Center, Rostock, Germany
| |
Collapse
|