Ocular Structures Segmentation from Multi-sequences MRI Using 3D Unet with Fully Connected CRFs

Multi-view convolutional neural networks for automated ocular structure and tumor segmentation in retinoblastoma

In retinoblastoma, accurate segmentation of ocular structure and tumor tissue is important when working towards personalized treatment. This retrospective study serves to evaluate the performance of multi-view convolutional neural networks (MV-CNNs) for automated eye and tumor segmentation on MRI in retinoblastoma patients. Forty retinoblastoma and 20 healthy-eyes from 30 patients were included in a train/test (N = 29 retinoblastoma-, 17 healthy-eyes) and independent validation (N = 11 retinoblastoma-, 3 healthy-eyes) set. Imaging was done using 3.0 T Fast Imaging Employing Steady-state Acquisition (FIESTA), T2-weighted and contrast-enhanced T1-weighted sequences. Sclera, vitreous humour, lens, retinal detachment and tumor were manually delineated on FIESTA images to serve as a reference standard. Volumetric and spatial performance were assessed by calculating intra-class correlation (ICC) and dice similarity coefficient (DSC). Additionally, the effects of multi-scale, sequences and data augmentation were explored. Optimal performance was obtained by using a three-level pyramid MV-CNN with FIESTA, T2 and T1c sequences and data augmentation. Eye and tumor volumetric ICC were 0.997 and 0.996, respectively. Median [Interquartile range] DSC for eye, sclera, vitreous, lens, retinal detachment and tumor were 0.965 [0.950-0.975], 0.847 [0.782-0.893], 0.975 [0.930-0.986], 0.909 [0.847-0.951], 0.828 [0.458-0.962] and 0.914 [0.852-0.958], respectively. MV-CNN can be used to obtain accurate ocular structure and tumor segmentations in retinoblastoma.

Ophthalmic Magnetic Resonance Imaging: Where Are We (Heading To)?

Magnetic resonance imaging of the eye and orbit (MReye) is a cross-domain research field, combining (bio)physics, (bio)engineering, physiology, data sciences and ophthalmology. A growing number of reports document technical innovations of MReye and promote their application in preclinical research and clinical science. Realizing the progress and promises, this review outlines current trends in MReye. Examples of MReye strategies and their clinical relevance are demonstrated. Frontier applications in ocular oncology, refractive surgery, ocular muscle disorders and orbital inflammation are presented and their implications for explorations into ophthalmic diseases are provided. Substantial progress in anatomically detailed, high-spatial resolution MReye of the eye, orbit and optic nerve is demonstrated. Recent developments in MReye of ocular tumors are explored, and its value for personalized eye models derived from machine learning in the treatment planning of uveal melanoma and evaluation of retinoblastoma is highlighted. The potential of MReye for monitoring drug distribution and for improving treatment management and the assessment of individual responses is discussed. To open a window into the eye and into (patho)physiological processes that in the past have been largely inaccessible, advances in MReye at ultrahigh magnetic field strengths are discussed. A concluding section ventures a glance beyond the horizon and explores future directions of MReye across multiple scales, including in vivo electrolyte mapping of sodium and other nuclei. This review underscores the need for the (bio)medical imaging and ophthalmic communities to expand efforts to find solutions to the remaining unsolved problems and technical obstacles of MReye, with the objective to transfer methodological advancements driven by MR physics into genuine clinical value.