1
|
Fazekas B, Aresta G, Lachinov D, Riedl S, Mai J, Schmidt-Erfurth U, Bogunović H. SD-LayerNet: Robust and label-efficient retinal layer segmentation via anatomical priors. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2025; 261:108586. [PMID: 39809093 DOI: 10.1016/j.cmpb.2025.108586] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Revised: 12/12/2024] [Accepted: 01/01/2025] [Indexed: 01/16/2025]
Abstract
BACKGROUND AND OBJECTIVES Automated, anatomically coherent retinal layer segmentation in optical coherence tomography (OCT) is one of the most important components of retinal disease management. However, current methods rely on large amounts of labeled data, which can be difficult and expensive to obtain. In addition, these systems tend often propose anatomically impossible results, which undermines their clinical reliability. METHODS This study introduces a semi-supervised approach to retinal layer segmentation that leverages large amounts of unlabeled data and anatomical prior knowledge related to the structure of the retina. During training, we use a novel topological engine that converts inferred retinal layer boundaries into pixel-wise structured segmentations. These compose a set of anatomically valid disentangled representations which, together with predicted style factors, are used to reconstruct the input image. At training time, the retinal layer boundaries and pixel-wise predictions are both guided by reference annotations, where available, but more importantly by innovatively exploiting anatomical priors that improve the performance, robustness and coherence of the method even if only a small amount of labeled data is available. RESULTS Exhaustive experiments with respect to label efficiency, contribution of unsupervised data and robustness to different acquisition settings were conducted. The proposed method showed state of-the-art performance on all the studied public and internal datasets, specially in low annotated data regimes. Additionally, the model was able to make use of unlabeled data from a different domain with only a small performance drop in comparison to a fully-supervised setting. CONCLUSION A novel, robust, label-efficient retinal layer segmentation method was proposed. The approach has shown state-of-the-art layer segmentation performance with a fraction of the training data available, while at the same time, its robustness against domain shift was also shown.
Collapse
Affiliation(s)
- Botond Fazekas
- Christian Doppler Laboratory for Artificial Intelligence in Retina, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria; Institute of Artificial Intelligence, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria.
| | - Guilherme Aresta
- Christian Doppler Laboratory for Artificial Intelligence in Retina, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria; Institute of Artificial Intelligence, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria
| | - Dmitrii Lachinov
- Christian Doppler Laboratory for Artificial Intelligence in Retina, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria; Institute of Artificial Intelligence, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria
| | - Sophie Riedl
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria
| | - Julia Mai
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria
| | - Ursula Schmidt-Erfurth
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria
| | - Hrvoje Bogunović
- Christian Doppler Laboratory for Artificial Intelligence in Retina, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria; Institute of Artificial Intelligence, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
2
|
Khateri P, Koottungal T, Wong D, Strauss RW, Janeschitz-Kriegl L, Pfau M, Schmetterer L, Scholl HPN. Looking outside the box with a pathology aware AI approach for analyzing OCT retinal images in Stargardt disease. Sci Rep 2025; 15:4739. [PMID: 39922894 PMCID: PMC11807158 DOI: 10.1038/s41598-025-85213-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2024] [Accepted: 01/01/2025] [Indexed: 02/10/2025] Open
Abstract
Stargardt disease type 1 (STGD1) is a genetic disorder that leads to progressive vision loss, with no approved treatments currently available. The development of effective therapies faces the challenge of identifying appropriate outcome measures that accurately reflect treatment benefits. Optical Coherence Tomography (OCT) provides high-resolution retinal images, serving as a valuable tool for deriving potential outcome measures, such as retinal thickness. However, automated segmentation of OCT images, particularly in regions disrupted by degeneration, remains complex. In this study, we propose a deep learning-based approach that incorporates a pathology-aware loss function to segment retinal sublayers in OCT images from patients with STGD1. This method targets relatively unaffected regions for sublayer segmentation, ensuring accurate boundary delineation in areas with minimal disruption. In severely affected regions, identified by a box detection model, the total retina is segmented as a single layer to avoid errors. Our model significantly outperforms standard models, achieving an average Dice coefficient of [Formula: see text] for total retina and [Formula: see text] for retinal sublayers. The most substantial improvement was in the segmentation of the photoreceptor inner segment, with Dice coefficient increasing by [Formula: see text]. This approach provides a balance between granularity and reliability, making it suitable for clinical application in tracking disease progression and evaluating therapeutic efficacy.
Collapse
Affiliation(s)
- Parisa Khateri
- Institute of Molecular and Clinical Ophthalmology Basel, Basel, Switzerland.
- Department of Ophthalmology, University of Basel, Basel, Switzerland.
| | - Tiana Koottungal
- Institute of Molecular and Clinical Ophthalmology Basel, Basel, Switzerland
| | - Damon Wong
- Institute of Molecular and Clinical Ophthalmology Basel, Basel, Switzerland
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore
| | - Rupert W Strauss
- Institute of Molecular and Clinical Ophthalmology Basel, Basel, Switzerland
- Department of Ophthalmology, Medical University Graz, Graz, Austria
- Moorfields Eye Hospital, NHS Foundation Trust and UCL Institute of Ophthalmology, University College London, London, UK
| | - Lucas Janeschitz-Kriegl
- Institute of Molecular and Clinical Ophthalmology Basel, Basel, Switzerland
- Department of Ophthalmology, University of Basel, Basel, Switzerland
| | - Maximilian Pfau
- Department of Ophthalmology, University of Basel, Basel, Switzerland
- Department of Ophthalmology, University of Bonn, Bonn, Germany
- F. Hoffmann-La Roche AG, Basel, Switzerland
| | - Leopold Schmetterer
- Institute of Molecular and Clinical Ophthalmology Basel, Basel, Switzerland.
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore.
- Department of Clinical Pharmacology, Medical University of Vienna, Vienna, Austria.
- SERI-NTU Advanced Ocular Engineering (STANCE) Program, Singapore, Singapore.
- Ophthalmology and Visual Sciences Academic Clinical Program (Eye ACP), Duke-NUS MedicalSchool, Singapore, Singapore.
- School of Chemistry, Chemical Engineering and Biotechnology, Nanyang Technological University, Singapore, Singapore.
- Center for Medical Physics and Biomedical Engineering, Medical University Vienna, Vienna, Austria.
- Fondation Ophtalmologique Adolphe De Rothschild, Paris, France.
- Aier Hospital Group, Changsha, People's Republic of China.
| | - Hendrik P N Scholl
- Department of Clinical Pharmacology, Medical University of Vienna, Vienna, Austria.
- Pallas Kliniken AG, Pallas Klinik Zürich, Zürich, Switzerland.
- European Vision Institute, Basel, Switzerland.
| |
Collapse
|
3
|
Deussen DN, Heinke A, Elsner W, Galang CMB, Kalaw FGP, Warter A, Bartsch DU, Cheng L, Freeman WR. Effect of manual OCTA segmentation correction to improve image quality and visibility of choroidal neovascularization in AMD. Sci Rep 2024; 14:13990. [PMID: 38886462 PMCID: PMC11183238 DOI: 10.1038/s41598-024-61551-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 05/07/2024] [Indexed: 06/20/2024] Open
Abstract
In this retrospective case series on neovascular age-related macular degeneration (nAMD), we aimed to improve Choroidal Neovascularization (CNV) visualization in Optical Coherence Tomography Angiography (OCTA) scans by addressing segmentation errors. Out of 198 eyes, 73 OCTA scans required manual segmentation correction. We compared uncorrected scans to those with minimal (2 corrections), moderate (10 corrections), and detailed (50 corrections) efforts targeting falsely segmented Bruch's Membrane (BM). Results showed that 55% of corrected OCTAs exhibited improved quality after manual correction. Notably, minimal correction (2 scans) already led to significant improvements, with additional corrections (10 or 50) not further enhancing expert grading. Reduced background noise and improved CNV identification were observed, with the most substantial improvement after two corrections compared to baseline uncorrected images. In conclusion, our approach of correcting segmentation errors effectively enhances image quality in OCTA scans of nAMD. This study demonstrates the efficacy of the method, with 55% of resegmented OCTA images exhibiting enhanced quality, leading to a notable increase in the proportion of high-quality images from 63 to 83%.
Collapse
Affiliation(s)
- Daniel N Deussen
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Department of Ophthalmology, University Hospital, Ludwig-Maximilians-University, 80336, Munich, Germany
| | - Anna Heinke
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA.
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA.
| | - Wyatt Elsner
- The Department of Cognitive Science, University of California San Diego, San Diego, USA
| | - Carlo Miguel B Galang
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
| | - Fritz Gerald P Kalaw
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
| | - Alexandra Warter
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
| | - Dirk-Uwe Bartsch
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
| | - Lingyun Cheng
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
| | - William R Freeman
- Jacobs Retina Center, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
- Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, 9415 Campus Point Drive, La Jolla, CA, 92037, USA
| |
Collapse
|
4
|
Heinke A, Zhang H, Deussen D, Galang CMB, Warter A, Kalaw FGP, Bartsch DUG, Cheng L, An C, Nguyen T, Freeman WR. ARTIFICIAL INTELLIGENCE FOR OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY-BASED DISEASE ACTIVITY PREDICTION IN AGE-RELATED MACULAR DEGENERATION. Retina 2024; 44:465-474. [PMID: 37988102 PMCID: PMC10922109 DOI: 10.1097/iae.0000000000003977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
PURPOSE The authors hypothesize that optical coherence tomography angiography (OCTA)-visualized vascular morphology may be a predictor of choroidal neovascularization status in age-related macular degeneration (AMD). The authors thus evaluated the use of artificial intelligence (AI) to predict different stages of AMD disease based on OCTA en face 2D projections scans. METHODS Retrospective cross-sectional study based on collected 2D OCTA data from 310 high-resolution scans. Based on OCT B-scan fluid and clinical status, OCTA was classified as normal, dry AMD, wet AMD active, and wet AMD in remission with no signs of activity. Two human experts graded the same test set, and a consensus grading between two experts was used for the prediction of four categories. RESULTS The AI can achieve 80.36% accuracy on a four-category grading task with 2D OCTA projections. The sensitivity of prediction by AI was 0.7857 (active), 0.7142 (remission), 0.9286 (dry AMD), and 0.9286 (normal) and the specificity was 0.9524, 0.9524, 0.9286, and 0.9524, respectively. The sensitivity of prediction by human experts was 0.4286 active choroidal neovascularization, 0.2143 remission, 0.8571 dry AMD, and 0.8571 normal with specificity of 0.7619, 0.9286, 0.7857, and 0.9762, respectively. The overall AI classification prediction was significantly better than the human (odds ratio = 1.95, P = 0.0021). CONCLUSION These data show that choroidal neovascularization morphology can be used to predict disease activity by AI; longitudinal studies are needed to better understand the evolution of choroidal neovascularization and features that predict reactivation. Future studies will be able to evaluate the additional predicative value of OCTA on top of other imaging characteristics (i.e., fluid location on OCT B scans) to help predict response to treatment.
Collapse
Affiliation(s)
- Anna Heinke
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
| | - Haochen Zhang
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States
| | - Daniel Deussen
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
- University Eye Hospital, Ludwig-Maximillians-University, Munich, Germany
| | - Carlo Miguel B. Galang
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
| | - Alexandra Warter
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
| | - Fritz Gerald P. Kalaw
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
| | - Dirk-Uwe G. Bartsch
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
| | - Lingyun Cheng
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
| | - Cheolhong An
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States
| | - Truong Nguyen
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States
| | - William R. Freeman
- University of California at San Diego Department of Ophthalmology at the Shiley Eye Institute, La Jolla, CA, United States
- Joan and Irwin Jacobs Retina Center, La Jolla, CA, United States
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States
| |
Collapse
|