Predicting Post-Therapeutic Visual Acuity and OCT Images in Patients With Central Serous Chorioretinopathy by Artificial Intelligence

Artificial intelligence in therapeutic management of hyperlipidemic ocular pathology

Hyperlipidemia has many ocular manifestations, the most prevalent being retinal vascular occlusion. Hyperlipidemic lesions and occlusions to the vessels supplying the retina result in permanent blindness, necessitating prompt detection and treatment. Retinal vascular occlusion is diagnosed using different imaging modalities, including optical coherence tomography angiography. These diagnostic techniques obtain images representing the blood flow through the retinal vessels, providing an opportunity for AI to utilize image recognition to detect blockages and abnormalities before patients present with symptoms. AI is already being used as a non-invasive method to detect retinal vascular occlusions and other vascular pathology, as well as predict treatment outcomes. As providers see an increase in patients presenting with new retinal vascular occlusions, the use of AI to detect and treat these conditions has the potential to improve patient outcomes and reduce the financial burden on the healthcare system. This article comprehends the implications of AI in the current management strategies of retinal vascular occlusion (RVO) in hyperlipidemia and the recent developments of AI technology in the management of ocular diseases.

3D Features Fusion for Automated Segmentation of Fluid Regions in CSCR Patients: An OCT-based Photodynamic Therapy Response Analysis

Central Serous Chorioretinopathy (CSCR) is a significant cause of vision impairment worldwide, with Photodynamic Therapy (PDT) emerging as a promising treatment strategy. The capability to precisely segment fluid regions in Optical Coherence Tomography (OCT) scans and predict the response to PDT treatment can substantially augment patient outcomes. This paper introduces a novel deep learning (DL) methodology for automated 3D segmentation of fluid regions in OCT scans, followed by a subsequent PDT response analysis for CSCR patients. Our approach utilizes the rich 3D contextual information from OCT scans to train a model that accurately delineates fluid regions. This model not only substantially reduces the time and effort required for segmentation but also offers a standardized technique, fostering further large-scale research studies. Additionally, by incorporating pre- and post-treatment OCT scans, our model is capable of predicting PDT response, hence enabling the formulation of personalized treatment strategies and optimized patient management. To validate our approach, we employed a robust dataset comprising 2,769 OCT scans (124 3D volumes), and the results obtained were significantly satisfactory, outperforming the current state-of-the-art methods. This research signifies an important milestone in the integration of DL advancements with practical clinical applications, propelling us a step closer towards improved management of CSCR. Furthermore, the methodologies and systems developed can be adapted and extrapolated to tackle similar challenges in the diagnosis and treatment of other retinal pathologies, favoring more comprehensive and personalized patient care.

BASELINE SPECTRAL DOMAIN OPTICAL COHERENCE TOMOGRAPHIC RETINAL LAYER FEATURES IDENTIFIED BY ARTIFICIAL INTELLIGENCE PREDICT THE COURSE OF CENTRAL SEROUS CHORIORETINOPATHY

PURPOSE

To identify optical coherence tomography (OCT) features to predict the course of central serous chorioretinopathy (CSC) with an artificial intelligence-based program.

METHODS

Multicenter, observational study with a retrospective design. Treatment-naïve patients with acute CSC and chronic CSC were enrolled. Baseline OCTs were examined by an artificial intelligence-developed platform (Discovery OCT Fluid and Biomarker Detector, RetinAI AG, Switzerland). Through this platform, automated retinal layer thicknesses and volumes, including intaretinal and subretinal fluid, and pigment epithelium detachment were measured. Baseline OCT features were compared between acute CSC and chronic CSC patients.

RESULTS

One hundred and sixty eyes of 144 patients with CSC were enrolled, of which 100 had chronic CSC and 60 acute CSC. Retinal layer analysis of baseline OCT scans showed that the inner nuclear layer, the outer nuclear layer, and the photoreceptor-retinal pigmented epithelium complex were significantly thicker at baseline in eyes with acute CSC in comparison with those with chronic CSC ( P < 0.001). Similarly, choriocapillaris and choroidal stroma and retinal thickness (RT) were thicker in acute CSC than chronic CSC eyes ( P = 0.001). Volume analysis revealed average greater subretinal fluid volumes in the acute CSC group in comparison with chronic CSC ( P = 0.041).

CONCLUSION

Optical coherence tomography features may be helpful to predict the clinical course of CSC. The baseline presence of an increased thickness in the outer retinal layers, choriocapillaris and choroidal stroma, and subretinal fluid volume seems to be associated with acute course of the disease.

Artificial intelligence in retinal imaging: current status and future prospects

INTRODUCTION

The steadily growing and aging world population, in conjunction with continuously increasing prevalences of vision-threatening retinal diseases, is placing an increasing burden on the global healthcare system. The main challenges within retinology involve identifying the comparatively few patients requiring therapy within the large mass, the assurance of comprehensive screening for retinal disease and individualized therapy planning. In order to sustain high-quality ophthalmic care in the future, the incorporation of artificial intelligence (AI) technologies into our clinical practice represents a potential solution.

AREAS COVERED

This review sheds light onto already realized and promising future applications of AI techniques in retinal imaging. The main attention is directed at the application in diabetic retinopathy and age-related macular degeneration. The principles of use in disease screening, grading, therapeutic planning and prediction of future developments are explained based on the currently available literature.

EXPERT OPINION

The recent accomplishments of AI in retinal imaging indicate that its implementation into our daily practice is likely to fundamentally change the ophthalmic healthcare system and bring us one step closer to the goal of individualized treatment. However, it must be emphasized that the aim is to optimally support clinicians by gradually incorporating AI approaches, rather than replacing ophthalmologists.

Predicting glaucoma progression using deep learning framework guided by generative algorithm

Glaucoma is a slowly progressing optic neuropathy that may eventually lead to blindness. To help patients receive customized treatment, predicting how quickly the disease will progress is important. Structural assessment using optical coherence tomography (OCT) can be used to visualize glaucomatous optic nerve and retinal damage, while functional visual field (VF) tests can be used to measure the extent of vision loss. However, VF testing is patient-dependent and highly inconsistent, making it difficult to track glaucoma progression. In this work, we developed a multimodal deep learning model comprising a convolutional neural network (CNN) and a long short-term memory (LSTM) network, for glaucoma progression prediction. We used OCT images, VF values, demographic and clinical data of 86 glaucoma patients with five visits over 12 months. The proposed method was used to predict VF changes 12 months after the first visit by combining past multimodal inputs with synthesized future images generated using generative adversarial network (GAN). The patients were classified into two classes based on their VF mean deviation (MD) decline: slow progressors (< 3 dB) and fast progressors (> 3 dB). We showed that our generative model-based novel approach can achieve the best AUC of 0.83 for predicting the progression 6 months earlier. Further, the use of synthetic future images enabled the model to accurately predict the vision loss even earlier (9 months earlier) with an AUC of 0.81, compared to using only structural (AUC = 0.68) or only functional measures (AUC = 0.72). This study provides valuable insights into the potential of using synthetic follow-up OCT images for early detection of glaucoma progression.

Artificial Intelligence-Aided Optical Imaging for Cancer Theranostics

The use of artificial intelligence (AI) to assist biomedical imaging have demonstrated its high accuracy and high efficiency in medical decision-making for individualized cancer medicine. In particular, optical imaging methods are able to visualize both the structural and functional information of tumors tissues with high contrast, low cost, and noninvasive property. However, no systematic work has been performed to inspect the recent advances on AI-aided optical imaging for cancer theranostics. In this review, we demonstrated how AI can guide optical imaging methods to improve the accuracy on tumor detection, automated analysis and prediction of its histopathological section, its monitoring during treatment, and its prognosis by using computer vision, deep learning and natural language processing. By contrast, the optical imaging techniques involved mainly consisted of various tomography and microscopy imaging methods such as optical endoscopy imaging, optical coherence tomography, photoacoustic imaging, diffuse optical tomography, optical microscopy imaging, Raman imaging, and fluorescent imaging. Meanwhile, existing problems, possible challenges and future prospects for AI-aided optical imaging protocol for cancer theranostics were also discussed. It is expected that the present work can open a new avenue for precision oncology by using AI and optical imaging tools.

Developing a machine-learning model for real-time prediction of successful extubation in mechanically ventilated patients using time-series ventilator-derived parameters

Background

Successful weaning from mechanical ventilation is important for patients admitted to intensive care units. However, models for predicting real-time weaning outcomes remain inadequate. Therefore, this study aimed to develop a machine-learning model for predicting successful extubation only using time-series ventilator-derived parameters with good accuracy.

Methods

Patients with mechanical ventilation admitted to the Yuanlin Christian Hospital in Taiwan between August 2015 and November 2020 were retrospectively included. A dataset with ventilator-derived parameters was obtained before extubation. Recursive feature elimination was applied to select the most important features. Machine-learning models of logistic regression, random forest (RF), and support vector machine were adopted to predict extubation outcomes. In addition, the synthetic minority oversampling technique (SMOTE) was employed to address the data imbalance problem. The area under the receiver operating characteristic (AUC), F1 score, and accuracy, along with the 10-fold cross-validation, were used to evaluate prediction performance.

Results

In this study, 233 patients were included, of whom 28 (12.0%) failed extubation. The six ventilatory variables per 180 s dataset had optimal feature importance. RF exhibited better performance than the others, with an AUC value of 0.976 (95% confidence interval [CI], 0.975-0.976), accuracy of 94.0% (95% CI, 93.8-94.3%), and an F1 score of 95.8% (95% CI, 95.7-96.0%). The difference in performance between the RF and the original and SMOTE datasets was small.

Conclusion

The RF model demonstrated a good performance in predicting successful extubation in mechanically ventilated patients. This algorithm made a precise real-time extubation outcome prediction for patients at different time points.

Intelligent oncology: The convergence of artificial intelligence and oncology

With increasingly explored ideologies and technologies for potential applications of artificial intelligence (AI) in oncology, we here describe a holistic and structured concept termed intelligent oncology. Intelligent oncology is defined as a cross-disciplinary specialty which integrates oncology, radiology, pathology, molecular biology, multi-omics and computer sciences, aiming to promote cancer prevention, screening, early diagnosis and precision treatment. The development of intelligent oncology has been facilitated by fast AI technology development such as natural language processing, machine/deep learning, computer vision, and robotic process automation. While the concept and applications of intelligent oncology is still in its infancy, and there are still many hurdles and challenges, we are optimistic that it will play a pivotal role for the future of basic, translational and clinical oncology.

Prediction of OCT images of short-term response to anti-VEGF treatment for diabetic macular edema using different generative adversarial networks

PURPOSE

This study sought to assess the predictive performance of optical coherence tomography (OCT) images for the response of diabetic macular edema (DME) patients to anti-vascular endothelial growth factor (VEGF) therapy generated from baseline images using generative adversarial networks (GANs).

METHODS

Patient information, including clinical and imaging data, was obtained from inpatients at the Ophthalmology Department of Qilu Hospital. 715 and 103 pairs of pre-and post-treatment OCT images of DME patients were included in the training and validation sets, respectively. The post-treatment OCT images were used to assess the validity of the generated images. Six different GAN models (CycleGAN, PairGAN, Pix2pixHD, RegGAN, SPADE, UNIT) were applied to predict the efficacy of anti-VEGF treatment by generating OCT images. Independent screening and evaluation experiments were conducted to validate the quality and comparability of images generated by different GAN models.

RESULTS

OCT images generated f GAN models exhibited high comparability to the real images, especially for edema absorption. RegGAN exhibited the highest prediction accuracy over the CycleGAN, PairGAN, Pix2pixHD, SPADE, and UNIT models. Further analyses were conducted based on the RegGAN. Most post-therapeutic OCT images (95/103) were difficult to differentiate from the real OCT images by retinal specialists. A mean absolute error of 26.74 ± 21.28 μm was observed for central macular thickness (CMT) between the synthetic and real OCT images.

CONCLUSION

Different generative adversarial networks have different prognostic efficacy for DME, and RegGAN yielded the best performance in our study. Different GAN models yielded good accuracy in predicting the OCT-based response to anti-VEGF treatment at one month. Overall, the application of GAN models can assist clinicians in prognosis prediction of patients with DME to design better treatment strategies and follow-up schedules.

Central serous chorioretinopathy: A review

Central serous chorioretinopathy (CSC) is the fourth most common non-surgical retinopathy associated with fluid leakage. The pathogenesis is not yet completely understood, but changes in the choroid, sclera and RPE have been described associated with venous congestion of choroidal outflow. CSC can be categorised into acute, chronic, and recurrent subtypes with recent classifications of simple and complex based on the area of RPE change seen on fundus autofluorescence. A multimodal imaging approach is helpful in the diagnosis and management of CSC and secondary complications such as type 1 neovascularisation. Although spontaneous resolution with relatively good visual outcomes is common, treatment should be considered in patients with persistent or recurrent SRF. Treatment options include laser, systemic medications, intravitreal therapy, and surgery. Of these, argon laser for focal extramacular fluid leaks and photodynamic therapy of leakage identified by indocyanine-green angiography currently have the greatest supportive evidence.

Prediction of the response to photodynamic therapy in patients with chronic central serous chorioretinopathy based on optical coherence tomography using deep learning

PURPOSE

To assess the prediction of the response to photodynamic therapy (PDT) in chronic central serous chorioretinopathy (CSCR) based on spectral-domain optical coherence tomography (SD-OCT) images using deep learning (DL).

METHODS

Retrospective study including 216 eyes of 175 patients with CSCR and persistent subretinal fluid (SRF) who underwent half-fluence PDT. SD-OCT macular examination was performed before (baseline) and 3 months after treatment. Patients were classified into groups by experts based on the response to PDT: Group 1, complete SRF resorption (n = 100); Group 2, partial SRF resorption (n = 66); and Group 3, absence of any SRF resorption (n = 50). This work proposes different computational approaches: 1st approach compares all groups; 2nd compares groups 1 vs. 2 and 3 together; 3rd compares groups 2 vs. 3.

RESULTS

The mean age was 55.6 ± 10.9 years and 70.3% were males. In the first approach, the algorithm showed a precision of up to 57% to detect the response to treatment in group 1 based on the initial scan, with a mean average accuracy of 0.529 ± 0.035. In the second model, the mean accuracy was higher (0.670 ± 0.046). In the third approach, the algorithm showed a precision of 0.74 ± 0.12 to detect the response to treatment in group 2 (partial SRF resolution) and 0.69 ± 0.15 in group 3 (absence of SRF resolution).

CONCLUSION

Despite the high clinical variability in the response of chronic CSCR to PDT, this DL algorithm offers an objective and promising tool to predict the response to PDT treatment in clinical practice.

Artificial intelligence-based pathologic myopia identification system in the ophthalmology residency training program

Background: Artificial intelligence (AI) has been successfully applied to the screening tasks of fundus diseases. However, few studies focused on the potential of AI to aid medical teaching in the residency training program. This study aimed to evaluate the effectiveness of the AI-based pathologic myopia (PM) identification system in the ophthalmology residency training program and assess the residents' feedback on this system. Materials and Methods: Ninety residents in the ophthalmology department at the Second Affiliated Hospital of Zhejiang University were randomly assigned to three groups. In group A, residents learned PM through an AI-based PM identification system. In group B and group C, residents learned PM through a traditional lecture given by two senior specialists independently. The improvement in resident performance was evaluated by comparing the pre-and post-lecture scores of a specifically designed test using a paired t-test. The difference among the three groups was evaluated by one-way ANOVA. Residents' evaluations of the AI-based PM identification system were measured by a 17-item questionnaire. Results: The post-lecture scores were significantly higher than the pre-lecture scores in group A (p < 0.0001). However, there was no difference between pre-and post-lecture scores in group B (p = 0.628) and group C (p = 0.158). Overall, all participants were satisfied and agreed that the AI-based PM identification system was effective and helpful to acquire PM identification, myopic maculopathy (MM) classification, and "Plus" lesion localization. Conclusion: It is still difficult for ophthalmic residents to promptly grasp the knowledge of identification of PM through a single traditional lecture, while the AI-based PM identification system effectively improved residents' performance in PM identification and received satisfactory feedback from residents. The application of the AI-based PM identification system showed advantages in promoting the efficiency of the ophthalmology residency training program.

Wide-field OCT-angiography assessment of choroidal thickness and choriocapillaris in eyes with central serous chorioretinopathy

Purpose: To assess wide-field changes in choroidal thickness and choriocapillaris in eyes with central serous chorioretinopathy (CSC) compared with the fellow eyes and eyes from healthy individuals using wide-field swept-source (SS) OCT-Angiography (OCTA).

Methods: A cross-sectional study in which 68 eyes from 34 individual patients affected by unilateral CSC and 32 eyes of 32 age- and sex-matched healthy subjects were evaluated. All subjects underwent wide-field SS-OCTA examination to quantify choroidal thickness and vascular density of the choriocapillaris. To assess the wide-field changes, we developed five 4-by-4 mm square regions located in the posterior pole and in the four quadrants of the peripheral retina (superotemporal, inferotemporal, superonasal, and inferonasal subfields, respectively).

Results: The choroidal thickness of eyes with CSC was greater than that of the fellow eyes in the central and inferonasal subfields (p < 0.001 for the central subfield and p = 0.006 for the inferonasal subfield, respectively). Compared with the choroidal thickness of healthy eyes, that of patients with CSC were significantly greater in all the subfields (p < 0.05 for the fellow eyes and p < 0.05 for eyes with CSC, respectively). Compared with that of healthy eyes, the vascular density of choriocapillaris in eyes of patients with CSC were significantly greater in the central and superotemporal subfields (p < 0.05 for the fellow eyes and p < 0.05 for eyes with CSC, respectively). In the central region, the vascular density of choriocapillaris of the fellow eyes was greater than eyes with CSC (p = 0.023).

Conclusion: CSC appears to be a bilateral disease with asymmetric manifestations. Local factors of the diseased eyes may play an important role in the development of CSC, during which dynamic and regional changes in the choriocapillaris may have happened. Wide-field swept-source OCTA provided a useful tool to study the pathogenesis of CSC.

Predicting OCT images of short-term response to anti-VEGF treatment for retinal vein occlusion using generative adversarial network

To generate and evaluate post-therapeutic optical coherence tomography (OCT) images based on pre-therapeutic images with generative adversarial network (GAN) to predict the short-term response of patients with retinal vein occlusion (RVO) to anti-vascular endothelial growth factor (anti-VEGF) therapy. Real-world imaging data were retrospectively collected from 1 May 2017, to 1 June 2021. A total of 515 pairs of pre-and post-therapeutic OCT images of patients with RVO were included in the training set, while 68 pre-and post-therapeutic OCT images were included in the validation set. A pix2pixHD method was adopted to predict post-therapeutic OCT images in RVO patients after anti-VEGF therapy. The quality and similarity of synthetic OCT images were evaluated by screening and evaluation experiments. We quantitatively and qualitatively assessed the prognostic accuracy of the synthetic post-therapeutic OCT images. The post-therapeutic OCT images generated by the pix2pixHD algorithm were comparable to the actual images in edema resorption response. Retinal specialists found most synthetic images (62/68) difficult to differentiate from the real ones. The mean absolute error (MAE) of the central macular thickness (CMT) between the synthetic and real OCT images was 26.33 ± 15.81 μm. There was no statistical difference in CMT between the synthetic and the real images. In this retrospective study, the application of the pix2pixHD algorithm objectively predicted the short-term response of each patient to anti-VEGF therapy based on OCT images with high accuracy, suggestive of its clinical value, especially for screening patients with relatively poor prognosis and potentially guiding clinical treatment. Importantly, our artificial intelligence-based prediction approach's non-invasiveness, repeatability, and cost-effectiveness can improve compliance and follow-up management of this patient population.

Retinal Microvascular Signs in Pre- and Early-Stage Diabetic Retinopathy Detected Using Wide-Field Swept-Source Optical Coherence Tomographic Angiography

Purpose Using a wide-field, high-resolution swept-source optical coherence tomographic angiography (OCTA), this study investigated microvascular abnormalities in patients with pre- and early-stage diabetic retinopathy. Methods 38 eyes of 20 people with diabetes mellitus (DM) type 2 without diabetic retinopathy (DR) and 39 eyes of 21 people with DR were enrolled in this observational and cross-sectional cohort study, and a refractive error-matched group consisting of 42 eyes of 21 non-diabetic subjects of similar age were set as the control. Each participant underwent a wide-field swept-source OCTA. On OCTA scans (1.2 cm × 1.2 cm), the mean central macular thickness (CMT), the vessel density of the inner retina, superficial capillary plexus (SCP), and deep capillary plexus (DCP) were independently measured in the whole area (1.2 cm diameter) via concentric rings with varying radii (0–0.3, 0.3–0.6, 0.6–0.9, and 0.9–1.2 cm). Results Patients whose eyes had pre-and early-stage DR showed significantly decreased vessel density in the inner retina, SCP, DCP and CMT (early-stage DR) compared with the control. In addition, compared with the average values upon wide-field OCTA, the decreases were even more pronounced for concentric rings with a radius of 0.9–1.2 cm in terms of the inner retina, SCP, DCP and CMT. Conclusions Widefield OCTA allows for a more thorough assessment of retinal changes in patients with pre- and early-stage DR.; retinal microvascular abnormalities were observed in both groups. In addition, the decreases in retinal vessel density were more significant in the peripheral concentric ring with a radius of 0.9–1.2 cm. The application of novel and wide-field OCTA could potentially help to detect earlier diabetic microvascular abnormalities.

Predicting persistent central serous chorioretinopathy using multiple optical coherence tomographic images by deep learning

We sought to predict whether central serous chorioretinopathy (CSC) will persist after 6 months using multiple optical coherence tomography (OCT) images by deep convolutional neural network (CNN). This was a multicenter, retrospective, cohort study. Multiple OCT images, including B-scan and en face images of retinal thickness (RT), mid-retina, ellipsoid zone (EZ) layer, and choroidal layer, were collected from 832 eyes of 832 CSC patients (593 self-resolving and 239 persistent). Each image set and concatenated set were divided into training (70%), validation (15%), and test (15%) sets. Training and validation were performed using ResNet50 CNN architecture for predicting CSC requiring treatment. Model performance was analyzed using the test set. The accuracy of prediction was 0.8072, 0.9200, 0.6480, and 0.9200 for B-scan, RT, mid-retina, EZ, and choroid modalities, respectively. When image sets with high accuracy were concatenated, the accuracy was 0.9520, 0.8800, and 0.9280 for B-scan + RT, B-scan + EZ, and EZ + RT, respectively. OCT B-scan, RT, and EZ en face images demonstrated good performances for predicting the prognosis of CSC using CNN. The performance improved when these sets were concatenated. The results of this study can serve as a reference for choosing an optimal treatment for CSC patients.

Prediction of Visual Acuity after anti-VEGF Therapy in Diabetic Macular Edema by Machine Learning

PURPOSE

To predict visual acuity (VA) 1 month after anti-vascular endothelial growth factor (VEGF) therapy in patients with diabetic macular edema (DME) by using machine learning.

METHODS

This retrospective study included 281 eyes with DME receiving intravitreal anti-VEGF treatment from January 1, 2019, to April 1, 2021. Eighteen features from electronic medical records and measurements data from OCT images were extracted. The data obtained from January 1, 2019, to November 1, 2020, were used as the training set; the data obtained from November 1, 2020, to April 1, 2021, were used as the validation set. Six different machine learning algorithms were used to predict VA in patients after anti-VEGF therapy. After the initial detailed investigation, we designed an optimization model for convenient application. The VA predicted by machine learning was compared with the ground truth.

RESULTS

The ensemble algorithm (linear regression + random forest regressor) performed best in VA and VA variance predictions. In the validation set, the mean absolute errors (MAEs) of VA predictions were 0.137-0.153 logMAR (within 7-8 letters), and the mean square errors (MSEs) were 0.033-0.045 logMAR (within 2-3 letters) for the 1-month VA predictions, respectively. For the prediction of VA variance at 1 month, the MAEs were 0.164-0.169 logMAR (within 9 letters), and the MSEs were 0.056-0.059 logMAR (within 3 letters), respectively.

CONCLUSIONS

Our machine learning models could accurately predict VA and VA variance in DME patients receiving anti-VEGF therapy 1 month after, which would be much valuable to guide precise individualized interventions and manage expectations in clinical practice.