1
|
Stolte S, Fang R. A survey on medical image analysis in diabetic retinopathy. Med Image Anal 2020; 64:101742. [PMID: 32540699 DOI: 10.1016/j.media.2020.101742] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 02/03/2020] [Accepted: 05/28/2020] [Indexed: 01/12/2023]
Abstract
Diabetic Retinopathy (DR) represents a highly-prevalent complication of diabetes in which individuals suffer from damage to the blood vessels in the retina. The disease manifests itself through lesion presence, starting with microaneurysms, at the nonproliferative stage before being characterized by neovascularization in the proliferative stage. Retinal specialists strive to detect DR early so that the disease can be treated before substantial, irreversible vision loss occurs. The level of DR severity indicates the extent of treatment necessary - vision loss may be preventable by effective diabetes management in mild (early) stages, rather than subjecting the patient to invasive laser surgery. Using artificial intelligence (AI), highly accurate and efficient systems can be developed to help assist medical professionals in screening and diagnosing DR earlier and without the full resources that are available in specialty clinics. In particular, deep learning facilitates diagnosis earlier and with higher sensitivity and specificity. Such systems make decisions based on minimally handcrafted features and pave the way for personalized therapies. Thus, this survey provides a comprehensive description of the current technology used in each step of DR diagnosis. First, it begins with an introduction to the disease and the current technologies and resources available in this space. It proceeds to discuss the frameworks that different teams have used to detect and classify DR. Ultimately, we conclude that deep learning systems offer revolutionary potential to DR identification and prevention of vision loss.
Collapse
Affiliation(s)
- Skylar Stolte
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Biomedical Sciences Building JG56 P.O. Box 116131 Gainesville, FL 32611-6131, USA.
| | - Ruogu Fang
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Biomedical Sciences Building JG56 P.O. Box 116131 Gainesville, FL 32611-6131, USA.
| |
Collapse
|
2
|
Nguyen NV, Vigil EM, Hassan M, Halim MS, Baluyot SC, Guzman HA, Afridi R, Do DV, Sepah YJ. Comparison of montage with conventional stereoscopic seven-field photographs for assessment of ETDRS diabetic retinopathy severity. Int J Retina Vitreous 2019; 5:51. [PMID: 31890280 PMCID: PMC6909536 DOI: 10.1186/s40942-019-0201-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2019] [Accepted: 11/25/2019] [Indexed: 12/16/2022] Open
Abstract
Background The ETDRS stereoscopic seven-field (7F) has been a standard imaging and grading protocol for assessment of diabetic retinopathy (DR) severity score in many clinical trials. To the best of our knowledge, the comparison between montage and stereoscopic 7F has not been reported in the literature. Therefore, the main purpose of this study is to compare agreement between montage and stereoscopic seven-field (7F) photographs in the assessment of DR severity. Methods Stereoscopic 7F photographs were captured from subjects with DR. Montages of monoscopic 7F images were created using Adobe Photoshop CS6 Extended©. The best quality image of each stereo pair was selected and placed on a 150 × 125-inch canvas field according to the standard location from field 1 to 7. All the fields were aligned following the vessels and overlaid using the built-in blending tool. The resulting montage was utilized for grading and compared with grading on stereoscopic 7F photographs. Three independent graders were asked to assess DR severity on stereoscopic 7F photographs and montage. Severity level agreement between stereo 7F and montage was cross-tabulated and the agreement of DR severity levels between stereoscopic 7-field images and montage was analyzed using κ intergrader agreement; statistical significance was set at p < 0.05. Results A total of 50 eyes were included in the study. There was a substantial agreement between stereoscopic 7F and montage (κ = 0.745, κweighted = 0.867) in assessment of DR severity. Of 50 eyes, 80% of the cases showed complete agreement, and 100% of the cases had agreement within one-step. There was a moderate agreement among graders, and κ-value ranged from 0.4705 to 0.5803. Conclusion In this study, we found a substantial agreement in assessing DR severity score employing non-stereoscopic montage and stereoscopic 7F photographs.
Collapse
Affiliation(s)
- Nam V Nguyen
- 1Byers Eye Institute, Stanford University, 2370 Watson Court, Suite 200, Palo Alto, CA USA.,Ocular Imaging Research and Reading Center, Sunnyvale, CA USA.,4College of Arts and Sciences, University of Nebraska-Lincoln, Lincoln, NE USA
| | - Erin M Vigil
- 1Byers Eye Institute, Stanford University, 2370 Watson Court, Suite 200, Palo Alto, CA USA.,Ocular Imaging Research and Reading Center, Sunnyvale, CA USA.,3University of Texas Southwestern School of Medicine, Dallas, TX USA
| | - Muhammad Hassan
- 1Byers Eye Institute, Stanford University, 2370 Watson Court, Suite 200, Palo Alto, CA USA
| | - Muhammad S Halim
- 1Byers Eye Institute, Stanford University, 2370 Watson Court, Suite 200, Palo Alto, CA USA
| | - Sean C Baluyot
- Ocular Imaging Research and Reading Center, Sunnyvale, CA USA
| | - Hugo A Guzman
- Ocular Imaging Research and Reading Center, Sunnyvale, CA USA
| | - Rubbia Afridi
- 1Byers Eye Institute, Stanford University, 2370 Watson Court, Suite 200, Palo Alto, CA USA
| | - Diana V Do
- 1Byers Eye Institute, Stanford University, 2370 Watson Court, Suite 200, Palo Alto, CA USA
| | - Yasir J Sepah
- 1Byers Eye Institute, Stanford University, 2370 Watson Court, Suite 200, Palo Alto, CA USA
| |
Collapse
|
3
|
|
4
|
Sim DA, Keane PA, Tufail A, Egan CA, Aiello LP, Silva PS. Automated retinal image analysis for diabetic retinopathy in telemedicine. Curr Diab Rep 2015; 15:14. [PMID: 25697773 DOI: 10.1007/s11892-015-0577-6] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
There will be an estimated 552 million persons with diabetes globally by the year 2030. Over half of these individuals will develop diabetic retinopathy, representing a nearly insurmountable burden for providing diabetes eye care. Telemedicine programmes have the capability to distribute quality eye care to virtually any location and address the lack of access to ophthalmic services. In most programmes, there is currently a heavy reliance on specially trained retinal image graders, a resource in short supply worldwide. These factors necessitate an image grading automation process to increase the speed of retinal image evaluation while maintaining accuracy and cost effectiveness. Several automatic retinal image analysis systems designed for use in telemedicine have recently become commercially available. Such systems have the potential to substantially improve the manner by which diabetes eye care is delivered by providing automated real-time evaluation to expedite diagnosis and referral if required. Furthermore, integration with electronic medical records may allow a more accurate prognostication for individual patients and may provide predictive modelling of medical risk factors based on broad population data.
Collapse
Affiliation(s)
- Dawn A Sim
- Department of Ophthalmology, Harvard Medical School and Beetham Eye Institute, Joslin Diabetes Center, One Joslin Place, Boston, MA, 02215, USA
| | | | | | | | | | | |
Collapse
|
5
|
Shi L, Wu H, Dong J, Jiang K, Lu X, Shi J. Telemedicine for detecting diabetic retinopathy: a systematic review and meta-analysis. Br J Ophthalmol 2015; 99:823-31. [PMID: 25563767 PMCID: PMC4453504 DOI: 10.1136/bjophthalmol-2014-305631] [Citation(s) in RCA: 109] [Impact Index Per Article: 12.1] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2014] [Accepted: 12/10/2014] [Indexed: 11/25/2022]
Abstract
Objective To determine the diagnostic accuracy of telemedicine in various clinical levels of diabetic retinopathy (DR) and diabetic macular oedema (DME). Methods PubMed, EMBASE and Cochrane databases were searched for telemedicine and DR. The methodological quality of included studies was evaluated using the Quality Assessment for Diagnostic Accuracy Studies (QUADAS-2). Measures of sensitivity, specificity and other variables were pooled using a random effects model. Summary receiver operating characteristic curves were used to estimate overall test performance. Meta-regression and subgroup analyses were used to identify sources of heterogeneity. Publication bias was evaluated using Stata V.12.0. Results Twenty articles involving 1960 participants were included. Pooled sensitivity of telemedicine exceeded 80% in detecting the absence of DR, low- or high-risk proliferative diabetic retinopathy (PDR), it exceeded 70% in detecting mild or moderate non-proliferative diabetic retinopathy (NPDR), DME and clinically significant macular oedema (CSME) and was 53% (95% CI 45% to 62%) in detecting severe NPDR. Pooled specificity of telemedicine exceeded 90%, except in the detection of mild NPDR which reached 89% (95% CI 88% to 91%). Diagnostic accuracy was higher with digital images obtained through mydriasis than through non-mydriasis, and was highest when a wide angle (100–200°) was used compared with a narrower angle (45–60°, 30° or 35°) in detecting the absence of DR and the presence of mild NPDR. No potential publication bias was detected. Conclusions The diagnostic accuracy of telemedicine using digital imaging in DR is overall high. It can be used widely for DR screening. Telemedicine based on the digital imaging technique that combines mydriasis with a wide angle field (100–200°) is the best choice in detecting the absence of DR and the presence of mild NPDR.
Collapse
Affiliation(s)
- Lili Shi
- Department of Medical informatics, Nantong University, Nantong, China Nantong University Library, Nantong, China
| | - Huiqun Wu
- Department of Medical informatics, Nantong University, Nantong, China
| | - Jiancheng Dong
- Department of Medical informatics, Nantong University, Nantong, China
| | - Kui Jiang
- Department of Medical informatics, Nantong University, Nantong, China
| | - Xiting Lu
- Department of Ophthalmology, Suzhou Municipal Hospital, Suzhou, China
| | - Jian Shi
- Department of Ophthalmology, Affiliated Hospital of Nantong University, Nantong, China
| |
Collapse
|
6
|
Vaziri K, Moshfeghi DM, Moshfeghi AA. Feasibility of telemedicine in detecting diabetic retinopathy and age-related macular degeneration. Semin Ophthalmol 2013; 30:81-95. [PMID: 24171781 DOI: 10.3109/08820538.2013.825727] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Age-related macular degeneration and diabetic retinopathy are important causes of visual impairment and blindness in the world. Because of recent advances and newly available treatment modalities along with the devastating consequences associated with late stages of these diseases, much attention has been paid to the importance of early detection and improving patient access to specialist care. Telemedicine or, more specifically, digital retinal imaging utilizing telemedical technology has been proposed as an important alternative screening and management strategy to help meet this demand. In this paper, we perform a literature review and analysis that evaluates the validity and feasibility of telemedicine in detecting diabetic retinopathy and age-related macular degeneration. Understanding both the progress and barriers to progress that have been demonstrated in these two areas is important for future telemedicine research projects and innovations in telemedicine technology.
Collapse
Affiliation(s)
- Kamyar Vaziri
- Bascom Palmer Eye Institute, Department of Ophthalmology, University of Miami Miller School of Medicine, Palm Beach Gardens , Florida , USA and
| | | | | |
Collapse
|
7
|
Krupinski EA, Silverstein LD, Hashmi SF, Graham AR, Weinstein RS, Roehrig H. Observer performance using virtual pathology slides: impact of LCD color reproduction accuracy. J Digit Imaging 2013; 25:738-43. [PMID: 22546982 DOI: 10.1007/s10278-012-9479-1] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
The use of color LCDs in medical imaging is growing as more clinical specialties use digital images as a resource in diagnosis and treatment decisions. Telemedicine applications such as telepathology, teledermatology, and teleophthalmology rely heavily on color images. However, standard methods for calibrating, characterizing, and profiling color displays do not exist, resulting in inconsistent presentation. To address this, we developed a calibration, characterization, and profiling protocol for color-critical medical imaging applications. Physical characterization of displays calibrated with and without the protocol revealed high color reproduction accuracy with the protocol. The present study assessed the impact of this protocol on observer performance. A set of 250 breast biopsy virtual slide regions of interest (half malignant, half benign) were shown to six pathologists, once using the calibration protocol and once using the same display in its "native" off-the-shelf uncalibrated state. Diagnostic accuracy and time to render a decision were measured. In terms of ROC performance, Az (area under the curve) calibrated = 0.8570 and Az uncalibrated = 0.8488. No statistically significant difference (p = 0.4112) was observed. In terms of interpretation speed, mean calibrated = 4.895 s; mean uncalibrated = 6.304 s which is statistically significant (p = 0.0460). Early results suggest a slight advantage diagnostically for a properly calibrated and color-managed display and a significant potential advantage in terms of improved workflow. Future work should be conducted using different types of color images that may be more dependent on accurate color rendering and a wider range of LCDs with varying characteristics.
Collapse
|
8
|
Silva PS, Cavallerano JD, Sun JK, Noble J, Aiello LM, Aiello LP. Nonmydriatic ultrawide field retinal imaging compared with dilated standard 7-field 35-mm photography and retinal specialist examination for evaluation of diabetic retinopathy. Am J Ophthalmol 2012; 154:549-559.e2. [PMID: 22626617 DOI: 10.1016/j.ajo.2012.03.019] [Citation(s) in RCA: 162] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2011] [Revised: 03/03/2012] [Accepted: 03/06/2012] [Indexed: 12/18/2022]
Abstract
PURPOSE To compare nonmydriatic stereoscopic Optomap ultrawide field images with dilated stereoscopic Early Treatment Diabetic Retinopathy Study 7-standard field 35-mm color 30-degree fundus photographs (ETDRS photography) and clinical examination for determining diabetic retinopathy (DR) and diabetic macular edema (DME) severity. DESIGN Single-site, prospective, comparative, instrument validation study. METHODS One hundred three diabetic patients (206 eyes) representing the full spectrum of DR severity underwent nonmydriatic ultrawide field 100-degree and 200-degree imaging, dilated ETDRS photography, and dilated fundus examination by a retina specialist. Two independent readers graded images to determine DR and DME severity. A third masked retina specialist adjudicated discrepancies. RESULTS Based on ETDRS photography (n = 200), the results were as follows: no DR (n = 25 eyes [12.5%]), mild nonproliferative DR (NPDR; 47 [23.5%]), moderate NPDR (61 [30.5%]), severe NPDR (11 [5.5%]), very severe NPDR (3 [1.5%]), and proliferative DR (52 [2.5%]). One (0.5%) eye was ungradable and 6 eyes did not complete ETDRS photography. No DME was found in 114 eyes (57.0%), DME was found in 28 eyes (14.0%), and clinically significant DME was found in 47 eyes (23.5%), and 11 (5.5%) eyes were ungradable. Exact DR severity agreement between ultrawide field 100-degree imaging and ETDRS photography occurred in 84%, with agreement within 1 level in 91% (K(W) = 0.85; K = 0.79). Nonmydriatic ultrawide field images exactly matched clinical examination results for DR in 70% and were within 1 level in 93% (K(W) = 0.71; K = 0.61). Nonmydriatic ultrawide field imaging acquisition time was less than half that of dilated ETDRS photography (P < .0001). CONCLUSIONS Nonmydriatic ultrawide field images compare favorably with dilated ETDRS photography and dilated fundus examination in determining DR and DME severity; however, they are acquired more rapidly. If confirmed in broader diabetic populations, nonmydriatic ultrawide field imaging may prove to be beneficial in DR evaluation in research and clinical settings.
Collapse
|