Speed of telemedicine vs ophthalmoscopy for retinopathy of prematurity diagnosis

Telemedicine at a University Ophthalmology Practice During the Beginning of the COVID-19 Pandemic

Purpose

The aim of the research was to evaluate the use of teleophthalmology at a university practice during the COVID-19 pandemic, specifically examining precision, effectiveness, and patient satisfaction.

Patients and Methods

Telemedicine visits were offered to new and established patients requesting appointments with the Stony Brook University Department of Ophthalmology between March 30 and June 2, 2020. Records from these visits were reviewed for chief complaint, past medical and ocular history, diagnoses, treatment/management, and providers' sub-specialty. Precision was determined by comparing agreement between diagnoses of the telemedicine visit with those of the subsequent in-person visit. The decision to follow up in person was made by the physician and patient. Diagnostic precision as well as progression, improvement, or stability of patients' symptoms were determined by the physician's assessment at follow-up visits. Post-telemedicine visit satisfaction surveys were sent to all patients.

Results

Telemedicine visits were offered to 783 patients, 520 (66.4%) of whom accepted. Of these 520 patients, 409 (78.7%) were established and 105 (20.2%) had in-person, follow-up visits. Overall, the diagnostic precision of the follow-up visits was 89.5%. Precision differed significantly across ophthalmologic subspecialties. Of the patients who had in-person follow-up visits, 56.8% remained stable, 32.4% improved, and 10.8% worsened. Established patients presented with more extensive ocular histories/procedures and experienced a higher percentage of worsening symptoms/disease stage compared to new patients. Oculoplastics/orbit was the most prevalent diagnostic subspecialty that worsened. Surveys were sent to all patients completing telemedicine visits, 15.0% of whom responded. Overall satisfaction was 91.9%, although only 23.0% of respondents preferred telemedicine to an in-office visit.

Conclusion

Telehealth provides high levels of precision and patient satisfaction for a wide range of ophthalmologic visits, although most patients still prefer in-office examinations. Employing teleophthalmology for follow-up and emergency care may provide patients with an effective alternative during pandemic situations and beyond.

Patient and Provider Experience in Real-Time Telemedicine Consultations for Pediatric Ophthalmology

Purpose

Telemedicine adoption hinges on positive experiences for patients and providers. We report participants’ experience from our prospective study.

Patients and Methods

Ophthalmic examinations for children 0–17 years of age were conducted by an optometrist using digital exam instruments and streamed to an ophthalmologist. The ophthalmologist, optometrist, parent, and patient (≥10 years) completed surveys capturing patient and provider experience outcomes.

Results

Three hundred forty-eight examinations were conducted with 210 patients in a hospital-based pediatric ophthalmology clinic. About 99% of parents were comfortable with exam quality, and 97% indicated they would have another telemedicine examination. Fifty-four of 55 consented for surgery during the initial telemedicine examination. Thirty-seven percent of families traveled ≥2 hours round-trip to their appointment; 1/3 of parents and patients missed a full day of work/school. Video glasses were by far the most useful instrument, while technical proficiency was most challenging with the digital indirect ophthalmoscope. Problem-focused examinations took 33 minutes of the ophthalmologist’s time on average. Equipment challenges caused delays in 40/348 (11.5%) of visits, with the majority lasting 5–10 minutes. In a few cases, a backup device was used. Despite seeing significantly fewer patients on telemedicine days, the ophthalmologist’s surgical volume increased 25%.

Conclusion

All participants were satisfied with telemedicine visits despite longer durations and learning curve. Results indicate an opportunity for telemedicine in community settings to improve access to specialized care. Telemedicine enabled the optometrist to manage or co-manage more complex patients with a pipeline to the ophthalmologist for surgical cases. In the right setting, collaborative telemedicine consultations may be beneficial to one’s practice.

Cost-effectiveness of Artificial Intelligence-Based Retinopathy of Prematurity Screening

Importance

Artificial intelligence (AI)-based retinopathy of prematurity (ROP) screening may improve ROP care, but its cost-effectiveness is unknown.

Objective

To evaluate the relative cost-effectiveness of autonomous and assistive AI-based ROP screening compared with telemedicine and ophthalmoscopic screening over a range of estimated probabilities, costs, and outcomes.

Design, Setting, and Participants

A cost-effectiveness analysis of AI ROP screening compared with ophthalmoscopy and telemedicine via economic modeling was conducted. Decision trees created and analyzed modeled outcomes and costs of 4 possible ROP screening strategies: ophthalmoscopy, telemedicine, assistive AI with telemedicine review, and autonomous AI with only positive screen results reviewed. A theoretical cohort of infants requiring ROP screening in the United States each year was analyzed.

Main Outcomes and Measures

Screening and treatment costs were based on Current Procedural Terminology codes and included estimated opportunity costs for physicians. Outcomes were based on the Early Treatment of ROP study, defined as timely treatment, late treatment, or correctly untreated. Incremental cost-effectiveness ratios were calculated at a willingness-to-pay threshold of $100 000. One-way and probabilistic sensitivity analyses were performed comparing AI strategies to telemedicine and ophthalmoscopy to evaluate the cost-effectiveness across a range of assumptions. In a secondary analysis, the modeling was repeated and assumed a higher sensitivity for detection of severe ROP using AI compared with ophthalmoscopy.

Results

This theoretical cohort included 52 000 infants born 30 weeks' gestation or earlier or weighed 1500 g or less at birth. Autonomous AI was as effective and less costly than any other screening strategy. AI-based ROP screening was cost-effective up to $7 for assistive and $34 for autonomous screening compared with telemedicine and $64 and $91 compared with ophthalmoscopy in the primary analysis. In the probabilistic sensitivity analysis, autonomous AI screening was more than 60% likely to be cost-effective at all willingness-to-pay levels vs other modalities. In a second simulated cohort with 99% sensitivity for AI, the number of late treatments for ROP decreased from 265 when ROP screening was performed with ophthalmoscopy to 40 using autonomous AI.

Conclusions and Relevance

AI-based screening for ROP may be more cost-effective than telemedicine and ophthalmoscopy, depending on the added cost of AI and the relative performance of AI vs human examiners detecting severe ROP. As AI-based screening for ROP is commercialized, care must be given to appropriately price the technology to ensure its benefits are fully realized.

Extending Hui-Walter framework to correlated outcomes with application to diagnosis tests of an eye disease among premature infants

Diagnostic accuracy, a measure of diagnostic tests for correctly identifying patients with or without a target disease, plays an important role in evidence-based medicine. Diagnostic accuracy of a new test ideally should be evaluated by comparing to a gold standard; however, in many medical applications it may be invasive, costly, or even unethical to obtain a gold standard for particular diseases. When the accuracy of a new candidate test under evaluation is assessed by comparison to an imperfect reference test, bias is expected to occur and result in either overestimates or underestimates of its true accuracy. In addition, diagnostic test studies often involve repeated measurements of the same patient, such as the paired eyes or multiple teeth, and generally lead to correlated and clustered data. Using the conventional statistical methods to estimate diagnostic accuracy can be biased by ignoring the within-cluster correlations. Despite numerous statistical approaches have been proposed to tackle this problem, the methodology to deal with correlated and clustered data in the absence of a gold standard is limited. In this article, we propose a method based on the composite likelihood function to derive simple and intuitive closed-form solutions for estimates of diagnostic accuracy, in terms of sensitivity and specificity. Through simulation studies, we illustrate the relative advantages of the proposed method over the existing methods that simply treat an imperfect reference test as a gold standard in correlated and clustered data. Compared with the existing methods, the proposed method can reduce not only substantial bias, but also the computational burden. Moreover, to demonstrate the utility of this approach, we apply the proposed method to the study of National-Eye-Institute-funded Telemedicine Approaches to Evaluating of Acute-Phase Retinopathy of Prematurity (e-ROP), for estimating accuracies of both the ophthalmologist examination and the image evaluation.

Remote intervention engagement and outcomes in the Clinical Trials in Organ Transplantation in Children consortium multisite trial

Remote interventions are increasingly used in transplant medicine but have rarely been rigorously evaluated. We investigated a remote intervention targeting immunosuppressant management in pediatric lung transplant recipients. Patients were recruited from a larger multisite trial if they had a Medication Level Variability Index (MLVI) ≥2.0, indicating worrisome tacrolimus level fluctuation. The manualized intervention included three weekly phone calls and regular follow-up calls. A comparison group included patients who met enrollment criteria after the subprotocol ended. Outcomes were defined before the intent-to-treat analysis. Feasibility was defined as ≥50% of participants completing the weekly calls. MLVI was compared pre- and 180 days postenrollment and between intervention and comparison groups. Of 18 eligible patients, 15 enrolled. Seven additional patients served as the comparison. Seventy-five percent of participants completed ≥3 weekly calls; average time on protocol was 257.7 days. Average intervention group MLVI was significantly lower (indicating improved blood level stability) at 180 days postenrollment (2.9 ± 1.29) compared with pre-enrollment (4.6 ± 2.10), p = .02. At 180 days, MLVI decreased by 1.6 points in the intervention group but increased by 0.6 in the comparison group (p = .054). Participants successfully engaged in a long-term remote intervention, and their medication blood levels stabilized. NCT02266888.

Digital technology, tele-medicine and artificial intelligence in ophthalmology: A global perspective

The simultaneous maturation of multiple digital and telecommunications technologies in 2020 has created an unprecedented opportunity for ophthalmology to adapt to new models of care using tele-health supported by digital innovations. These digital innovations include artificial intelligence (AI), 5th generation (5G) telecommunication networks and the Internet of Things (IoT), creating an inter-dependent ecosystem offering opportunities to develop new models of eye care addressing the challenges of COVID-19 and beyond. Ophthalmology has thrived in some of these areas partly due to its many image-based investigations. Tele-health and AI provide synchronous solutions to challenges facing ophthalmologists and healthcare providers worldwide. This article reviews how countries across the world have utilised these digital innovations to tackle diabetic retinopathy, retinopathy of prematurity, age-related macular degeneration, glaucoma, refractive error correction, cataract and other anterior segment disorders. The review summarises the digital strategies that countries are developing and discusses technologies that may increasingly enter the clinical workflow and processes of ophthalmologists. Furthermore as countries around the world have initiated a series of escalating containment and mitigation measures during the COVID-19 pandemic, the delivery of eye care services globally has been significantly impacted. As ophthalmic services adapt and form a "new normal", the rapid adoption of some of telehealth and digital innovation during the pandemic is also discussed. Finally, challenges for validation and clinical implementation are considered, as well as recommendations on future directions.

COVID-19 Launches Retinal Telemedicine into the Next Frontier

INTRODUCTION

Telemedicine in ophthalmology, and specifically in retinal diseases, has made significant advancements in recent years. The COVID-19 pandemic has launched telehealth into a new era by creating demand from patients and physicians alike, while breaking down previous insurance, reimbursement, access and educational barriers.

METHODS

This paper reviews mulitple studies demonstrating the use of telemedicine in managing various retinal conditions before and during the COVID-19 pandemic.

CONCLUSION

Moving forward, promising new devices and models of care ensure that tele-retinal care will continue to expand and become a vital part of how we screen, diagnose and monitor retinal diseases.

HUMAN REMOTE MOBILE MEDICAL INFORMATION COLLECTION METHOD BASED ON INTERNET OF THINGS AND INTELLIGENT ALGORITHM

ABSTRACT In the environment of rapid social and economic development, the reform of medical informatization is constantly advancing, and the residents pay more and more attention to their own health status while improving their living standards. The traditional medical service system has some disadvantages in providing real-time, cross regional, long-term and easy-to-operate health services, which has become increasingly inadequate to meet the health needs of users. In order to solve the problem of difficulty in seeing a doctor caused by limited medical resources, and to carry out real-time health monitoring for a large number of groups suffering from chronic diseases and sub-health groups, this study conducted in-depth analysis and experimental exploration on the human remote mobile medical information collection method based on the Internet of things and intelligent algorithm. It established the information collection section by using KbaC clustering algorithm based on ant colony point system which, combined with a comparative study on the health indicators of related groups, has successfully proved that the Internet of things technology and intelligent algorithm for medical information collection and follow-up medical services are of certain positive significance, based on the Internet of things and other related technologies of human remote medical information collection system that can accurately and timely detect the patient's blood pressure, blood sugar and other health data, and then provide corresponding medical services.

Deep Learning Models for Automated Diagnosis of Retinopathy of Prematurity in Preterm Infants

Retinopathy of prematurity (ROP) is a disease that can cause blindness in premature infants. It is characterized by immature vascular growth of the retinal blood vessels. However, early detection and treatment of ROP can significantly improve the visual acuity of high-risk patients. Thus, early diagnosis of ROP is crucial in preventing visual impairment. However, several patients refrain from treatment owing to the lack of medical expertise in diagnosing the disease; this is especially problematic considering that the number of ROP cases is on the rise. To this end, we applied transfer learning to five deep neural network architectures for identifying ROP in preterm infants. Our results showed that the VGG19 model outperformed the other models in determining whether a preterm infant has ROP, with 96% accuracy, 96.6% sensitivity, and 95.2% specificity. We also classified the severity of the disease; the VGG19 model showed 98.82% accuracy in predicting the severity of the disease with a sensitivity and specificity of 100% and 98.41%, respectively. We performed 5-fold cross-validation on the datasets to validate the reliability of the VGG19 model and found that the VGG19 model exhibited high accuracy in predicting ROP. These findings could help promote the development of computer-aided diagnosis.

Tele-ophthalmology: Need of the hour

Telemedicine and tele-ophthalmology have been in existence since many years, but have recently gained more importance in the present scenario of pandemic COVID-19. The attitude and perception of the doctors and patients has been changing gradually. Telemedicine has many advantages including providing care in inaccesible areas.In the present scenario, tele-ophthalmology gives an oppurtunity to patient for seeking consultation while also protecting against the contagion. There are many barriers faced by the patients and doctors that have restricted use of this technology in the past. However, with a systematic approach to designing the best suited technology, these barriers can be overcome and user friendly platforms can be created. Furthermore, the demand and use of teleconsulation had increased presently in this area of pandemic. Recent survey conducted by the All India Ophthalmological Society also reveals that many ophthalmologists who have not used tele-ophthalmology in the past are more keen to use it presently. In this article, we have reviewed telemedicine and tele-ophthalmology literature on Google and PubMed to get a holistic idea towards teleconsultation, its advantages, increased importance and prefrence during COVID-19 pandemic and various barriers faced so that the known challenges can be understood, which can pave way for better understanding and future incorporation into practice.

Auckland regional telemedicine retinopathy of prematurity screening network: A 10-year review

IMPORTANCE

Retinopathy of prematurity (ROP) is a potentially blinding condition affecting the retinae of premature infants. Effective screening is necessary for timely treatment.

BACKGROUND

The Auckland Regional Telemedicine ROP (ART-ROP) network, utilizes wide-field digital imaging for ROP screening. This study reviews the ART-ROP network.

DESIGN

Retrospective analysis of the ART-ROP database.

PARTICIPANTS

Files of infants in ART-ROP from 2006 to 2015.

METHODS

Data on infant demographics, ROP stage, treatment and outcome was collected.

MAIN OUTCOME MEASURES

The efficacy of ART-ROP in the management of ROP.

RESULTS

A review of 1181 infants across three neonatal intensive care units, was completed. Infants had a mean of four screening sessions with no infants who met ROP screening criteria being missed. Type 1 ROP was present in 83 infants, who had significantly lower average birth weight 786 ± 191 g compared to 1077 ± 285 g (P < .001), and gestational age 25.3 ± 1.7 weeks compared to 27.8 ± 2.2 weeks (P < .001) than the screened cohort. The number of infants requiring screening increased (R² = .7993), yet treatment rates decreased (R² = .9205) across the time period. Out-patient clinic follow-up was attended by 75.10% of infants screened and there was no missed ROP in those infants seen.

CONCLUSIONS AND RELEVANCE

ART-ROP solely uses wide-field digital imaging for ROP diagnosis, and management, including discharge, of infants. This detailed review of ART-ROP indicates an increase in screening demand, but a decrease in the rate of type 1 ROP. The ART-ROP telemedicine model demonstrates real potential to address workforce shortage in ROP screening.

Research in Integrated Health Care and Publication Trends from the Perspective of Global Informatics

BACKGROUND

Integrated care has gained popularity in recent decades and is advocated by the World Health Organization. This study examined the global progress, current foci, and the future of integrated care.

METHODS

We conducted a scientometric analysis of data exported from the Web of Science database. Publication number and citations, co-authorship between countries and institutions and cluster analysis were calculated and clustered using Histcite12.03.07 and VOS viewer1.6.4.

RESULTS

We retrieved 6127 articles from 1997 to 2016. We found the following. (1) The United States, United Kingdom, and Canada had the most publications, citations, and productive institutions. (2) The top 10 cited papers and journals were crucial for knowledge distribution. (3) The 50 author keywords were clustered into 6 groups: digital medicine and e-health, community health and chronic disease management, primary health care and mental health, healthcare system for infectious diseases, healthcare reform and qualitative research, and social care and health policy services.

CONCLUSIONS

This paper confirmed that integrated care is undergoing rapid development: more categories are involved and collaborative networks are being established. Various research foci have formed, such as economic incentive mechanisms for integration, e-health data mining, and quantitative studies. There is an urgent need to develop performance measurements for policies and models.

Anti-Vascular Endothelial Growth Factor and the Evolving Management Paradigm for Retinopathy of Prematurity

Diagnosis and management of pediatric retinal conditions such as retinopathy of prematurity (ROP) have been evolving significantly with the availability of new technology and treatments. New imaging systems, telemedicine, tele-education, and anti‒vascular endothelial growth factor (VEGF) intravitreal pharmacotherapy are all changing the way we diagnose and deliver care to children with pediatric retinal disease. Fluorescein angiography and optical coherence tomography have the potential to improve our diagnosis and management of disease, and with improvements in retinal imaging, telemedicine is becoming more feasible. Telemedicine, tele-education, and computer-based image analysis may overcome many of the challenges we face in providing adequate care and access for children with pediatric retinal disease. Treatment options have also expanded with the use of anti-VEGF therapy. Although the use of intravitreal anti-VEGF for ROP has been documented in the literature for more than a decade, many questions still remain about its safety in the pediatric patient population. Several ongoing prospective studies are exploring the utility of anti-VEGF agents for ROP, with attention to the optimal dose of drug, systemic safety, and our understanding of recurrence of disease. This review aims to provide an update on current diagnostic and therapeutic modalities, focusing predominantly on the role of anti-VEGF therapy, for the management of ROP and other pediatric retinal vascular diseases.

A national telemedicine network for retinopathy of prematurity screening

PURPOSE

To report the results of retinopathy of prematurity (ROP) screening by a telemedicine system in Chile and evaluate its usefulness for referring patients who require treatment.

METHODS

Premature infants at risk of developing ROP from 11 neonatal intensive care units were included. Screening was performed on all infants born at a gestational age of <32 weeks and/or birth weight of <1500 g. A trained nonphysician operator used an imaging system to capture retinal images, which were reviewed by two independent ROP experts. All infants that required treatment were referred for further evaluation.

RESULTS

The study included 2,048 eyes of 1,024 premature infants. Mean gestational age was 28.8 ± 2.2 weeks, and mean birth weight was 1128 ± 279 g. A total of 5,263 telemedicine examinations were performed and reported. The average number of image sets per patient was 2.6 ± 2.5. Of the 5,263 images, 4,903 (93%) were recorded to at least the end of zone II; 5,172 (98%) were graded as having good quality, allowing for staging of ROP disease. Forty-two infants (4%) were referred for treatment. Discharged patients with ROP type 2 that regressed did not present with any complications or adverse effects during 6 months' follow-up.

CONCLUSIONS

Our study demonstrates the utility of telemedicine screening for ROP with ophthalmologist readers in a developing country. Telemedicine screening was able to detect treatment-requiring ROP. Most of the images had good quality and showed the end of zone II, two variables sufficient to discharge patients.

Telemedical Diagnosis of Stage 4 and Stage 5 Retinopathy of Prematurity

PURPOSE

To determine the accuracy of image-based diagnosis for stage 4 or worse retinopathy of prematurity (ROP) disease.

DESIGN

Prospective cohort study.

PARTICIPANTS

We prospectively obtained data, from 8 major ROP centers, for 1220 eye examinations from 230 infants.

METHODS

An ophthalmologist at each center provided a clinical diagnosis using indirect ophthalmoscopy. Wide-angle retinal images (RetCam; Clarity Medical Systems, Pleasanton, CA) were then obtained, and these were independently read by 2 ROP experts using a web-based system for an image-based diagnosis.

MAIN OUTCOME MEASURES

Sensitivity and specificity of image-based diagnosis from the ROP experts were calculated using the clinical diagnosis as the reference standard.

RESULTS

Of 1220 examinations, 28 (2%) had a clinical diagnosis of stage 4 or worse. Sensitivity and specificity for stage 4 or worse disease were 75% and 99% for expert 1, and 86% and 99% for expert 2. Sensitivity and specificity for the detection of stage 5 disease were 69% and 99% for both experts.

CONCLUSIONS

There are inconsistencies in the accuracy of image-based diagnosis of stage 4 and stage 5 ROP when compared with the clinical diagnosis.

Screening and treatments using telemedicine in retinopathy of prematurity

Several studies have validated the role of telemedicine as a new powerful screening and diagnostic tool for retinal disorders, such as diabetic retinopathy and retinopathy of prematurity. With regard to retinopathy of prematurity, bedside examination with binocular indirect ophthalmoscopy has been the gold standard technique for screening, yet with several limitations. Herein, we review the current evidence that supports the role of telemedicine for the screening of infants with retinopathy of prematurity.

Pediatric Telehealth: Opportunities and Challenges

This article examines the current role of telehealth as a tool in the delivery of pediatric health care. It defines telemedicine and telehealth and provides an overview of different types of telehealth services. The article then explores the potential of telehealth to improve pediatric health care quality and safety through increased access to care, enhanced communication, expanded educational opportunities, and better resource utilization. It also discusses current challenges to the implementation of telehealth, including technological, financial, and licensing barriers, as well as provider, patient, and legal concerns.

Teleophthalmology: improving patient outcomes?

Teleophthalmology is gaining importance as an effective eye care delivery modality worldwide. In many developing countries, teleophthalmology is being utilized to provide quality eye care to the underserved urban population and the unserved remote rural population. Over the years, technological innovations have led to improvement in evidence and teleophthalmology has evolved from a research tool to a clinical tool. The majority of the current teleophthalmology services concentrate on patient screening and appropriate referral to experts. Specialty care using teleophthalmology services for the pediatric group includes screening as well as providing timely care for retinopathy of prematurity (ROP). Among geriatric eye diseases, specialty teleophthalmology care is focused toward screening and referral for diabetic retinopathy (DR), glaucoma, age-related macular degeneration (ARMD), and other sight-threatening conditions. Comprehensive vision screening and refractive error services are generally covered as part of most of the teleophthalmology methods. Over the past decades, outcome assessment of health care system includes patients' assessments on their health, care, and services they receive. Outcomes, by and large, remain the ultimate validators of the effectiveness and quality of medical care. Teleophthalmology produces the same desired clinical outcome as the traditional system. Remote portals allow specialists to provide care over a larger region, thereby improving health outcomes and increasing accessibility of specialty care to a larger population. A high satisfaction level and acceptance is reported in the majority of the studies because of increased accessibility and reduced traveling cost and time. Considering the improved quality of patient care and patient satisfaction reported for these telemedicine services, this review explores how teleophthalmology helps to improve patient outcomes.

[Telemedicine correlation in retinopathy of prematurity between experts and non-expert observers]

OBJECTIVE

To study the correlation between expert and non-expert observers in the reporting images for the diagnosis of retinopathy of prematurity (ROP) in a telemedicine setting.

METHODS

A cross-sectional, multicenter study, consisting of 25 sets of images of patients screened for ROP. They were evaluated by two experts in ROP and 1 non-expert and classified according to telemedicine classification, zone, stage, plus disease and Ells referral criteria. The telemedicine classification was: no ROP, mild ROP, type 2 ROP, or ROP that requires treatment. Ells referral criteria is defined as the presence at least one of the following: ROP in zone I, Stage 3 in zone I or II, or plus+ For statistical analysis, SPSS 16.0 was used. For correlation, Kappa value was performed.

RESULTS

There was a high correlation between observers for the assessment of ROP stage (0.75; 0.54-0.88) plus disease (0.85; 0.71-0.92), and Ells criteria (0.89; 0.83-1.0). However, inter-observer values were low for zone (0.41; 0.27-0.54) and telemedicine classification (0.43; 0.33-0.6).

CONCLUSIONS

When evaluating telemedicine images by examiners with different levels of expertise in ROP, the Ells criteria gave the best correlation. In addition, stage of disease and plus disease have good correlation among observers. In contrast, the correlation between observers was low for zone and telemedicine classification.

The Global Education Network for Retinopathy of Prematurity (Gen-Rop): Development, Implementation, and Evaluation of A Novel Tele-Education System (An American Ophthalmological Society Thesis)

PURPOSE

To describe the design, implementation, and evaluation of a tele-education system developed to improve diagnostic competency in retinopathy of prematurity (ROP) by ophthalmology residents.

METHODS

A secure Web-based tele-education system was developed utilizing a repository of over 2,500 unique image sets of ROP. For each image set used in the system, a reference standard ROP diagnosis was established. Performance by ophthalmology residents (postgraduate years 2 to 4) from the United States and Canada in taking the ROP tele-education program was prospectively evaluated. Residents were presented with image-based clinical cases of ROP during a pretest, posttest, and training chapters. Accuracy and reliability of ROP diagnosis (eg, plus disease, zone, stage, category) were determined using sensitivity, specificity, and the kappa statistic calculations of the results from the pretest and posttest.

RESULTS

Fifty-five ophthalmology residents were provided access to the ROP tele-education program. Thirty-one ophthalmology residents completed the program. When all training levels were analyzed together, a statistically significant increase was observed in sensitivity for the diagnosis of plus disease, zone, stage, category, and aggressive posterior ROP (P<.05). Statistically significant changes in specificity for identification of stage 2 or worse (P=.027) and pre-plus (P=.028) were observed.

CONCLUSIONS

A tele-education system for ROP education is effective in improving diagnostic accuracy of ROP by ophthalmology residents. This system may have utility in the setting of both healthcare and medical education reform by creating a validated method to certify telemedicine providers and educate the next generation of ophthalmologists.

Stanford University Network for Diagnosis of Retinopathy of Prematurity (SUNDROP): five years of screening with telemedicine

BACKGROUND AND OBJECTIVE

To report the 5-year results of the Stanford University Network for Diagnosis of Retinopathy of Prematurity (SUNDROP) telemedicine initiative.

PATIENTS AND METHODS

Infants requiring retinopathy of prematurity (ROP) screening at six neonatal intensive care units from December 1, 2005, to November 30, 2010, were evaluated with remote retinal photography by an ROP specialist. Every infant received outpatient binocular indirect ophthalmoscope examinations until termination criteria were achieved or until treatment. Outcomes were treatment-warranted ROP (TW-ROP, ETROP type 1) and adverse anatomical events.

RESULTS

Five hundred eleven infants (1,022 eyes) were screened. Fifteen infants had TW-ROP and underwent laser photocoagulation. The TW-ROP cohort had significantly lower birth weight and gestational age (both P < .001). No patient progressed to adverse anatomical outcomes and no case of TW-ROP was missed. Tele-medicine had 100% sensitivity, 99.8% specificity, 93.8% positive predictive value, and 100% negative predictive value for detection of TW-ROP.

CONCLUSION

Telemedicine demonstrates high diagnostic accuracy for detection of TW-ROP and can complement ROP screening.

Telemedicine for retinopathy of prematurity

PURPOSE OF REVIEW

To examine and review digital retinal imaging via telemedicine as an important screening and diagnostic tool in the management of retinopathy of prematurity (ROP).

RECENT FINDINGS

The use of wide-angle digital retinal photography to detect clinically significant ROP has been described in numerous reports since 2000. Comparisons with the gold standard of binocular indirect ophthalmoscopy have been favorable. Digital image capture can provide more objective information for disease detection, thereby facilitating internet consultation and retrospective analysis as part of the electronic medical record. As the presence of plus disease in ROP is now the most important criteria for determining the need for laser treatment, computer-based image analysis can potentially provide additional benefit to digital retinal imaging. Telemedicine screening also allows for the extension of diagnostic expertise to underserved areas in both the developed and third world. The role of telemedicine in ROP education will impact both screening efforts and traditional fellowship training in future years.

SUMMARY

As the worldwide incidence of ROP continues to rise, the use of telemedicine for screening, diagnostic and educational purposes will assume increasing importance in the delivery of healthcare for premature infants.

Comparison of profile of retinopathy of prematurity in semiurban/rural and urban NICUs in Karnataka, India

PURPOSE

To identify and compare the profile of retinopathy of prematurity (ROP) in premature babies in urban and semiurban neonatal intensive care units (NICUs).

METHODS

A prospective study of babies admitted to NICUs of two urban and seven semiurban centres. They were <36 weeks of gestational age and were subjected to fundus photography with a RetCam shuttle camera. Photos and NICU details were uploaded on a secure website. Photographs were read by a single observer. Infants were followed till retinal vascularisation was complete, or 45 weeks post conceptional age. Babies developing severe ROP were lasered.

RESULTS

500 babies were screened (243, urban group; 257, semiurban group). Incidence of ROP in the urban and semiurban groups was 16.5% (40) and 14.8% (38) respectively. Mean gestational age was 30.90 weeks and 31.53 weeks respectively. Mean birth weight was 1344 g and 1375 g respectively. 28 babies were lasered, 15 and 13 from each group respectively. There was no statistically significant difference between any of the parameters compared. Level of significance was fixed at 0.05.

CONCLUSIONS

The magnitude of the burden of ROP is comparable between urban and semiurban NICUs stressing the need for effective screening strategies in semiurban and rural areas as well.

Use of digital retinal imaging in screening for retinopathy of prematurity

The frequency of premature births is increasing world-wide. This factor, combined with improved survival and revised screening criteria, is resulting in an increased workload in screening for retinopathy of prematurity. Digital retinal imaging is emerging as an important alternative tool for diagnosing retinopathy of prematurity, and its use has even been extended to developing countries. Neonatal nurses and technicians can be trained to use digital imaging devices effectively. This is important in areas that do not have ready access to paediatric ophthalmologists. The ability to transfer images electronically makes it a valuable tool in telemedicine, while the ability to store and retrieve images is also advantageous from a medico-legal perspective. Image analysis software can further improve the accuracy of diagnosis. The main limitation of this technology is its high capital cost.

Detection of clinically significant retinopathy of prematurity using wide-angle digital retinal photography: a report by the American Academy of Ophthalmology

OBJECTIVE

To evaluate the accuracy of detecting clinically significant retinopathy of prematurity (ROP) using wide-angle digital retinal photography.

METHODS

Literature searches of PubMed and the Cochrane Library databases were conducted last on December 7, 2010, and yielded 414 unique citations. The authors assessed these 414 citations and marked 82 that potentially met the inclusion criteria. These 82 studies were reviewed in full text; 28 studies met inclusion criteria. The authors extracted from these studies information about study design, interventions, outcomes, and study quality. After data abstraction, 18 were excluded for study deficiencies or because they were superseded by a more recent publication. The methodologist reviewed the remaining 10 studies and assigned ratings of evidence quality; 7 studies were rated level I evidence and 3 studies were rated level III evidence.

RESULTS

There is level I evidence from ≥5 studies demonstrating that digital retinal photography has high accuracy for detection of clinically significant ROP. Level III studies have reported high accuracy, without any detectable complications, from real-world operational programs intended to detect clinically significant ROP through remote site interpretation of wide-angle retinal photographs.

CONCLUSIONS

Wide-angle digital retinal photography has the potential to complement standard ROP care. It may provide advantages through objective documentation of clinical examination findings, improved recognition of disease progression by comparing previous photographs, and the creation of image libraries for education and research.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found after the references.

Evaluation of vascular disease progression in retinopathy of prematurity using static and dynamic retinal images

PURPOSE

To measure accuracy and speed for detection of vascular progression in retinopathy of prematurity (ROP) from serial images. Two strategies are compared: static side-by-side presentation and dynamic flickering of superimposed image pairs.

DESIGN

Prospective comparative study.

METHODS

Fifteen de-identified, wide-angle retinal image pairs were taken from infants who eventually developed plus disease. Image pairs representing vascular disease progression were taken ≥1 week apart, and control images without progression were taken on the same day. Dynamic flickering pairs were created by digital image registration. Ten experts independently reviewed each image pair on a secure website using both strategies, and were asked to identify progression or state that images were identical. Accuracy and speed were measured, using examination date and ophthalmoscopic findings as a reference standard.

RESULTS

Using static images, experts were accurate in a mean (%) ± standard deviation (SD) of 11.4 of 15 (76%) ± 1.7 image pairs. Using dynamic flickering images, experts were accurate in a mean (%) ± SD of 11.3 of 15 (75%) ± 1.7 image pairs. There was no significant difference in accuracy between these strategies (P = .420). Diagnostic speed was faster using dynamic flickering (24.7 ± 8.3 seconds) vs static side-by-side images (40.3 ± 18.3 seconds) (P = .002). Experts reported higher confidence when interpreting dynamic flickering images (P = .001).

CONCLUSIONS

Retinal imaging provides objective documentation of vascular appearance, with potentially improved ability to recognize ROP progression compared to standard ophthalmoscopy. Speed of identifying vascular progression was faster by review of dynamic flickering image pairs than by static side-by-side images, although there was no difference in accuracy.

Diagnostic performance of a telemedicine system for ophthalmology: advantages in accuracy and speed compared to standard care

Telemedicine has potential to improve quality and delivery of medical care, particularly in image-oriented specialties where decisions are based on appearance of morphological features during examination. In the ophthalmology domain, nearly all published telemedicine studies have measured accuracy against a gold standard of ophthalmoscopic examination. The purposes of this study are to examine difficulties in defining an absolute gold standard and to compare diagnostic speed in a representative disease, retinopathy of prematurity. We compare results from ophthalmoscopic and telemedicine examinations by the same physicians. In 180 (86.5%) of 208 eyes, the two examinations produced the same diagnosis. In some discrepancies, there was rationale suggesting that telemedicine may have provided a more accurate diagnosis than ophthalmoscopic examination. The quantity and nature of these disagreements has important implications for evaluation of telemedicine systems in image-based specialties, and for the definition of gold standards in future studies.

Efficacy of wide-field digital retinal imaging for retinopathy of prematurity screening

BACKGROUND

To evaluate the efficacy of wide-field digital retinal imaging for retinopathy of prematurity screening.

DESIGN

Retrospective study in a quaternary public neonatal intensive care unit.

PARTICIPANTS

A total of 108 premature infants screened for retinopathy of prematurity.

METHODS

Retrospective chart and photo review were performed on participants screened by both serial wide-field digital retinal imaging and concurrent binocular indirect ophthalmoscopy. Review of captured digital photos was performed independently by a masked reader. Using the binocular indirect ophthalmoscopy findings as the gold standard, the efficacy of wide-field digital retinal imaging in detecting treatment-requiring retinopathy of prematurity, defined as type 1 prethreshold disease, was determined.

MAIN OUTCOME MEASURES

Sensitivity and specificity of wide-field digital retinal imaging in detecting treatment-requiring retinopathy of prematurity.

RESULTS

Treatment-requiring retinopathy of prematurity was detected in 11 infants by both binocular indirect ophthalmoscopy examination and telemedicine images taken at the same visit. Wide-field digital retinal imaging has a sensitivity of 100% (95% CI: 76.2-100%) and a specificity of 97.9% (95% CI: 93.4-99.7%) in detecting infants with treatment-requiring retinopathy of prematurity. Positive and negative predictive values of wide-field digital retinal imaging were 84.6% (95% CI: 57.8-97.3%) and 100% (95% CI: 96.9-100%), respectively.

CONCLUSIONS

Wide-field digital retinal imaging is accurate, reliable and efficient in detecting treatment-requiring retinopathy of prematurity. Incorporating wide-field digital retinal imaging with telemedicine in standard retinopathy of prematurity management can potentially improve delivery, accessibility, quality and cost of retinopathy of prematurity care.

Telemedicine for retinopathy of prematurity diagnosis: evaluation and challenges

Retinopathy of prematurity (ROP) is a vasoproliferative disorder affecting low birth weight infants. Although timely diagnosis and treatment can significantly reduce the risk of severe complications, ROP remains a leading cause of childhood blindness worldwide. Limitations of current disease management strategies include extensive travel and logistical coordination requirements for ophthalmologists and neonatologists, decreasing availability of adequately trained ophthalmologists at the point of care, variability in how retinal findings are diagnosed and documented, and a growing need for ROP care worldwide. Store-and-forward telemedicine is an emerging technology by which medical data are captured for subsequent interpretation by a remote expert. This has potential to improve accessibility, quality, and cost of ROP management. In this article, we summarize the current evaluation data on applications of telemedicine for ROP, particularly involving the diagnostic accuracy and reliability of remote image interpretation by experts. We also address challenges such as the cost-effectiveness of telemedicine, and highlight potential barriers to implementation of these systems. Understanding these principles is essential to determine future directions in research and development of telemedicine systems for ROP, as well as for other ophthalmic diseases.