Stanford University Network for Diagnosis of Retinopathy of Prematurity (SUNDROP): five years of screening with telemedicine

A Comparison of Strategies for Retinopathy of Prematurity Detection

BACKGROUND AND OBJECTIVES

Delayed detection of type 1 retinopathy of prematurity (ROP) can lead to permanent visual impairment. Providing ROP examinations is challenging because of the limited ophthalmology workforce. This study compares digital imaging-based ROP detection strategies versus serial ROP examinations.

METHODS

We conducted an individual-level microsimulation study of a hypothetical cohort of 650 infants with gestational age from 23 to 30 weeks. Infants were evaluated by using strategies based on indirect ophthalmoscopy or digital imaging beginning at 32 weeks' postmenstrual age (PMA) and continuing to discharge, transfer, or 40 weeks' PMA. ROP status and the accuracy of digital imaging were based on the e-ROP (Telemedicine Approaches to Evaluating Acute-Phase ROP) study, which enrolled high-risk infants.

RESULTS

Within the hypothetical NICU, the strategy of ROP examinations identified an average of 45.8 cases of type 1 ROP by discharge, transfer, or 40 weeks' PMA, and another 1.9 cases were included in the group of infants recommended to have later follow-up. Digital imaging with an ROP examination at discharge identified all 47.7 cases of type 1 ROP. On average, the ROP examination-only strategy required 1745.7 ROP examinations, whereas digital imaging with a discharge examination required 1065.5 ROP examinations and 1786.2 digital imaging sessions.

CONCLUSIONS

Although digital imaging decreased the number of ROP examinations per infant, there was an increase in the total number of interventions (ie, ROP examinations and imaging sessions). Providing an ROP examination at the time of NICU discharge can significantly reduce the number of infants who require follow-up.

Evaluation of Screening for Retinopathy of Prematurity by ROPtool or a Lay Reader

PURPOSE

To determine if (1) tortuosity assessment by a computer program (ROPtool, developed at the University of North Carolina, Chapel Hill, and Duke University, and licensed by FocusROP) that traces retinal blood vessels and (2) assessment by a lay reader are comparable with assessment by a panel of 3 retinopathy of prematurity (ROP) experts for remote clinical grading of vascular abnormalities such as plus disease.

DESIGN

Validity and reliability analysis of diagnostic tools.

PARTICIPANTS

Three hundred thirty-five fundus images of prematurely born infants.

METHODS

Three hundred thirty-five fundus images of prematurely born infants were obtained by neonatal intensive care unit nurses. A panel of 3 ROP experts graded 84 images showing vascular dilatation, tortuosity, or both and 251 images showing no evidence of vascular abnormalities. These images were sent electronically to an experienced lay reader who independently graded them for vascular abnormalities. The images also were analyzed using the ROPtool, which assigns a numerical value to the level of vascular abnormality and tortuosity present in each of 4 quadrants or sectors. The ROPtool measurements of vascular abnormalities were graded and compared with expert panel grades with a receiver operating characteristic (ROC) curve. Grades between human readers were cross-tabulated. The area under the ROC curve was calculated for the ROPtool, and sensitivity and specificity were computed for the lay reader.

MAIN OUTCOME MEASURES

Measurements of vascular abnormalities by ROPtool and grading of vascular abnormalities by 3 ROP experts and 1 experienced lay reader.

RESULTS

The ROC curve for ROPtool's tortuosity assessment had an area under the ROC curve of 0.917. Using a threshold value of 4.97 for the second most tortuous quadrant, ROPtool's sensitivity was 91% and its specificity was 82%. Lay reader sensitivity and specificity were 99% and 73%, respectively, and had high reliability (κ, 0.87) in repeated measurements.

CONCLUSIONS

ROPtool had very good accuracy for detection of vascular abnormalities suggestive of plus disease when compared with expert physician graders. The lay reader's results showed excellent sensitivity and good specificity when compared with those of the expert graders. These options for remote reading of images to detect vascular abnormalities deserve consideration in the quest to use telemedicine with remote reading for efficient delivery of high-quality care and to detect infants requiring bedside examination.

Safety of Retinopathy of Prematurity Examination and Imaging in Premature Infants

OBJECTIVES

To describe adverse events (AEs) and noteworthy clinical or ocular findings associated with retinopathy of prematurity (ROP) evaluation procedures.

STUDY DESIGN

Descriptive analysis of predefined AEs and noteworthy findings reported in a prospective observational cohort study of infants <1251 g birth weight who had ROP study visits consisting of both binocular indirect ophthalmoscopy (BIO) and digital retinal imaging. We compared infant characteristics during ROP visits with and without AEs. We compared respiratory support, nutrition, and number of apnea, bradycardia, or hypoxia events 12 hours before and after ROP visits.

RESULTS

A total of 1257 infants, mean birth weight 802 g, had 4263 BIO and 4048 imaging sessions (total 8311 procedures). No serious AEs were related to ROP visits. Sixty-five AEs were reported among 61 infants for an AE rate of 4.9% infants (61/1257) or 0.8% total procedures (65/8311 BIO + imaging). Most AEs were due to apnea, bradycardia, and/or hypoxia (68%), tachycardia (16%), or emesis (8%). At ROP visit, infants with AEs, compared with those without, were more likely to be on mechanical ventilation (26% vs 12%, P = .04) even after adjustment for weight and postmenstrual age. Noteworthy clinical findings were reported during 8% BIO and 15% imaging examinations. Respiratory and nutrition support were not significantly different before and after ROP evaluations.

CONCLUSIONS

Retinal imaging by nonphysicians combined with BIO was safe. Noteworthy clinical findings occurred during both procedures. Ventilator support was a risk factor for AEs. Monitoring rates of AEs and noteworthy findings are important to the safe implementation of ROP imaging protocols.

TRIAL REGISTRATION

Clinicaltrials.gov: NCT01264276.

Role of tele-medicine in retinopathy of prematurity screening in rural outreach centers in India - a report of 20,214 imaging sessions in the KIDROP program

Middle-income countries such as India are suffering from the third epidemic of retinopathy of prematurity (ROP). Improved survival and lower infant mortality rates have resulted in an increased number of preterm survivors in rural areas that unfortunately lack ROP specialists. We report our experience of a public-private partnership in rural India of an ongoing telemedicine program Karnataka Internet Assisted Diagnosis of Retinopathy of Prematurity program KIDROP that provides ROP screening by non-physicians. The analysis of 20,214 imaging sessions of 7106 from 36 rural centers in 77 months of activity are presented. The overall incidence of any stage and treatment requiring ROP was 22.39% and 3.57% respectively. We found a higher incidence of severe ROP in private (7.1%) vs government centers (1.7%). Fifty of the 254 babies (19.69%) who underwent treatment were outside the American screening guidelines cut-off. The report compares other "real-world" tele-ROP programs, summarizes the impact, and provides future strategies for outreach ROP screening in middle-income countries.

Validated System for Centralized Grading of Retinopathy of Prematurity: Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity (e-ROP) Study

IMPORTANCE

Measurable competence derived from comprehensive and advanced training in grading digital images is critical in studies using a reading center to evaluate retinal fundus images from infants at risk for retinopathy of prematurity (ROP). Details of certification for nonphysician trained readers (TRs) have not yet been described.

OBJECTIVE

To describe a centralized system for grading ROP digital images by TRs in the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity (e-ROP) Study.

DESIGN, SETTING, AND PARTICIPANTS

Multicenter observational cohort study conducted from July 1, 2010, to June 30, 2014. The TRs were trained by experienced ROP specialists and certified to detect ROP morphology in digital retinal images under supervision of an ophthalmologist reading center director. An ROP reading center was developed with standard hardware, secure Internet access, and customized image viewing software with an electronic grading form. A detailed protocol for grading was developed. Based on results of TR gradings, a computerized algorithm determined whether referral-warranted ROP (RW-ROP; defined as presence of plus disease, zone I ROP, and stage 3 or worse ROP) was present in digital images from infants with birth weight less than 1251 g enrolled from May 25, 2011, through October 31, 2013. Independent double grading was done by the TRs with adjudication of discrepant fields performed by the reading center director.

EXPOSURE

Digital retinal images.

MAIN OUTCOMES AND MEASURES

Intragrader and intergrader variability and monitoring for temporal drift.

RESULTS

Four TRs underwent rigorous training and certification. A total of 5520 image sets were double graded, with 24.5% requiring adjudication for at least 1 component of RW-ROP. For individual RW-ROP components, the adjudication rate was 3.9% for plus disease, 12.4% for zone I ROP, and 16.9% for stage 3 or worse ROP. The weighted κ for intergrader agreement (n = 80 image sets) was 0.72 (95% CI, 0.52-0.93) for RW-ROP, 0.57 (95% CI, 0.37-0.77) for plus disease, 0.43 (95% CI, 0.24-0.63) for zone I ROP, and 0.67 (95% CI, 0.47-0.88) for stage 3 or worse ROP. The weighted κ for grade-regrade agreement was 0.77 (95% CI, 0.57-0.97) for RW-ROP, 0.87 (95% CI, 0.67-1.00) for plus disease, 0.70 (95% CI, 0.51-0.90) for zone I ROP, and 0.77 (95% CI, 0.57-0.97) for stage 3 or worse ROP.

CONCLUSIONS AND RELEVANCE

These data suggest that the e-ROP system for training and certifying nonphysicians to grade ROP images under the supervision of a reading center director reliably detects potentially serious ROP with good intragrader and intergrader consistency and minimal temporal drift.

"Tele-rounding" with a remotely controlled mobile robot in the neonatal intensive care unit

OBJECTIVE

To investigate the feasibility of 'tele-rounding' in the neonatal intensive care.

METHODS

In this prospective study utilizing telemedicine technology in the NICU for daily patient bedside rounds ('tele-rounds'), twenty pairs of neonates were matched according to gestational age, diagnoses, and disease severity. One patient was cared for by the on-site NICU team lead by an on-site neonatologist. The other patient was cared for by the on-site team but led by an off-site neonatologist using a remote-controlled robot. Patient rounding data, clinical outcomes, length of stay, and hospital costs were compared between the two groups. Parents and staff were also surveyed about their satisfaction with telemedicine.

RESULTS

Except for one parameter, no significant differences in care or outcomes were found between patients cared for by either neonatologist. The exception was the time the off-site neonatologist spent on the patient encounter compared to the on-site neonatologist (median [interquartile range]), (5 minutes [5, 6] vs. 8 minutes [7, 10.5], p = 0.002). This difference was due primarily to time needed to operate and maneuver the robot or occasionally to slower or dropped connection to the Internet. There were positive perceptions of telemedicine among both parents and NICU staff.

CONCLUSION

As long as direct bedside care providers are available, remote-controlled, robotic telemedicine technology can be utilized by neonatologists to perform daily patient rounds in the neonatal intensive care unit.

Current understanding and management of aggressive posterior retinopathy of prematurity

Aggressive posterior retinopathy of prematurity (ROP), previously referred to as “Rush disease”, is a rapidly progressive form of ROP. This form of ROP typically presents in very low birth weight babies of early gestational age. Historically, anatomical and functional outcomes have been poor with standard treatment. This review is designed to discuss current knowledge and treatment regarding this aggressive form of ROP. Recommendations regarding management of these difficult cases are detailed.

[Telemedicine correlation in retinopathy of prematurity between experts and non-expert observers]

OBJECTIVE

To study the correlation between expert and non-expert observers in the reporting images for the diagnosis of retinopathy of prematurity (ROP) in a telemedicine setting.

METHODS

A cross-sectional, multicenter study, consisting of 25 sets of images of patients screened for ROP. They were evaluated by two experts in ROP and 1 non-expert and classified according to telemedicine classification, zone, stage, plus disease and Ells referral criteria. The telemedicine classification was: no ROP, mild ROP, type 2 ROP, or ROP that requires treatment. Ells referral criteria is defined as the presence at least one of the following: ROP in zone I, Stage 3 in zone I or II, or plus+ For statistical analysis, SPSS 16.0 was used. For correlation, Kappa value was performed.

RESULTS

There was a high correlation between observers for the assessment of ROP stage (0.75; 0.54-0.88) plus disease (0.85; 0.71-0.92), and Ells criteria (0.89; 0.83-1.0). However, inter-observer values were low for zone (0.41; 0.27-0.54) and telemedicine classification (0.43; 0.33-0.6).

CONCLUSIONS

When evaluating telemedicine images by examiners with different levels of expertise in ROP, the Ells criteria gave the best correlation. In addition, stage of disease and plus disease have good correlation among observers. In contrast, the correlation between observers was low for zone and telemedicine classification.

Narrative review of telemedicine consultation in medical practice

BACKGROUND

The use of telemedicine has grown across several medical fields, due to the increasing number of "e-patients".

OBJECTIVE

This narrative review gives an overview of the growing use of telemedicine in different medical specialties, showing how its use can improve medical care.

METHODS

A PubMed/Medline, Embase, Web of Science, and Scopus search was performed using the following keywords: telemedicine, teleconsultation, telehealth, e-health, and e-medicine. Selected papers from 1996 to 2014 were chosen on the basis of their content (quality and novelty).

RESULTS

Telemedicine has already been applied to different areas of medical practice, and it is as effective as face-to-face medical care, at least for the diagnosis and treatment of some pathological conditions.

CONCLUSION

Telemedicine is time- and cost-effective for both patients and health care professionals, encouraging its use on a larger scale. Telemedicine provides specialist medical care to patients who have poor access to hospitals, and ensures continuity of care and optimal use of available health resources. The use of telemedicine opens new perspectives for patients seeking a medical second opinion for their pathology, since they can have remote access to medical resources that would otherwise require enormous costs and time.

Telemedicine for corneal disease in rural Nepal

We evaluated the diagnostic accuracy of slit-lamp photographs interpreted by telemedicine compared to a conventional clinical examination. A convenience sample of 21 patients with anterior segment disease was enrolled at the Lumbini Eye Institute (LEI) in Bhairahawa, Nepal. An ophthalmologist at the LEI examined each patient and assigned a diagnosis and follow-up interval; this represented the gold standard. An ophthalmic technician also obtained anterior segment photographs of each patient. Slit-lamp photographs and clinical histories were then uploaded to a server for access by three separate readers. These readers, one in Nepal and two in the US, provided a diagnosis and follow-up interval independently. The diagnostic agreement between the examiner and all readers was good (kappa = 0.75, P < 0.0001). The agreement regarding follow-up interval between the examiner and all readers was fair, with a kappa coefficient of 0.32 (P < 0.0001). However, the agreement was high when comparing the examiner with the reviewer in Nepal (kappa = 0.90) and was moderate when comparing the two US-based readers with each other (kappa = 0.45). In general, the ophthalmologists in Nepal recommended more rapid follow-up than their US-based counterparts. Our results suggest that the transmission of slit-lamp photographs from satellite clinics and eye health screening camps to the LEI and elsewhere for review and triage is an effective means of identifying anterior segment pathology.