Scoring reading parameters: An inter-rater reliability study using the MNREAD chart

PTVR - A software in Python to make virtual reality experiments easier to build and more reproducible

Researchers increasingly use virtual reality (VR) to perform behavioral experiments, especially in vision science. These experiments are usually programmed directly in so-called game engines that are extremely powerful. However, this process is tricky and time-consuming as it requires solid knowledge of game engines. Consequently, the anticipated prohibitive effort discourages many researchers who want to engage in VR. This paper introduces the Perception Toolbox for Virtual Reality (PTVR) library, allowing visual perception studies in VR to be created using high-level Python script programming. A crucial consequence of using a script is that an experiment can be described by a single, easy-to-read piece of code, thus improving VR studies' transparency, reproducibility, and reusability. We built our library upon a seminal open-source library released in 2018 that we have considerably developed since then. This paper aims to provide a comprehensive overview of the PTVR software for the first time. We introduce the main objects and features of PTVR and some general concepts related to the three-dimensional (3D) world. This new library should dramatically reduce the difficulty of programming experiments in VR and elicit a whole new set of visual perception studies with high ecological validity.

Validation of a computerized version of the MNREAD chart for children

PURPOSE

We aimed the develop and validate a computerized version of the MNREAD for the assessment of reading speed for children.

METHODS

A computerized version of the MNREAD was built in Psykinematix software using the same parameters as the physical chart. We measured the reading velocity of 104 children (n = 44 of the 3rd grade; n = 60 of the 5th grade). Bland-Altaman analysis was used to quantify agreement between two chart measurements.

RESULTS

Comparison between the 3rd and 5th-grade children for physical and computerized MNREAD versions showed statistical differences in Maximum Reading Speed (F = 2669.6; p < 0.001), Critical Print Size (F = 17.49; p < 0.001), and Reading Acuity (F = 14.19; p = 0.002) with huge effect size (η2 = 0.930). No differences were found between the versions within grades. Bland-Altman analysis showed 95% of the data points within ± 2 s of the mean difference, suggesting a similarity between versions of the MNREAD parameters.

CONCLUSION

Our reading speed values for children in the 5th grade were higher than previous studies, suggesting a better quality of the assessment in the computerized version. Tolerance Limits were calculated as normality references for clinical purposes.

Pegcetacoplan for the treatment of geographic atrophy secondary to age-related macular degeneration (OAKS and DERBY): two multicentre, randomised, double-masked, sham-controlled, phase 3 trials

BACKGROUND

Geographic atrophy is a leading cause of progressive, irreversible vision loss. The objectives of OAKS and DERBY were to assess the efficacy and safety of pegcetacoplan compared with sham treatment in patients with geographic atrophy.

METHODS

OAKS and DERBY were two 24-month, multicentre, randomised, double-masked, sham-controlled, phase 3 studies, in which patients aged 60 years and older with geographic atrophy secondary to age-related macular degeneration were enrolled at 110 clinical sites and 122 clinical sites worldwide, respectively. Patients were randomly assigned (2:2:1:1) by central web-based randomisation system to intravitreal 15 mg per 0·1 mL pegcetacoplan monthly or every other month, or sham monthly or every other month using stratified permuted block randomisation (stratified by geographic atrophy lesion area at screening, history or presence of active choroidal neovascularisation in the eye not under assessment, and block size of six). Study site staff, patients, reading centre personnel, evaluating physicians, and the funder were masked to group assignment. Sham groups were pooled for the analyses. The primary endpoint was the change from baseline to month 12 in the total area of geographic atrophy lesions in the study eye based on fundus autofluorescence imaging, in the modified intention-to-treat population (ie, all patients who received one or more injections of pegcetacoplan or sham and had a baseline and at least one post-baseline value of lesion area). Key secondary endpoints (measured at 24 months) were change in monocular maximum reading speed of the study eye, change from baseline in mean functional reading independence index score, change from baseline in normal luminance best-corrected visual acuity score, and change from baseline in the mean threshold sensitivity of all points in the study eye by mesopic microperimetry (OAKS only). Safety analyses included patients who were randomly assigned and received at least one injection of pegcetacoplan or sham. The now completed studies are registered with ClinicalTrials.gov, NCT03525613 (OAKS) and NCT03525600 (DERBY).

FINDINGS

Between Aug 30, 2018, and July 3, 2020, 1258 patients were enrolled in OAKS and DERBY. The modified intention-to-treat populations comprised 614 (96%) of 637 patients in OAKS (202 receiving pegcetacoplan monthly, 205 pegcetacoplan every other month, and 207 sham) and 597 (96%) of 621 patients in DERBY (201 receiving pegcetacoplan monthly, 201 pegcetacoplan every other month, and 195 sham). In OAKS, pegcetacoplan monthly and pegcetacoplan every other month significantly slowed geographic atrophy lesion growth by 21% (absolute difference in least-squares mean -0·41 mm2, 95% CI -0·64 to -0·18; p=0·0004) and 16% (-0·32 mm2, -0·54 to -0·09; p=0·0055), respectively, compared with sham at 12 months. In DERBY, pegcetacoplan monthly and pegcetacoplan every other month slowed geographic atrophy lesion growth, although it did not reach significance, by 12% (-0·23 mm2, -0·47 to 0·01; p=0·062) and 11% (-0·21 mm2, -0·44 to 0·03; p=0·085), respectively, compared with sham at 12 months. At 24 months, pegcetacoplan monthly and pegcetacoplan every other month slowed geographic atrophy lesion growth by 22% (-0·90 mm2, -1·30 to -0·50; p<0·0001) and 18% (-0·74 mm2, -1·13 to -0·36; p=0·0002) in OAKS, and by 19% (-0·75 mm2, -1·15 to -0·34; p=0·0004) and 16% (-0·63 mm2, -1·05 to -0·22; p=0·0030) in DERBY, respectively, compared with sham. There were no differences in key secondary visual function endpoints at 24 months. Serious ocular treatment-emergent adverse events were reported in five (2%) of 213, four (2%) of 212, and one (<1%) of 211 patients in OAKS, and in four (2%) of 206, two (1%) of 208, and two (1%) of 206 patients in DERBY receiving pegcetacoplan monthly, pegcetacoplan every other month, and sham, respectively, at 24 months. New-onset exudative age-related macular degeneration was reported in 24 (11%), 16 (8%), and four (2%) patients in OAKS, and in 27 (13%), 12 (6%), and nine (4%) patients in DERBY receiving pegcetacoplan monthly, pegcetacoplan every other month, and sham, respectively, at 24 months.

INTERPRETATION

Pegcetacoplan, the first treatment approved by the US Food and Drug Administration for geographic atrophy, slowed geographic atrophy lesion growth with an acceptable safety profile.

FUNDING

Apellis Pharmaceuticals.

Reading performance in Portuguese children from second to tenth grade with the MNREAD reading acuity test

PURPOSE

To assess reading performance and report normative values for normal sighted Portuguese schoolchildren using the Portuguese version of the MNREAD reading acuity chart.

METHODS

Children in the 2nd, 4th, 6th, 8th, and 10th grade in Portugal were recruited for this study. One hundred and sixty-seven children from 7 to 16 years of age participated. The Portuguese version of the printed MNREAD reading acuity chart was used to measure reading performance in these children. The non-linear mixed effects model with negative exponential decay function was used to compute maximum reading speed (MRS) and critical print size (CPS) automatically. Reading acuity (RA) and reading accessibility index (ACC) were computed manually.

RESULTS

The mean MRS in words-per-minute (wpm) for the 2nd grade was 55 wpm (SD = 11.2 wpm), 104 wpm (SD = 27.9) for the 4th grade, 149 wpm (SD = 22.5) for 6th grade, 172 wpm (SD = 24.6) for 8th grade and 180 wpm for the 10th grade (SD = 16.8). There was a significant difference in MRS between school grades (p < 0.001). Participants' reading speed increased by 14.5 wpm (95% CL: 13.1-15.9) with each year of increase in age. We found a significant difference between RA and school grades, but not for CPS.

CONCLUSIONS

This study provides normative reading performance values for the Portuguese version of the MNREAD chart. The MRS increased with increasing age and school grade, while RA shows initial improvement from early school years and gradually stabilizes in the more mature children. Normative values for the MNREAD test can now be used to determine reading difficulties or slow reading speed in, for example, children with impaired vision.

The Basic VRS-Effect Study: Clinical Trial Outcomes and Cost-Effectiveness of Low Vision Rehabilitation in Portugal

INTRODUCTION

The aim of this study was twofold: (1) to investigate the clinical impact of vision rehabilitation in patients with vision impairment and (2) to investigate the cost-effectiveness of a basic vision rehabilitation service in Portugal.

METHODS

The trial recruited patients diagnosed with age-related macular degeneration or diabetic retinopathy (DR) and visual acuity in the range 0.4-1.0logMAR in the better-seeing eye. Participants were randomised to one of the study arms consisting of immediate intervention and delayed intervention. The intervention included: new refractive correction, optical reading aids, in-office training and advice about modifications at home. Visual ability, health-related quality of life and costs were measured. Economic analysis was performed to evaluate whether the intervention was cost-effective. The trial compared the outcomes 12 weeks after the start in both arms.

RESULTS

Of the 46 participants, 34 (74%) were diagnosed with DR, 25 (54%) were female, and mean age was 70.08 years (SD = 8.74). In the immediate intervention arm visual ability increased a mean of 0.523 logits (SE = 0.11) (p < 0.001). Changes in the delayed intervention arm were not statistically significant (p = 0.95). Acuity in the better-seeing eye, near acuity and critical print size also improved during the study. The mean cost of the intervention was €118.79 (SD = 24.37). The incremental cost-effectiveness ratio using the EQ-5D-5L was 30,421€/QALY and 1186€/QALY when using near acuity.

CONCLUSION

The current study gives evidence of positive clinical impact of a basic vision rehabilitation intervention and shows that a basic vision rehabilitation service is cost-effective. These findings are important to clinical and rehabilitation practices and for planning vision rehabilitation services.

TRIAL REGISTRATION

Retrospectively registered, 21/01/2019. ISRCTN10894889, https://www.isrctn.com/ISRCTN10894889.

A systematic review of reading tests

Adequate near and intermediate visual capacity is important in performing everyday tasks, especially after the introduction of smartphones and computers in our professional and recreational activities. Primary objective of this study was to review all available reading tests both conventional and digital and explore their integrated characteristics. A systematic review of the recent literature regarding reading charts was performed based on the PubMed, Google Scholar, and Springer databases between February and March 2021. Data from 11 descriptive and 24 comparative studies were included in the present systematic review. Clinical settings are still dominated by conventional printed reading charts; however, the most prevalent of them (i.e., Jaeger type charts) are not validated. Reliable reading capacity assessment is done only by those that comply with the International Council of Ophthalmology (ICO) recommendations. Digital reading tests are gaining popularity both in clinical and research settings and are differentiated in standard computer-based applications that require installation either in a computer or a tablet (e.g., Advanced VISION Test and web-based ones e.g., Democritus Digital Acuity Reading Test requires no installation). It is evident that validated digital tests will prevail in future clinical or research settings and it is upon ophthalmologists to select the one most compatible with their examination routine.

Predictors of problems reported on the EQ-5D-3L dimensions among people with impaired vision in northern Portugal

BACKGROUND

The EQ-5D index often fails to detect the effect of ophthalmic diseases and sight loss. Investigating predictors of individual EQ-5D health dimensions might reveal the underlying reasons. The aim of this study was to investigate predictors of health dimension ratings obtained with the EQ-5D-3L from participants with impaired vision representing a spectrum of eye diseases.

METHODS

Observational cross-sectional study with participants recruited at four public hospitals in Portugal. Outpatients with visual acuity of 0.30 logMAR(6/12) or worse in the better-seeing eye were invited to participate. Participants completed two instruments: the EQ-5D-3L (measures participants' perceived health-related quality-of-life) and the Massof Activity Inventory (measures visual ability-ability to perform vision-related activities). This study used logistic regression models to identify factors associated with responses to the EQ-5D-3L.

RESULTS

The study included 492 participants, mean age 63.4 years (range = 18-93), 50% females. The most common diagnosis was diabetic retinopathy (37%). The mean visual acuity in the better seeing eye was 0.65 logMAR (SD = 0.48) and the mean visual ability was 0.62 logits (SD = 2.04), the correlation between the two was r = - 0.511 (p < 0.001). Mobility and self-care were the health dimensions with the fewest problems (1% reported extreme problems), anxiety and depression the dimension with the most problems (24% reported extreme problems). ROC curve analysis showed that the EQ-5D index was a poor predictor of cases of vision impairment whilst visual ability given was a good predictor of cases of vision impairment. Visual ability was an independent predictor of the response for all dimensions, higher ability was always associated with a reduced odds of reporting problems. The odds of reporting problems were increased for females in 3 out of 5 dimensions. Comorbidities, visual acuity and age-category were predictors of the odds of reporting problems for one dimension each.

CONCLUSIONS

The odds of reporting problems for the five health dimensions of the EQ-5D-3L were strongly influenced by the ability to perform vision-related activities (visual ability). The EQ-5D index showed poor performance at detecting vision impairment. These findings are informative and relevant for the clinic and for research evaluating the impact of eye diseases and disease treatments in ophthalmology.

Can listening provide a useful clinical estimate of low vision reading parameters?

PURPOSE

The purpose of this study was to determine whether a clinician can assess critical print size (CPS) and/or reading fluency by listening to a visually impaired patient reading aloud across a range of print sizes on an MNREAD chart, rather than needing to plot and analyse reading speed data as a function of print size.

METHODS

Fifty-six low vision participants were audio-recorded reading an MNREAD chart under standard conditions. Two experienced raters listened to the recordings and made judgments of the CPS (logMAR), and of the level of reading fluency achieved at large print sizes on a 4-point rating scale. Reading times were plotted as a function of print size to determine the CPS as the smallest print size that supported the participant's maximum reading speed (MRS) by inspection, and the MRS as the mean reading speed across print sizes including, and larger than, the CPS.

RESULTS

Listened CPS judgments made for each rater were slightly larger than the CPS values obtained by inspection (mean differences 0.04logMAR (p = 0.06), 0.08logMAR (p < 0.01); limits of agreement (LoA) ±0.28logMAR, ±0.39logMAR, respectively). CPS judgments were consistent both between raters (mean difference 0.04logMAR [p = 0.18]; LoA ±0.42logMAR) and between two judgments made by each rater (mean differences 0.00logMAR (p = 1.0), 0.03logMAR (p < 0.05); LoA ±0.23logMAR, ±0.17logMAR). Reading fluency could be categorised as 'functional' (MRS > 80 wpm) or 'non-functional' (MRS < 80 wpm) with a sensitivity of 88%-90% and a specificity of 100%.

CONCLUSIONS

Experienced raters listening to a patient reading an MNREAD chart can determine a clinically useful estimate of critical print size and can discriminate maximum reading speeds that are above and below that likely to provide sustained reading ability. Listening to a patient reading an MNREAD chart is an option for the low vision clinician's armoury of assessments.

Assessing optimal colour and illumination to facilitate reading: an analysis of print size

PURPOSE

This study examined how optimal colour/illumination conditions and the efficacy of the iPad, LuxIQ and Smart Bulb varied as a function of print size in younger, older and visually impaired adults.

METHODS

Participants with visual impairments and simulated low vision (SLV) read the MNRead using the iPad, LuxIQ and Smart Bulb.

RESULTS

In the impairment condition at 1.20 logMAR, the iPad (M = 9.49, 95% CI [3.18, 19.42]) and LuxIQ (M = 15.95, 95% CI [9.54, 24.86]) improved the reading speeds. At 0.80 logMAR (SLV), all devices improved reading speeds of older adults (iPad (M = 28.70, 95% CI [14.65, 42.51]); LuxIQ (M = 49.63, 95% CI [30.04, 69.68]); Smart Bulb (M = 23.11, 95% CI [3.33, 42.11])), but in younger adults only the LuxIQ (M = 13.04, 95% CI [3.21, 21.27]) did so. In the impairment condition, the iPad (M = 5.54, 95% CI [0.31, 12.13]) and LuxIQ (M = 13.90, 95% CI [7.88, 23.49]) improved reading speeds. In the SLV condition, age was a significant predictor of reading speed at 1.20 logMAR (F_3,164  = 10.74, p < 0.001, Adj. R²  = 0.16). At 0.80 logMAR, age and luminance, but not colour, were significant predictors (F_3,164  = 52.52, p < 0.001, Adj. R²  = 0.49). In the impairment condition, both age and lux were significant predictors of reading speed at 1.20 (F_3,85  = 7.14, p < 0.001, Adj. R²  = 0.20) and 0.80 logMAR (F_3,85  = 7.97, p < 0.001, Adj. R²  = 0.22), but colour was not.

CONCLUSIONS

Light source effectiveness and optimal colour/illumination vary as a function of print size. It appears that print size is the most important factor for improving reading speed. As print size decreases, luminance becomes crucial, and only at the smallest print sizes does the effect of colour become useful.

Introduction of a digital near-vision reading test for normal and low vision adults: development and validation

Background

MNREAD is an advanced near-vision acuity chart that has already been translated and validated in Greek language. Considering that no validated Greek digital near-vision test exists, our primary objective was to develop and validate a digital near-vision reading test based on the fundamental properties of the Greek printed MNREAD (MNREAD-GR).

Methods

This is a prospective, comparative study. A digital near-vision chart was developed (Democritus Digital Acuity Reading Test - DDART) with text size calibration, audio recording for automatic reading timing, as well as automatic calculation of reading acuity (RA), maximum reading speed (MRS), critical print size (CPS) and reading accessibility index (ACC). Normal and low vision subjects participated in the validation process, responding to MNREAD-GR and DDART at the same day, at a 40 cm viewing distance. Differences in all parameters between the charts were compared with t-test and intraclass correlation coefficients (ICCs). Within 15 days, all participants responded again to DDART in a different set of sentences to assess its test-retest reliability.

Results

One hundred patients (normal vision group - NVG: 70 patients; low vision group - LVG: 30 patients) responded to both reading tests. Non-significant differences were detected for all parameters between DDART and MNREAD-GR except for MRS and ACC that were significantly higher in MNREAD-GR in NVG (p <  0.01). NVG participants demonstrated sufficient ICCs that ranged from 0.854 to 0.963, while LVG demonstrated ICCs for RA, ACC, MRS and CPS equal to 0.986, 0.894, 0.794 and 0.723, respectively. All parameters calculated with DDART demonstrated excellent test-retest reliability (ICCs: 0.903 - 0.956).

Conclusions

The proposed reading test presented comparable validity and repeatability to MNREAD-GR suggesting that it can be used both in normal and low vision Greek patients.

Trial registration

ClinicalTrials.gov, NCT04242836. Registered 24 January 2020 - Retrospectively registered.

Cost-effectiveness of basic vision rehabilitation (The basic VRS-effect study): study protocol for a randomised controlled trial

PURPOSE

To investigate the cost-effectiveness of a basic vision rehabilitation service (basic-VRS) in Portugal. We designed a parallel group, randomised controlled trial whose aim is to compare the effects and costs of 'usual low vision care' with a 'basic-VRS intervention' on self-reported visual ability and other psychosocial and health-related quality-of-life outcomes.

METHODS

The trial will recruit participants that meet the following inclusion criteria: (1) visual acuity between 0.4-1.0 logMAR in the better-seeing eye, (2) cause of vision loss is diabetic retinopathy or age-related macular degeneration, (3) 18 years or older and iv) live in the community (not in nursing homes or other type of institution). Participants will be randomised to one of the study arms consisting of immediate intervention and delayed intervention. The delayed intervention group will receive 'usual care' or no intervention in the first 12 weeks. Visual acuity, contrast sensitivity and retinal structure will be assessed during the study.

RESULTS

The primary outcome measure is visual ability, which will be evaluated with the Massof Activity Inventory, we expect that the intervention will raise the overall person measure or visual ability. Reading, health-related quality-of-life, anxiety and depression and social support will be also assessed. The analysis will be undertaken on an intention-to-treat basis. A cost-effectiveness analysis will be performed to provide information about the cost per unit of utility. To evaluate the cost-effectiveness of the intervention we will adopt the perspective of the healthcare system.

CONCLUSION

This study will provide additional evidence about the effects of basic-VRS on self-reported visual ability. Findings from this study should also contribute to better planning of low vision provision and, consequently, may contribute to reduce barriers to basic-VRS.