Psychometric evaluation of the Participation and Activity Inventory for Children and Youth (PAI-CY) 0-2 years with visual impairment

Measurement invariance of the 12-item self-administered World Health Organization Disability Assessment Schedule (WHODAS) 2.0 across early and late adolescents in Canada

PURPOSE

This study examined whether the 12-item self-administered World Health Organization Disability Assessment Schedule (WHODAS) 2.0 demonstrated measurement invariance between young adolescents aged 10-16 years with a physical illness and older adolescents aged 15-19 years from the general population.

MATERIALS AND METHODS

Young adolescent data come from the baseline wave of the Multimorbidity in Youth across the Life-course study (n = 117) and older adolescent data come from the Canadian Community Health Survey-Mental Health (n = 1851). Multiple-group confirmatory factor analysis was used to test measurement invariance. WHODAS 2.0 scores were compared across morbidity subgroups using multiple regression.

RESULTS

Measurement invariance of the WHODAS 2.0 was demonstrated: (χ2=635.2(144), p<.001; RMSEA = 0.059 (0.054, 0.064); CFI = 0.967; TLI = 0.970; and, SRMR = 0.068). Adjusting for data source, sex, race, immigrant status, and household income, WHODAS 2.0 scores were associated with morbidity status in a dose-response manner: physical illness only (B = 1.50, p<.001), mental illness only (B = 2.92, p<.001), and physical-mental comorbidity (B = 4.44, p<.001).

CONCLUSIONS

Measurement invariance of the WHODAS 2.0 suggests that young adolescents interpret the items and disability construct similarly to older adolescents - a group that previously demonstrated measurement invariance with an adult sample. The 12-item self-administered WHODAS 2.0 may be used to measure disability across the life-course. IMPLICATIONS FOR REHABILITATIONThe 12-item self-administered WHODAS 2.0 is one of the most widely used measures of disability and functioning.Measurement invariance of the WHODAS 2.0 suggests that young adolescents interpret the items and disability construct similarly to older adolescents and adults in Canada.Researchers and health professionals can be confident that differences in 12-item self-administered WHODAS 2.0 scores are real and meaningful.The 12-item self-administered WHODAS 2.0 may be used to measure disability across the life-course.

Development and validation of the health literacy environment scale for Chinese hospitals from patients' perspective

Introduction

While the research on improving individual health literacy by promoting individual skills and abilities is increasing, less attention has been paid to the complexities of the healthcare environment that may influence patients' ability to access, understand, and apply health information and health services to make health decisions. This study aimed to develop and validate a Health Literacy Environment Scale (HLES) that is suitable for Chinese culture.

Methods

This study was conducted in two phases. First, using the Person-Centered Care (PCC) framework as a theoretical framework, initial items were developed by using the existing health literacy environment (HLE) related measurement tools, literature review, qualitative interviews, and the researcher's clinical experience. Second, scale development was based on two rounds of Delphi expert consultation and a pre-test conducted with 20 hospitalized patients. Using 697 hospitalized patients from three sample hospitals, the initial scale was developed after item screening and its reliability and validity were evaluated.

Results

The HLES comprised 30 items classified into three dimensions as follows: interpersonal (11 items), clinical (9 items), and structural (10 items) dimensions. The Cronbach's α coefficient of the HLES was 0.960 and the intra-class correlation coefficient was 0.844. The confirmatory factor analysis verified the three-factor model after allowing for the correlation of five pairs of error terms. The goodness-of-fit indices signified a good fit for the model (χ²/df = 2.766, RMSEA = 0.069, RMR = 0.053, CFI = 0.902, IFI = 0.903, TLI = 0.893, GFI = 0.826, PNFI = 0.781, PCFI = 0.823, PGFI = 0.705). The item-content validity index ranged from 0.91 to 1.00, and the scale-content validity index was 0.90.

Conclusion

The HLES had good reliability and validity and provides a patient perspective tool for evaluating HLE and a new perspective for improving health literacy in China. That is, healthcare organizations make it easier for patients to access, understand, and use health information and service. Further studies about the validity and reliability of HLE should include other districts and different tiers or types of healthcare organizations.

Early Screening of Visual Processing Dysfunctions in Children Born Very or Extremely Preterm

Introduction: Children with early brain damage or dysfunction are at risk of developing cerebral visual impairment (CVI), including visual processing dysfunctions (VPD), which currently remain largely undetected until school age. Our aim was to systematically screen for possible VPD in children born very or extremely preterm from 1 to 2 years corrected age (CA) and to evaluate the effectiveness of early referral. Method: We included N = 48 children born < 30 weeks from 1 year CA. They underwent a two-step VPD screening based on (1) neurological signs indicative of visual brain damage evaluated by neonatologists and/or pediatric neurologist and (2) a functional assessment of visual orienting functions (VOF) with an eye tracking-based test. If at least one of these assessments was abnormal for their age, the children were classified as a risk of VPD and referred to undergo conventional visual diagnostics: ophthalmic exam and visual function assessment (VFA). At 2 years CA, VOF screening was repeated and neurodevelopment was assessed. Results: 18 children (38%) were classified as at risk of VPD at 1 year CA. 7 children had abnormal neurological signs, 5 children had abnormal VOF, and 6 children had both. Subsequent ophthalmic exams (N = 14) showed severe hypermetropia in 21% and strabismus in 14%. VFA (N = 10) showed abnormal visual function and behavior in only 1 child. At 2 years CA, the total group showed an increase in abnormal VOF. Whereas the children at risk showed some normalization, the group without VPD risk at 1 year CA showed deterioration of VOF. Neurodevelopmental outcome did not clearly differ between risk groups. Conclusion: Our findings show a substantial risk of VPD during visual screening (in 38%) at 1 year CA, but relatively few deficits on subsequent conventional ophthalmic exams and VFA. The data suggest that most conventional visual diagnostic methods at this young age are not related to the established VPD risks. VOF assessment should be used complimentary to these methods. The fact that at 2 years CA the number of children with a VPD risk based on abnormal VOF increased argues for more extensive and continuous screening in risk groups, at least until school age.

Translation and cross-cultural adaptation of a Nepali version of the Dutch Participation and Activity Inventory for Children and Youth (PAI - CY) with visual impairment

Background

Visual impairment is an important cause of disability in children. There is a lack of information on rehabilitation needs and low vision support services for children with visual impairment in Nepal. This is a pilot study designed to translate, culturally adapt and pre-test the Dutch version of the Participation and Activity Inventory for Children and Youth (PAI-CY) with visual impairment aged 7–17 years to develop a Nepali version.

Questionnaires (PAI-CY versions for 7–12 and 13–17 years) were translated using standardized methods and were culturally adapted by a panel of experts. They were pretested to evaluate comprehensibility and relevance among six children with visual impairment and blindness. Finally, participants completed a questionnaire evaluation form.

Results

The translation and cultural adaptation process resulted in the adaptation of nine items to make them suitable for Nepali culture. Most children had comprehensibility problems with some specific items because of vocabulary, sentence structure and the composition of items. Most of the children were satisfied with the questionnaires.

Conclusion

The study resulted in the development of a Nepali version of the PAI-CY. We worked with a small group of content experts and a small but representative sample of children which allowed us to use rigorous translation procedures to address language and cultural differences. A population based study has been planned to investigate the psychometric properties of these questionnaires.

A two-step, test-guided Mokken scale analysis, for nonclustered and clustered data

Purpose

Mokken scale analysis (MSA) is an attractive scaling procedure for ordinal data. MSA is frequently used in health-related quality of life research. Two of MSA's prime features are the scalability coefficients and the automated item selection procedure (AISP). The AISP partitions a (large) set of items into scales based on the observed item scores; the resulting scales can be used as measurement instruments. There exist two issues in MSA: First, point estimates, standard errors, and test statistics for scalability coefficients are inappropriate for clustered item scores, which are omnipresent in quality of life research data. Second, the AISP insufficiently takes sampling fluctuation of Mokken’s scalability coefficients into account.

Methods

We solved both issues by providing point estimates and standard errors for the scalability coefficients for clustered data and by implementing a Wald-based significance test in the AISP algorithm, resulting in a test-guided AISP (T-AISP), that is available for both nonclustered and clustered test scores.

Results

We integrated the T-AISP into a two-step, test-guided MSA for scale construction, to guide the analysis for nonclustered and clustered data. The first step is performing a T-AISP and select the final scale(s). For clustered data, within-group dependency is investigated on the final scale(s). In the second step, the strength of the scale(s) is determined and further analyses are performed. The procedure was demonstrated on clustered item scores obtained from administering a questionnaire on quality of life in schools to 639 students nested in 30 classrooms.

Conclusions

We developed a two-step, test-guided MSA for scale construction that takes into account sample fluctuation of all scalability coefficients and that can be applied to item scores obtained by a nonclustered or clustered sampling design.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02840-2.

The Michigan Vision-Related Anxiety Questionnaire: A Psychosocial Outcomes Measure for Inherited Retinal Degenerations

OBJECTIVE

We sought to construct and validate a patient-reported outcome measure for screening and monitoring vision-related anxiety in patients with inherited retinal degenerations.

DESIGN

Item-response theory and graded response modeling to quantitatively validate questionnaire items generated from qualitative interviews and patient feedback.

METHODS

Patients at the Kellogg Eye Center (University of Michigan, Ann Arbor, Michigan, USA) with a clinical diagnosis of an inherited retinal degeneration (n = 128) participated in an interviewer-administered questionnaire. The questionnaire consisted of 166 items, 26 of which pertained to concepts of "worry" and "anxiety." The subset of vision-related anxiety questions was analyzed by a graded response model using the Cai Metropolis-Hastings Robbins-Monro algorithm in the R software mirt package. Item reduction was performed based on item fit, item information, and item discriminability. To assess test-retest variability, 25 participants completed the questionnaire a second time 4 to 16 days later.

RESULTS

The final questionnaire consisted of 14 items divided into 2 unidimensional domains: rod function anxiety and cone function anxiety. The questionnaire exhibited convergent validity with the Patient Health Questionnaire for symptoms of depression and anxiety. This vision-related anxiety questionnaire has high marginal reliability (0.81 for rod-function anxiety, 0.83 for cone-function anxiety) and exhibits minimal test-retest variability (ρ = 0.81 [0.64-0.91] for rod-function anxiety and ρ = 0.83 [0.68-0.92] for cone-function anxiety).

CONCLUSIONS

The Michigan Vision-Related Anxiety Questionnaire is a psychometrically validated 14-item patient-reported outcome measure to be used as a psychosocial screening and monitoring tool for patients with inherited retinal degenerations. It can be used in therapeutic clinical trials for measuring the benefit of an investigational therapy on a patient's vision-related anxiety.

The Michigan Retinal Degeneration Questionnaire: A Patient-Reported Outcome Instrument for Inherited Retinal Degenerations

PURPOSE

To create a psychometrically validated patient-reported outcome measure for inherited retinal degenerations.

DESIGN

Qualitative and quantitative patient-reported outcome (PROs) questionnaire development using item response theory validation.

METHODS

One hundred twenty-eight patients with a diagnosis of an inherited retinal degeneration at the Kellogg Eye Center (University of Michigan) were recruited and administered a 166-item questionnaire comprising 7 expert-defined domains. The questionnaire was re-administered 4-16 days later to a subset of 25 participants to assess test-retest variability. Graded response models were fit by Cai's Metropolis-Hastings Robbins-Monro algorithm using the R (version 3.6.3) package mirt. Model data were fit to assess questionnaire dimensionality, to estimate item information, and to score participants. Poorly functioning items were removed, and the model was refit to create the final questionnaire.

RESULTS

The psychometrically validated PROs measure was reduced to a 59-item questionnaire measuring 7 unidimesnional domains: central vision, color vision, contrast sensitivity, scotopic function, photopic peripheral vision, mesopic peripheral vision, and photosensitivity. A total of 39 items were removed because of poor factor loading, low item information, poor person-ability differentiation, or high item-level interdependence. This novel questionnaire produces a reliable domain score for person ability that does not show significant test-retest variability across repeated administration.

CONCLUSIONS

The final PRO questionnaire, known as the Michigan Retinal Degeneration Questionnaire, is psychometrically validated and available for use in the evaluation of patients with inherited retinal degenerations.

First stage psychometric testing of a new instrument for adolescents with visual impairment: the Participation and Activity Inventory for Children and Youth (PAI-CY) 13-17 years

BACKGROUND

To assess participation of children with visual impairment, the Participation and Activity Inventory for Children and Youth (PAI-CY) was recently developed. This study assessed some initial psychometric properties of the PAI-CY 13-17 years version, and investigated its feasibility.

METHODS

Adolescents with visual impairment and their parents (n = 72 dyads) completed the self-report and proxy-report version of the 58-item PAI-CY, an evaluation form and several questionnaires measuring related constructs. Item deletion was informed by item responses, inter-item correlations, test-retest reliability, adolescent-parent agreement and participants' feedback. Known-group validity and concurrent validity with related questionnaires were investigated for the final item-set.

RESULTS

Twelve items had > 20% missing values, whereas 39 items showed floor effects. Eight item pairs showed high inter-item correlations. Test-retest reliability was acceptable for most items (kappa ≥0.4). Evaluation forms showed that over 90% of respondents was neutral to very positive regarding several feasibility aspects such as administration time and comprehensiveness. Adolescent-parent agreement was mostly low. These results informed the deletion of three items. Known-group validity seemed adequate since PAI-CY scores were significantly worse for participants with comorbidity compared to those without. A trend towards worse scores for participants with more severe visual impairment was also observed. Correlations between the PAI-CY and related questionnaires confirmed concurrent validity.

CONCLUSIONS

Initial psychometric properties of the PAI-CY 13-17 were acceptable, although more work is needed to assess other psychometric properties, such as the underlying construct. Following implementation in low vision care to assess participation needs, enabling larger samples, acceptability of the PAI-CY 13-17 to end-users should be carefully monitored, especially if alterations are made based on the current study.

Network Analysis of the Participation and Activity Inventory for Children and Youth (PAI-CY) 7-12 Years with Visual Impairment

Purpose

Children with visual impairment often experience more difficulties regarding participation compared to sighted peers. The Participation and Activity Inventory for Children and Youth (PAI-CY) has recently been developed to assess their participation needs. A novel application in the field of questionnaires is the use of network analysis to explore interrelations between items in order to capture their complex interactions as a reflection of the overall construct of measurement. This study aimed to apply network modeling for the PAI-CY 7–12 from the perspectives of children and their parents.

Methods

Children and their parents (n = 195) completed the 55-item PAI-CY via face-to-face interviews and a web-based survey, respectively. Internal consistency, test-retest reliability, and concordance between children and parents were investigated. Two networks were created, along with visualizations of shared and differential connections between children and parents.

Results

Eight items were deleted. Network structures were dissimilar; for children, connections evolved around social contacts and school items, whereas for parents, mobility, leisure time, acceptance, self-reliance, and communication items prevailed. In the children's network, playing imaginary games, inviting a friend to play at home, and estimating the distance from others were most connected to other items.

Conclusions

This study uniquely identifies connections between items of the PAI-CY 7–12, highlighting the different perspectives parents and children have on what defines participation, possibly implying that they perceive the relevance of various rehabilitation programs differently.

Translational Relevance

Rehabilitation programs aimed at improving the most connected items might positively affect other items in the network, possibly improving children's participation.

Early intervention for children at risk of visual processing dysfunctions from 1 year of age: a randomized controlled trial protocol

Background

An increasing number of children are suffering from brain damage-related visual processing dysfunctions (VPD). There is currently a lack of evidence-based intervention methods that can be used early in development. We developed a visual intervention protocol suitable from 1 year of age. The protocol is structured, comprehensive and individually adaptive, and is paired with quantitative outcome assessments. Our aim is to investigate the effectiveness of this first visual intervention program for young children with (a risk of) VPD.

Methods

This is a single-blind, placebo-controlled trial that is embedded within standard clinical care. The study population consists of 100 children born very or extremely preterm (< 30 weeks) at 1 year of corrected age (CA), of whom 50% are expected to have VPD. First, children undergo a visual screening at 1 year CA. If they are classified as being at risk of VPD, they are referred to standard care, which involves an ophthalmic and visual function assessment and a (newly developed) visual intervention program. This program consists of a general protocol (standardized and similar for all children) and a supplement protocol (adapted to the specific needs of the child). Children are randomly allocated to an intervention group (starting upon inclusion at 1 year CA) or a control group (postponed: starting at 2 years CA). The control group will receive a placebo treatment. The effectiveness of early visual intervention will be examined with follow-up visual and neurocognitive assessments after 1 year (upon completion of the direct intervention) and after 2 years (upon completion of the postponed intervention).

Discussion

Through this randomized controlled trial we will establish the effectiveness of a new and early visual intervention program. Combining a general and supplement protocol enables both structured comparisons between participants and groups, and custom habilitation that is tailored to a child’s specific needs. The design ensures that all included children will benefit from participation by advancing the age at which they start receiving an intervention. We expect results to be applicable to the overall population of children with (a risk of) VPD early in life.

Trial registration

Netherlands Trial Register: NTR6952. Registered 19 January 2018.