Item selection in self-report measures for children and adolescents with disabilities: lessons from cognitive interviews

Different perceptual worlds: Parent and youth perspectives on parenting outcome trajectories from a Latino family-based program

Discrepancies between parent and youth perceptions of their relationship are a common aspect of generational acculturation gaps influencing immigrant families. Programs designed to strengthen parenting practices among immigrant Latino families commonly address immigration stresses, including differences between parent and youth perceptions, but little is known about discrepancies in their appraisals of program effects on parenting behavior. A randomized trial was conducted examining effects on parent behavior of a program for immigrant families with youth aged 10-14, developed through community-based participatory research principles. Families (346 parents and youth) were recruited by organizations serving Latino families in a Midwestern metropolitan area and randomly assigned to the eight-session psychoeducation and skill-building program or a waitlist control. Parents and youth completed self-report measures at pre-intervention, post-intervention (4 months), and a 6-month follow-up regarding parents' expression of acceptance, efforts to solicit information about the child's experiences, and consistency of discipline, key foci of the program. Based on social cognition theory, the study focused on possible differences in parents' and youths' perceptions of change in parenting behavior. Parents in the treatment group reported pre-post improved acceptance, consistent discipline, and solicitation, whereas youth reported improvement only in parental solicitation, a pattern maintained at follow-up. In the control group, the only change was youth-reported reduction in parental acceptance. Parents' perceptions of improvement are encouraging, but overall lack of improvements from the youth perspective poses a potential problem for impact on parent-child relations. Interventions may need to target both parent and youth cognitions about behavior changes directly.

Determining at What Age Children Provide Sound Self-Reports: An Illustration of the Validity-Index Approach

In psychological assessment of children, it is pivotal to establish from what age on self-reports can complement or replace informant reports. We introduce a psychometric approach to estimate the minimum age for a child to produce self-report data that is of similar quality as informant data. The approach makes use of statistical validity indicators such as person-fit and long-string indices, and can be readily applied to data commonly collected in psychometric studies of child measures. We evaluate and illustrate the approach, using self-report and informant-report data of the PedsQL, a pediatric health-related quality of life measure, from 651 child-mother pairs. To evaluate the approach, we tested various hypotheses about the validity of the self-report data, using the Gnp person-fit index as the validity indicator and the mother informant-data as a benchmark for validity. Results showed that Gnp discriminated between self-reports of younger and older children, between self-reports of children that completed the PedsQL alone or with a parent, and between self-reports and informant reports. We conclude that the validity-index approach has good potential for future applications. Future research should further evaluate the approach for different types of questionnaires (e.g., personality inventories) and using different validity indices (e.g., response-bias indices).

Patient-reported outcome measures for young people with developmental disabilities: incorporation of design features to reduce cognitive demands

Use of patient-reported outcome measures (PROMs) may increase the involvement of young people with developmental disabilities in their healthcare decisions and healthcare-related research. Young people with developmental disabilities may have difficulty completing PROMs because of extraneous assessment demands that require additional cognitive processes. However, PROM design features may mitigate the impact of these demands. We identified and evaluated six pediatric PROMs of self-care and domestic life tasks for the incorporation of suggested design features that can reduce cognitive demands. PROMs incorporated an average of 6 out of 11 content, 7 out of 14 layout, and 2 out of 9 administration features. This critical review identified two primary gaps in PROM design: (1) examples and visuals were not optimized to reduce cognitive demands; and (2) administration features that support young people's motivation and self-efficacy and reduce frustration were underutilized. Because assessment demands impact the validity of PROMs, clinicians should prospectively consider the impact of these demands when selecting PROMs and interpreting scores.

WHAT THIS PAPER ADDS

Patient-reported outcome measure (PROM) design features can reduce assessment demands related to cognitive processes. Pediatric PROMs underutilize design features that decrease cognitive demands of self-reporting.

Refining the Pediatric Evaluation of Disability Inventory-Patient-Reported Outcome (PEDI-PRO) item candidates: interpretation of a self-reported outcome measure of functional performance by young people with neurodevelopmental disabilities

AIM

This study examined the item interpretability and rating scale use of the Pediatric Evaluation of Disability Inventory-Patient-Reported Outcome (PEDI-PRO) by young people with developmental disabilities. The PEDI-PRO assesses the functional performance of discrete functional tasks in the context of everyday life situations.

METHOD

A two-phase cognitive interview design was implemented with a convenience sample of 37 young people (mean age 19y, SD 2y 5mo; 13 males and 24 females; 68% with intellectual disability) with developmental disabilities. In phase I, 182 item candidates were each reviewed by an average of four young people. In phase II, 103 items were carried forward or revised and each reviewed by an average of seven additional young people. Two raters coded responses for intended item interpretation and performance quality; codes were analysed using descriptive statistics. Qualitative analysis explored young people's self-evaluation process.

RESULTS

Items were interpreted as intended by most young people (mean 86%). Young people can use PEDI-PRO response categories appropriately to describe their performance: 94% of positive performance descriptions coincided with a positive response category choice; 73% of negative descriptions coincided with a negative response category choice. Young people interpreted items in a literal manner, and their self-evaluation incorporated the use of supports that facilitate functional performance.

INTERPRETATION

The PEDI-PRO's measurement framework appears to support the self-evaluation of functional performance of young people with developmental disabilities.

Reducing Barriers to Patient-Reported Outcome Measures for People With Cognitive Impairments

The field of rehabilitation has increasingly called for the use of patient-reported outcome measures (PROMs) in research and practice. Given that many rehabilitation patients present with conditions associated with cognitive impairments, it is imperative to reduce barriers to PROM use for this population. The purpose of this article is to develop a comprehensive understanding of cognitive accessibility that can prospectively inform the design of PROMs. We put forth the following definition of cognitive accessibility for PROMs: cognitive accessibility is present when assessment design anticipates respondent variability in cognitive abilities and, to the greatest extent possible, reduces cognitive demands and/or supports cognitive processes to enable respondents with a range of cognitive abilities to interpret and respond to assessment items as intended. Our operationalization of cognitive accessibility in measurement in the field of rehabilitation is informed by 2 assumptions: (1) cognitive accessibility results from an interaction between the individual's capacities and the demands of the assessment and assessment context, and (2) individuals with cognitive impairments have the right to be involved in decisions about their lives, including health care decisions. This article proposes 3 design features that can be optimized for cognitive accessibility: content, layout, and administration procedures. We end with a discussion of next steps that the field of rehabilitation measurement can undertake to advance our understanding of cognitive accessibility.

Symptoms and quality of life indicators among children with chronic medical conditions

BACKGROUND

Children with chronic conditions often experience numerous symptoms, but few research studies examine patterns of symptoms and quality of life (QoL) indicators.

OBJECTIVE

To examine if reliable latent classes of children with chronic medical conditions can be identified based on the clustering of symptoms and QoL indicators.

METHODS

Structured interviews were conducted with children ages 9-21 living with chronic medical conditions (N = 90). Multiple symptoms (e.g., pain, sleep, fatigue, and depression) and QoL indicators (e.g., life satisfaction and social support) were measured. Physical health and emotional, social, and school functioning were measured using the Pediatric Quality of Life Inventory (PedsQL). Latent class analysis was used to classify each child into a latent class whose members report similar patterns of responses.

RESULTS

A three-class solution had the best model fit. Class 1 (high-symptom group; n = 15, 16.7%) reported the most problems with symptoms and the lowest scores on the QoL indicators. Class 2 (moderate-symptom group; n = 39, 43.3%) reported moderate levels of both symptoms and QoL indicators. Class 3 (low-symptom group; n = 36, 40.0%) reported the lowest levels of symptoms and the highest scores on the QoL indicators.

CONCLUSIONS

The three latent classes identified in this study were distributed along the severity continuum. All symptoms and QoL indicators appeared to move in the same direction (e.g., worse symptoms with lower QoL). The PedsQL psychosocial health summary score (combining emotional, social, and school functioning scores) discriminated well between children with different levels of disease burden.