Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ-CAT

PURPOSE

The animated activity questionnaire (AAQ) is a computer-based measure of activity limitations. To answer a question, patients choose the animation of a person performing an activity that matches their own level of limitation. The AAQ has not yet been tested for suitability to be applied as computer-adaptive test (CAT). Thus, the objective of this study was to develop and evaluate an AAQ-based CAT to facilitate the application of the AAQ in daily clinical care.

METHODS

Patients (n = 1408) with hip/knee osteoarthritis from Brazil, Denmark, France, The Netherlands, Norway, Spain, and the UK responded to all 17 AAQ items. Assumptions of item-response theory (IRT) modelling were investigated. To establish item parameters for the CAT, a graded response model was estimated. To evaluate the performance of post-hoc simulated AAQ-based CATs, precision, test length, and construct validity (correlations with well-established measures of activity limitations) were evaluated.

RESULTS

Unidimensionality (CFI = 0.95), measurement invariance (R²-change < 2%), and IRT item fit (S-X² p > .003) of the AAQ were supported. Performing simulated CATs, the mean test length was more than halved (≤ 8 items), while the range of precise measurement (standard error ≤ 0.3) was comparable to the full AAQ. The correlations between original AAQ scores and three AAQ-CAT versions were ≥ 0.95. Correlations of AAQ-CAT scores with patient-reported and performance measures of activity limitations were ≥ 0.60.

CONCLUSION

The almost non-verbal AAQ-CAT is an innovative and efficient tool in patients with hip/knee osteoarthritis from various countries, measuring activity limitations with lower respondent burden, but similar precision and construct validity compared to the full AAQ.

Development of an EORTC Item Bank for Computer-Adaptive Testing of Nausea and Vomiting

OBJECTIVES

Nausea and vomiting (NV) remain common cancer symptoms and frequent side effects of anticancer therapies despite available antiemetics. They can lead to treatment disruption and discontinuation. NV is an important patient reported outcome in oncology. This study aimed to build an item bank for computer-adaptive testing (CAT) based on NV questions in the European Organisation for Research for Treatment of Cancer, Quality of Life for Cancer Patients (EORTC QLQ-C30) questionnaire and complete the first three phases of development as described in the EORTC Quality of Life Group guidelines.

DATA SOURCES

The development followed a standard procedure. The three phases include conceptualization and literature search (phase 1); item classification, selection, formulation and rating, and expert evaluations (phase 2); and patient pretesting (phase 3). The literature search resulted in a preliminary list of 115 items. Following classification, formulation, and rating, 21 candidate items adhered to the QLQ-C30 format. Evaluation by experts (n = 11) from five countries and patients (n = 31) pretesting in Denmark, Poland, and the UK lead to a final list of 20 items.

CONCLUSION

The selection, development, and refining of NV items have been described. The nature of this testing ensures an initial CAT item bank that after field testing (phase 4) and psychometric analysis is expected to provide a precise and efficient NV measurement while still being comparable to the original QLQ-C30 scale.

IMPLICATIONS FOR NURSING PRACTICE

Access to reliable tools that facilitate NV comprehensive assessment is an important issue for nurses caring for patients with cancer. This CAT item bank is meant to support clinical decisions when all phases of testing are completed.

Patient-Reported Outcome Measurement Information System (PROMIS) in Orthopaedic Trauma Research

This review describes the development, advantages and disadvantages, and applications of the Patient-Reported Outcome Measurement Information System (PROMIS) in orthopaedic trauma. PROMIS is a useful tool for quantifying outcomes in orthopedic trauma. It allows measurement of outcomes across multiple domains while minimizing administration time. PROMIS also reliably identifies clinical, social, and psychological risk factors for poor outcomes across a variety of orthopaedic injuries and disease states. However, PROMIS lacks specificity for certain anatomic regions and validation for mental health outcomes. It also is limited by ceiling effects in certain active patient populations. Orthopaedic traumatologists should be familiar with PROMIS, as its use is increasing and it is a valuable tool that can aid in clinical decision making.

Measuring Quality and Outcomes in Sports Medicine

Patient-reported outcome measures (PROMs) are objective metrics critical to evaluating outcomes throughout orthopedic surgery. New instruments continue to emerge, increasing the breadth of information required for those intending to use these measures for research or clinical care. Although earlier metrics were developed using the principles of classic test theory, newer instruments constructed using item response theory are amenable to computer-adaptive testing and may change the way these instruments are administered. This article aims to define the psychometric properties that are important to understand when using all PROMs and to review the most widely used instruments in sports medicine.

Predictors of health-related quality of life in chronically ill children and adolescents over time

OBJECTIVE

This study aims at identifying predictors of generic health-related quality of life (HRQoL) in chronically ill children and adolescents over time. The newly developed computer-adaptive test Kids-CAT was used to assess five dimensions of HRQoL.

METHODS

Longitudinal data from the Kids-CAT study on children and adolescents with asthma, diabetes and juvenile arthritis (n = 248; aged 7-17 years) were assessed at three measurement points over six months. Individual growth modeling served to investigate effects of sociodemographic, disease- and health-related as well as psychosocial factors on HRQoL dimensions Physical Well-Being (WB), Psychological WB, Parent Relations, Social Support & Peers, and School WB over time.

RESULTS

Besides effects of sociodemographic variables on HRQoL dimensions Social Support & Peers as well as School WB, we found that a longer duration of the disease was associated with better Physical WB. Lower scores were found for patients with juvenile arthritis compared to those with diabetes in HRQoL dimensions Physical WB and Social Support & Peers. Disease control was positively related to Physical and Psychological WB over time. Mental health problems were negatively associated with four, and subjective health complaints with all five HRQoL dimensions over time. Parental mental health was positively related to the patients' HRQoL score in Parent Relations over time.

CONCLUSIONS

HRQoL as a multidimensional construct is associated with a wide range of different factors. Pediatricians should consider potential mental health problems and subjective health complaints in their patients. Finally, parental HRQoL can affect HRQoL in chronically ill children and adolescents.

Adjusting for cross-cultural differences in computer-adaptive tests of quality of life

PURPOSE

Previous studies using the WHOQOL measures have demonstrated that the relationship between individual items and the underlying quality of life (QoL) construct may differ between cultures. If unaccounted for, these differing relationships can lead to measurement bias which, in turn, can undermine the reliability of results.

METHODS

We used item response theory (IRT) to assess differential item functioning (DIF) in WHOQOL data from diverse language versions collected in UK, Zimbabwe, Russia, and India (total N = 1332). Data were fitted to the partial credit 'Rasch' model. We used four item banks previously derived from the WHOQOL-100 measure, which provided excellent measurement for physical, psychological, social, and environmental quality of life domains (40 items overall). Cross-cultural differential item functioning was assessed using analysis of variance for item residuals and post hoc Tukey tests. Simulated computer-adaptive tests (CATs) were conducted to assess the efficiency and precision of the four items banks.

RESULTS

Splitting item parameters by DIF results in four linked item banks without DIF or other breaches of IRT model assumptions. Simulated CATs were more precise and efficient than longer paper-based alternatives.

DISCUSSION

Assessing differential item functioning using item response theory can identify measurement invariance between cultures which, if uncontrolled, may undermine accurate comparisons in computer-adaptive testing assessments of QoL. We demonstrate how compensating for DIF using item anchoring allowed data from all four countries to be compared on a common metric, thus facilitating assessments which were both sensitive to cultural nuance and comparable between countries.

The validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design, methods and first results of the Kids-CAT study

PURPOSE

Recently, we developed a computer-adaptive test (CAT) for assessing health-related quality of life (HRQoL) in children and adolescents: the Kids-CAT. It measures five generic HRQoL dimensions. The aims of this article were (1) to present the study design and (2) to investigate its psychometric properties in a clinical setting.

METHODS

The Kids-CAT study is a longitudinal prospective study with eight measurements over one year at two University Medical Centers in Germany. For validating the Kids-CAT, 270 consecutive 7- to 17-year-old patients with asthma (n = 52), diabetes (n = 182) or juvenile arthritis (n = 36) answered well-established HRQoL instruments (Pediatric Quality of Life Inventory™ (PedsQL), KIDSCREEN-27) and scales measuring related constructs (e.g., social support, self-efficacy). Measurement precision, test-retest reliability, convergent and discriminant validity were investigated.

RESULTS

The mean standard error of measurement ranged between .38 and .49 for the five dimensions, which equals a reliability between .86 and .76, respectively. The Kids-CAT measured most reliably in the lower HRQoL range. Convergent validity was supported by moderate to high correlations of the Kids-CAT dimensions with corresponding PedsQL dimensions ranging between .52 and .72. A lower correlation was found between the social dimensions of both instruments. Discriminant validity was confirmed by lower correlations with non-corresponding subscales of the PedsQL.

CONCLUSIONS

The Kids-CAT measures pediatric HRQoL reliably, particularly in lower areas of HRQoL. Its test-retest reliability should be re-investigated in future studies. The validity of the instrument was demonstrated. Overall, results suggest that the Kids-CAT is a promising candidate for detecting psychosocial needs in chronically ill children.