The validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design, methods and first results of the Kids-CAT study

Computerized adaptive testing to screen pre-school children for emotional and behavioral problems

Questionnaires to detect emotional and behavioral (EB) problems in preventive child healthcare (PCH) should be short; this potentially affects their validity and reliability. Computerized adaptive testing (CAT) could overcome this weakness. The aim of this study was to (1) develop a CAT to measure EB problems among pre-school children and (2) assess the efficiency and validity of this CAT. We used a Dutch national dataset obtained from parents of pre-school children undergoing a well-child care assessment by PCH (n = 2192, response 70%). Data regarded 197 items on EB problems, based on four questionnaires, the Strengths and Difficulties Questionnaire (SDQ), the Child Behavior Checklist (CBCL), the Ages and Stages Questionnaire: Social Emotional (ASQ:SE), and the Brief Infant-Toddler Social and Emotional Assessment (BITSEA). Using 80% of the sample, we calculated item parameters necessary for a CAT and defined a cutoff for EB problems. With the remaining part of the sample, we used simulation techniques to determine the validity and efficiency of this CAT, using as criterion a total clinical score on the CBCL. Item criteria were met by 193 items. This CAT needed, on average, 16 items to identify children with EB problems. Sensitivity and specificity compared to a clinical score on the CBCL were 0.89 and 0.91, respectively, for total problems; 0.80 and 0.93 for emotional problems; and 0.94 and 0.91 for behavioral problems.    Conclusion: A CAT is very promising for the identification of EB problems in pre-school children, as it seems to yield an efficient, yet high-quality identification. This conclusion should be confirmed by real-life administration of this CAT. What is Known: • Studies indicate the validity of using computerized adaptive test (CAT) applications to identify emotional and behavioral problems in school-aged children. • Evidence is as yet limited on whether CAT applications can also be used with pre-school children. What is New: • The results of this study show that a computerized adaptive test is very promising for the identification of emotional and behavior problems in pre-school children, as it appears to yield an efficient and high-quality identification.

Using Self-Regulation Assessment to Explore Associations between Self-Regulation, Participation and Health-Related Quality of Life in a Rehabilitation Population

OBJECTIVE

Self-regulation, participation and health-related quality of life are important rehabilitation outcomes. The aim of this study was to explore associations between these outcomes in a multi-diagnostic and heterogenic group of former rehabilitation patients.

METHODS

This cross-sectional survey used the Self-Regulation Assessment (SeRA), Utrecht Scale for Evaluation of Rehabilitation-participation (USERParticipation) and the Patient-Reported-Outcome-Measurement-System (PROMIS) ability and PROMIS satisfaction with participation in social roles, and the EuroQol-5L-5D and PROMIS-10 Global Health. Regression analyses, controlling for demographic and condition-related factors, were performed.

RESULTS

Respondents (n = 563) had a mean age of 56.5 (standard deviation (SD) 12.7) years. The largest diagnostic groups were chronic pain disorder and brain injury. In addition to demographic and condition-related factors, self-regulation subscales explained 0-15% of the variance in participation outcome scores, and 0-22% of the variance in HRQoL outcome scores. Self-regulation subscales explained up to 22% of the variance in satisfaction subscales of participation (USER-Participation and PROMIS) and the mental health subscale of the PROMIS-10. Self-regulation subscales explained up to 11% of the restriction and frequency subscales of participation (USER-Participation) and the physical health subscale of the PROMIS-10.

CONCLUSION

Self-regulation is more strongly associated with outcomes such as satisfaction with participation and mental health compared with outcomes such as restrictions in participation and physical health.

Psychometric Performance of a Condition-Specific Quality-of-Life Instrument for Dutch Children Born with Esophageal Atresia

A condition-specific instrument (EA-QOL©) to assess quality of life of children born with esophageal atresia (EA) was developed in Sweden and Germany. Before implementing this in the Netherlands, we evaluated its psychometric performance in Dutch children. After Swedish−Dutch translation, cognitive debriefing was conducted with a subset of EA patients and their parents. Next, feasibility, reliability, and validity were evaluated in a nationwide field test. Cognitive debriefing confirmed the predefined concepts, although some questions were not generally applicable. Feasibility was poor to moderate. In 2-to-7-year-old children, 8/17 items had >5% missing values. In 8-to-17-year-old children, this concerned 3/24 items of the proxy-report and 5/14 items of the self-report. The internal reliability was good. The retest reliability showed good correlation. The comparison reliability between self-reports and proxy-reports was strong. The construct validity was discriminative. The convergent validity was strong for the 2-to-7-year-old proxy-report, and weak to moderate for the 8-to-17-year-old proxy-report and self-report. In conclusion, the Dutch-translated EA-QOL questionnaires showed good reliability and validity. Feasibility was likely affected by items not deemed applicable to an individual child’s situation. Computer adaptive testing could be a potential solution to customizing the questionnaire to the individual patient. Furthermore, cross-cultural validation studies and implementation-evaluation studies in different countries are needed.

Results and Quality of Life after Implantation of Active Middle Ear Implants

The provision of implantable hearing aids represents an area with high development and innovation potential. On the one hand, this review article provides an overview of current indication criteria for the treatment with active middle ear implants. On the other hand, outcome parameters as well as functional results after implantation of active middle ear implants are demonstrated and discussed. The focus is mainly placed on audiological results as well as the subjective health status. "Patient Reported Outcome Measures" (PROMs) have become an integral part of the evaluation of hearing implant treatment. Due to low evidence level criteria, the study situation regarding audiological as well as subjective outcome parameters is not satisfactory. The lack of an international consensus on accepted outcome parameters makes a meta-analytical analysis of results immensely difficult. In the studies published to date, patients with sensorineural hearing loss and patients with conductive or mixed hearing loss offered better speech recognition after implantation of an active middle ear implant compared to conventional hearing aids. Current analyses show a significant improvement in general as well as hearing-specific quality of life after implantation of an active middle ear implant. To date, no validated, hearing-specific quality-of-life measurement instruments exist for assessing the success of fitting in children. Especially in children with complex malformations of the outer ear and the middle ear, excellent audiological results were shown. However, these results need to be substantiated by quality-of-life measurements in future.

Mental health and well-being from childhood to adulthood: design, methods and results of the 11-year follow-up of the BELLA study

Mental health and well-being are of great interest in health policy and research. Longitudinal surveys are needed to provide solid population-based data. We describe the design and methods of an 11-year follow-up of the German BELLA study in children, adolescents and young adults, and we report on age- and gender-specific courses of general health and well-being, long-term health-related outcomes of mental health problems, and mental health care use. The BELLA study is the module on mental health and well-being within the German Health Interview and Examination Survey for Children and Adolescents (KiGGS). Standardised measures were used at each of the five measurement points of the BELLA study. In the 11-year follow-up, young people aged 7-31 years participated (n = 3492). Individual growth modelling, linear regression and descriptive analyses were conducted. Self-reported general health and well-being were both better in younger (vs. older) and in male (vs. female) participants according to the data from all five measurement points. Mental health problems in childhood and adolescence (measured at baseline) predicted impaired health outcomes at 6-year and 11-year follow-ups. Approximately one out of four children with a diagnosed mental disorder was not undergoing mental health treatment. With its 11-year follow-up, the prospective longitudinal BELLA study provides new and solid data on mental health and well-being from childhood to adulthood in Germany, and these data are important for health promotion and prevention practices. These results are consistent with previous findings. Promising future analyses are planned.

Quality of Life in Romanian Children with Type 1 Diabetes: A Cross-Sectional Survey Using an Interdisciplinary Healthcare Intervention

Background: The purpose of this study was to assess the quality of life in Romanian type 1 diabetes mellitus (T1DM) children attending an early interdisciplinary healthcare intervention. Hypothesis: engaging T1DM children in leisure sports leads to a better quality of life. Methods: This research embeds a cross-sectional observational study, incorporating some clinical characteristics relevant for diabetes management. The Kidscreen 27 questionnaire was issued to 100 T1DM children aged between 7 and 17 years. Parents completed the questionnaire. All subjects received interdisciplinary healthcare in the previous year. Statistics were performed using SPSS, v20. The required sample size of 100 subjects was obtained with a confidence interval of 95% and a sampling error of 0.009. The tests were two-sided, with a type I error set at 0.05. Results: Subjects reached an increased level of physical well-being, psychological well-being, autonomy, parent relationships, peer and social support, and school inclusion. There was a significant difference (p < 0.05) between children who practice leisure activities and children who only participated in physical education (PE) classes, regarding their physical well-being (t = 2.123). ANOVA demonstrated significant differences between age groups regarding physical well-being. Conclusion: The interdisciplinary healthcare intervention increased the efficiency of T1DM management with positive effects on life quality.

Computerized Adaptive Tests: Efficient and Precise Assessment of the Patient-Centered Impact of Diabetic Retinopathy

Purpose

Evaluate efficiency, precision, and validity of RetCAT, which comprises ten diabetic retinopathy (DR) quality of life (QoL) computerized adaptive tests (CATs).

Methods

In this cross-sectional clinical study, 183 English and/or Mandarin-speaking participants with DR (mean age ± standard deviation [SD] 56.4 ± 11.9 years; 38% proliferative DR [worse eye]) were recruited from retinal clinics in Singapore. Participants answered the RetCAT tests (Symptoms, Activity Limitation, Mobility, Emotional, Health Concerns, Social, Convenience, Economic, Driving, and Lighting), which were capped at seven items each, and other questionnaires, and underwent eye tests. Our primary evaluation focused on RetCAT efficiency (i.e. standard error of measurement [SEM] ± SD achieved and time needed to complete each CAT). Secondary evaluations included an assessment of RetCAT's test precision and validity.

Results

Mean SEM across all RetCAT tests was 0.351, ranging from 0.272 ± 0.130 for Economic to 0.484 ± 0.130 for Emotional. Four tests (Mobility, Social, Convenience, and Driving) had a high level of measurement error. The median time to take each RetCAT test was 1.79 minutes, ranging from 1.12 (IQR [interquartile range] 1.63) for Driving to 3.28 (IQR 2.52) for Activity Limitation. Test precision was highest for participants at the most impaired end of the spectrum. Most RetCAT tests displayed expected correlations with other scales (convergent/divergent validity) and were sensitive to DR and/or vision impairment severity levels (criterion validity).

Conclusions

RetCAT can provide efficient, precise, and valid measurement of DR-related QoL impact. Future application of RetCAT will employ a stopping rule based on SE rather than number of items to ensure that all tests can detect meaningful differences in person abilities. Responsiveness of RetCAT to treatment interventions must also be determined.

Translational Relevance

RetCAT may be useful for measuring the patient-centered impact of DR severity and disease progression and evaluating the effectiveness of new therapies.

Computerized adaptive testing to screen children for emotional and behavioral problems by preventive child healthcare

Background

Questionnaires to detect emotional and behavioral problems (EBP) in Preventive Child Healthcare (PCH) should be short which potentially affects validity and reliability. Simulation studies have shown that Computerized Adaptive Testing (CAT) could overcome these weaknesses. We studied the applicability (using the measures participation rate, satisfaction, and efficiency) and the validity of CAT in routine PCH practice.

Methods

We analyzed data on 461 children aged 10–11 years (response 41%), who were assessed during routine well-child examinations by PCH professionals. Before the visit, parents completed the CAT and the Child Behavior Checklist (CBCL). Satisfaction was measured by parent- and PCH professional-report. Efficiency of the CAT procedure was measured as number of items needed to assess whether a child has serious problems or not. Its validity was assessed using the CBCL as the criterion.

Results

Parents and PCH professionals rated the CAT on average as good. The procedure required at average 16 items to assess whether a child has serious problems or not. Agreement of scores on the CAT scales with corresponding CBCL scales was high (range of Spearman correlations 0.59–0.72). Area Under Curves (AUC) were high (range: 0.95–0.97) for the Psycat total, externalizing, and hyperactivity scales using corresponding CBCL scale scores as criterion. For the Psycat internalizing scale the AUC was somewhat lower but still high (0.86).

Conclusions

CAT is a valid procedure for the identification of emotional and behavioral problems in children aged 10–11 years. It may support the efficient and accurate identification of children with overall, and potentially also specific, emotional and behavioral problems in routine PCH.

[Health-related quality of life and its relation to chronic diseases and mental health problems among children and adolescents : Results from KiGGS Wave 2]

BACKGROUND

Health-related quality of life (HRQoL) is increasingly established as an indicator for the subjective health of children and adolescents. The aim of this study was to describe the current HRQoL among children and adolescents in Germany aged between 11 and 17 years taking into account common chronic diseases (bronchial asthma, atopic dermatitis, obesity, ADHD) and mental health problems.

METHODS

The analysis is based on information obtained from 6,599 children and adolescents (51.9% girls; 48.1% boys) from KiGGS Wave 2 (2014-2017). HRQoL was measured with the multidimensional KIDSCREEN-27. The chronic diseases and mental health problems under investigation were assessed by several indicators.

RESULTS

Differences in HRQoL could be found as a function of age and gender. The HRQoL among girls was lower at an older age across all dimensions. These age-related differences are less pronounced among boys. The HRQoL of children and adolescents with chronic diseases and mental health problems was lower compared to their healthy peer groups. The comparison of the investigated chronic diseases and mental health problems revealed significant differences. Particularly, HRQoL was lower for children and adolescents with obesity and mental health problems.

DISCUSSION

The distinction of several dimensions of HRQoL allows a comprehensive understanding of age- and gender-related effects and provides a detailed assessment of the impact of chronic diseases and mental health problems. The present findings underline the importance of HRQoL as an indicator for the subjective health of children and adolescents.

Stopping Rules for Computer Adaptive Testing When Item Banks Have Nonuniform Information

The standard error (SE) stopping rule, which terminates a computer adaptive test (CAT) when the SE is less than a threshold, is effective when there are informative questions for all trait levels. However, in domains such as patient reported outcomes, the items in a bank might all target one end of the trait continuum (e.g., negative symptoms), and the bank may lack depth for many individuals. In such cases, the predicted standard error reduction (PSER) stopping rule will stop the CAT even if the SE threshold has not been reached, and can avoid administering excessive questions that provide little additional information. By tuning the parameters of the PSER algorithm, a practitioner can specify a desired tradeoff between accuracy and efficiency. Using simulated data for the PROMIS Anxiety and Physical Function banks, we demonstrate that these parameters can substantially impact CAT performance. When the parameters were optimally tuned, the PSER stopping rule was found to outperform the SE stopping rule overall and particularly for individuals not targeted by the bank, and presented roughly the same number of items across the trait continuum. Therefore, the PSER stopping rule provides an effective method for balancing the precision and efficiency of a CAT.

The healthy body image (HBI) intervention: Effects of a school-based cluster-randomized controlled trial with 12-months follow-up

We examined the effects of the Healthy Body Image (HBI) intervention on positive embodiment and health-related quality of life among Norwegian high school students. The intervention comprised three interactive workshops, with body image, media literacy, and lifestyle as main themes. In total, 2,446 12^th grade boys (43%) and girls (mean age 16.8 years) from 30 high schools participated in a cluster-randomized controlled study with the HBI intervention and a control condition as the study arms. Data were collected at baseline, post-intervention, 3- and 12-months follow-up, and analysed using linear mixed regression models. The HBI intervention caused a favourable immediate change in positive embodiment and health-related quality of life among intervention girls, which was maintained at follow-up. Among intervention boys, however, weak post-intervention effects on embodiment and health-related quality of life vanished at the follow-ups. Future studies should address steps to make the HBI intervention more relevant for boys as well as determine whether the number of workshops or themes may be shortened to ease implementation and to enhance intervention effects.

Minimal Associations Between Clinical Data and Children's Self-Reported Health-Related Quality of Life in Children With Chronic Conditions-A Cross-Sectional Study

Introduction: The improvement-or at least maintenance-of health-related quality of life (HRQoL) in children and adolescents is one of the main aims of chronic disease care. This study examines HRQoL of children and adolescents with three different chronic conditions (i.e., diabetes mellitus, asthma, juvenile arthritis) using the computer-adaptive test Kids-CAT, comprising five HRQoL domains: physical well-being, psychological well-being, parent relations, social support and peers, and school well-being. Further, associations between HRQoL and distinct clinical data and medical assessments are investigated to explore how much variability of the five domains can be explained by these variables. Methods: Cross-sectional data of the Kids-CAT study was analyzed. The Kids-CAT was used in two outpatient clinics in northern Germany gathering data on self-reported HRQoL in n = 309 children and adolescents aged 7-17 years. Additionally, general patient information, clinical data, and pediatrician-reported medical assessments were measured. Multiple regression analyses were conducted to explore associations between HRQoL and selected variables (i.e., disease duration, co-morbidity, disease control, overall health status). Results: Overall, self-reported HRQoL in all five domains were comparable to data of an age- and sex-matched reference population. Results of regression analyses indicated that the investigated variables only minimally explain variance in the five Kids-CAT domains. Sociodemographic, clinical data, and medical assessments explained 18.4% of the variance in physical well-being, 10.7% in psychological well-being, and < 10% of the variance in parent relations, social support and peers, and school well-being. Conclusion: Sociodemographic data, disease duration, co-morbidity, and medical assessments, such as disease control or pediatrician-assessed overall health status show low association with HRQoL of children and adolescents with chronic conditions. Data on self-reported HRQoL delivers valuable information on children's well-being and can improve healthcare professionals' understanding of the subjective well-being of their young patients. The implementation of tools like the Kids-CAT can facilitate the identification of potential problem areas, which should enable healthcare professionals to better address specific healthcare needs. Clinical Trial Registration: identifier: DRKS00006326 (retrospectively registered); Date of registry: August 1st, 2014.

Trajectories of Health-Related Quality of Life and HbA1c Values of Children and Adolescents With Diabetes Mellitus Type 1 Over 6 Months: A Longitudinal Observational Study

Introduction: To achieve optimized blood glucose concentrations (assessed by HbA1c) and high health-related quality of life (HRQL), children and adolescents with diabetes mellitus type 1 (T1DM) must follow strict disease management strategies. This study aims to investigate HRQL of children and adolescents with T1DM and its association with HbA1c values over the course of 6 months. Methods: Patients aged 7-17 years (n = 203) with T1DM provided HRQL data on a monthly basis. HRQL was measured using the Kids-CAT, a computer-adaptive test (CAT) comprising five generic HRQL domains. HbA1c concentrations were assessed at baseline, at 3 and 6 months. We explored the trajectory of HRQL at the domain level using linear mixed effects models. Further, we investigated the association between HRQL and HbA1c concentrations over time using path analysis models. Results: Children and adolescents with T1DM reported high scores across all HRQL domains over time. However, those with an HbA1c concentrations of >9.0% reported significantly lower scores in physical well-being and parent relations compared with those with an HbA1c concentration of <7.5%. Path analysis models revealed a minimal temporal relationship between HbA1c and HRQL, with a small negative impact of HbA1c on physical well-being, psychological well-being and parent relations. Conclusion: Although observed HRQL of young patients with T1DM was comparable to age-related German-speaking reference population over the course of 6 months, those with an HbA1c concentration >9.0% reported lower scores in selected HRQL domains. Thus, special attention should be drawn to HRQL of children and adolescents with higher HbA1c concentrations. The minimal relationship between HbA1c and HRQL indicates that the two therapy goals, i.e., achievement and maintenance of glycemic targets and high HRQL, should be considered and evaluated independently in clinical routine. Trial Registration: DRKS00006326 (German Clinical Trial Register), date of registration: August 1st, 2014.

Predictors of health-related quality of life in chronically ill children and adolescents over time

OBJECTIVE

This study aims at identifying predictors of generic health-related quality of life (HRQoL) in chronically ill children and adolescents over time. The newly developed computer-adaptive test Kids-CAT was used to assess five dimensions of HRQoL.

METHODS

Longitudinal data from the Kids-CAT study on children and adolescents with asthma, diabetes and juvenile arthritis (n = 248; aged 7-17 years) were assessed at three measurement points over six months. Individual growth modeling served to investigate effects of sociodemographic, disease- and health-related as well as psychosocial factors on HRQoL dimensions Physical Well-Being (WB), Psychological WB, Parent Relations, Social Support & Peers, and School WB over time.

RESULTS

Besides effects of sociodemographic variables on HRQoL dimensions Social Support & Peers as well as School WB, we found that a longer duration of the disease was associated with better Physical WB. Lower scores were found for patients with juvenile arthritis compared to those with diabetes in HRQoL dimensions Physical WB and Social Support & Peers. Disease control was positively related to Physical and Psychological WB over time. Mental health problems were negatively associated with four, and subjective health complaints with all five HRQoL dimensions over time. Parental mental health was positively related to the patients' HRQoL score in Parent Relations over time.

CONCLUSIONS

HRQoL as a multidimensional construct is associated with a wide range of different factors. Pediatricians should consider potential mental health problems and subjective health complaints in their patients. Finally, parental HRQoL can affect HRQoL in chronically ill children and adolescents.

From the Child's Word to Clinical Intervention: Novel, New, and Innovative Approaches to Symptoms in Pediatric Palliative Care

Despite vast improvements in disease-based treatments, many children live with life-threatening disorders that cause distressing symptoms. These symptoms can be difficult to comprehensively assess and manage. Yet, frequent and accurate symptom reporting and expert treatment is critical to preserving a patient's physical, psychological, emotional, social, and existential heath. We describe emerging methods of symptom and health-related quality-of-life (HRQOL) assessment through patient-reported outcomes (PROs) tools now used in clinical practice and novel research studies. Computer-based and mobile apps can facilitate assessment of symptoms and HRQOL. These technologies can be used alone or combined with therapeutic strategies to improve symptoms and coping skills. We review technological advancements, including mobile apps and toys, that allow improved symptom reporting and management. Lastly, we explore the value of a pediatric palliative care interdisciplinary team and their role in assessing and managing distressing symptoms and minimizing suffering in both the child and family. These methods and tools highlight the way that novel, new, and innovative approaches to symptom assessment and management are changing the way that pediatrics and pediatric palliative care will be practiced in the future.

Predictors of self-reported health-related quality of life according to the EQ-5D-Y in chronically ill children and adolescents with asthma, diabetes, and juvenile arthritis: longitudinal results

PURPOSE

Health-related quality of life (HRQoL) is an important patient-reported outcome in clinical and health research. The EQ-5D-Y assesses child and adolescent HRQoL by five items on mobility, self-care, usual activities, pain/discomfort, and anxiety/depression as well as a visual analogue scale (VAS) on the current health state. This study investigates predictors of self-reported HRQoL according to the EQ-5D-Y in chronically ill children and adolescents using longitudinal data.

METHODS

Data from the German Kids-CAT study on children and adolescents with asthma, diabetes, and juvenile arthritis gathered over a period of six months were analyzed (n = 310; 7-17 years old; 48% female). Self-, parent-, and pediatrician-reported data were collected from June 2013 to October 2014. Generalized linear mixed models and linear mixed models served to examine effects of socio-demographic as well as disease- and health-specific predictors on the items as well as on the VAS of the EQ-5D-Y.

RESULTS

Ceiling effects for the EQ-5D-Y indicated low burden of disease in the analyzed sample. Longitudinal analyses revealed associations between less health complaints and better HRQoL for all investigated HRQoL domains. Further, age- and gender-specific effects, and associations of better disease control, longer duration of the disease and less mental health problems with better HRQoL were found.

CONCLUSIONS

Subjective health complaints and mental health problems should be considered in the care of children and adolescents with asthma, diabetes, and juvenile arthritis. Future research should suggest administering the items of the EQ-5D-Y with five instead of three response options, and investigate HRQoL over a longer period.