A Systematic Review of the Use and Quality of Qualitative Methods in Concept Elicitation for Measures with Children and Young People

Key Insights into Developing Qualitative Concept Elicitation Work for Outcome Measures with Children and Young People

Qualitative concept elicitation can develop meaningful patient-reported outcome measures for children and young people; however, the methods used for concept elicitation are often underreported for this population. This paper provides in-depth insight into the methods used for concept elicitation with children and young people, with a focus on key stages of concept elicitation that are challenging or unique to doing this research with children. Drawing on our experiences of developing wellbeing measures for children and young people aged 6-15 years, we detail the processes followed in our qualitative concept elicitation work, covering issues related to sampling and recruitment, encouraging informed assent and freedom over children and young people's involvement in concept elicitation, and the use of creative and participatory methods to develop measure items. We provide reflections on the approaches taken to navigate challenging aspects of concept elicitation with children and young people. Our reflections suggest that using existing links and online recruitment methods can help to navigate organisational gatekeepers, and using appropriate processes to develop study information and obtain informed assent can ensure that research is inclusive and that children have the freedom to decide whether to be involved. Our adaptation of a creative and participatory activity to generate concepts for measure items suggests that such approaches can be engaging and may help to give children greater control over their participation. In detailing our methods, we hope to have developed a useful resource for other researchers, while highlighting the value of transparent reporting in this area.

Is well-becoming important for children and young people? Evidence from in-depth interviews with children and young people and their parents

PURPOSE

This study explores how important well-becoming factors appear to be to children during childhood. We define well-becoming as the indicators which predict children and young people's future wellbeing and opportunities. The priority for this work was to explore whether well-becoming might be an important factor to include in outcome measures for children and young people. The inclusion of well-becoming indicators could ensure that opportunities to invest in promoting wellbeing in children's futures are not missed.

METHODS

In-depth, qualitative interviews (N = 70) were undertaken with children and young people aged 6-15 years and their parents. Analysis used constant comparison and framework methods to investigate whether well-becoming factors were considered important by informants to children and young people's current wellbeing.

RESULTS

The findings of the interviews suggested that children and young people and their parents are concerned with future well-becoming now, as factors such as future achievement, financial security, health, independence, identity, and relationships were identified as key to future quality of life. Informants suggested that they considered it important during childhood to aspire towards positive outcomes in children and young people's futures.

CONCLUSION

The study findings, taken alongside relevant literature, have generated evidence to support the notion that future well-becoming is important to current wellbeing. We have drawn on our own work in capability wellbeing measure development to demonstrate how we have incorporated a well-becoming attribute into our measures. The inclusion of well-becoming indicators in measures could aid investment in interventions which more directly improve well-becoming outcomes for children and young people.

Including Young Children in the Development and Testing of Patient Reported Outcome (PRO) Instruments: A Scoping Review of Children's Involvement and Qualitative Methods

BACKGROUND

Qualitative research during the development/testing of Patient Reported Outcome Measures (PROMs) is recommended to support content validity. However, it is unclear if and how young children (≤ 7 years) can be involved in this research because of their unique cognitive needs.

OBJECTIVES

Here we investigate the involvement of children (≤ 7 years) in qualitative research for PROM development/testing. This review aimed to identify (1) which stages of qualitative PROM development children ≤ 7 years had been involved in, (2) which subjective health concepts had been explored within qualitative PROM development with this age group, and (3) which qualitative methods had been reported and how these compared with existing methodological recommendations.

METHODS

This scoping review systematically searched three electronic databases (searches re-run prior to final analysis on 29 June 2022) with no date restrictions. Included studies had samples of at least 75% aged ≤ 7 years or reported distinct qualitative methods for children ≤ 7 years in primary qualitative research to support concept elicitation or PROM development/testing. Articles not in English and PROMs that did not enable children ≤ 7 years to self-report were excluded. Data on study type, subjective health and qualitative methods were extracted and synthesised descriptively. Methods were compared with recommendations from guidance.

RESULTS

Of 19 included studies, 15 reported concept elicitation research and 4 reported cognitive interviewing. Most explored quality of life (QoL)/health-related quality of life (HRQoL). Some concept elicitation studies reported that creative/participatory activities had supported children's engagement, but results and reporting detail varied considerably across studies. Cognitive interviewing studies reported less methodological detail and fewer methods adapted for young children compared with concept elicitation studies. They were limited in scope regarding assessments of content validity, mostly focussing on clarity while relevance and comprehensiveness were explored less.

DISCUSSION

Creative/participatory activities may be beneficial in concept elicitation research with children ≤ 7 years, but future research needs to explore what contributes to the success of young children's involvement and how researchers can adopt flexible methods. Cognitive interviews with young children are limited in frequency, scope and reported methodological detail, potentially impacting PROM content validity for this age group. Without detailed reporting, it is not possible to determine the feasibility and usefulness of children's (≤ 7 years) involvement in qualitative research to support PROM development and assessment.

Improving Reporting on Qualitative Methods Used in the Development and Validation of Patient-Reported Outcome Measures for Mental Health Concerns

Qualitative methodologies are recommended in the development and evaluation of psychological instruments. However, reporting on qualitative methods in instrument development studies remains variable and often insufficient to support claims surrounding content validity. In the current article, we present a commentary discussing the critical role qualitative inquiry plays in the development of patient-reported outcome measures. We outline the current state of reporting in qualitative instrument development and evaluation studies with a focus on mental health literature and highlight the clinical relevance of this topic for health care professionals. Despite challenges, we express confidence in the potential value of substantively engaging with qualitative methods and comprehensive reporting and summarize recommendations to this effect based on the current literature. [Journal of Psychosocial Nursing and Mental Health Services, 61(3), 40-44.].

The role of parental health and distress in assessing children’s health status

Purpose

The purpose of the study was to examine the contributions of parents’ health and distress to parent’s and children’s assessments of children’s health.

Methods

We used baseline data from a longitudinal study of 364 children (ages 4–12) about to undergo surgery and their parents in a Southern California pediatric hospital. We used the 20-item child self-reported CHRIS 2.0 general health and the parallel parent-reported measure of the child’s health, along with a measure of parental distress about the child’s health were administered in the perioperative period. Other measures included parents’ physical and mental health, quality of life, distress over their child’s health, and number and extent of other health problems of the child and siblings.

Results

On average, parents’ reports about the child were consistently and statistically significantly higher than children’s self-reports across all sub-dimensions of the CHRIS 2.0 measure. Parents’ personal health was positively associated with their reports of the child’s health. More distressed parents were closer to the child’s self-reports, but reported poorer personal health.

Conclusion

Parent–child differences in this study of young children’s health were related to parental distress. Exploring the nature of the gap between parents and children in assessments of children’s health could improve effective clinical management for the child and enhance family-centered pediatric care. Future studies are needed to assess the generalizability of CHRIS 2.0 to other health settings and conditions and to other racial/ethnic groups.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-022-03186-z.

Same same-but different: using qualitative studies to inform concept elicitation for quality of life assessment in telemedical care: a request for an extended working model

Background

Although telemedical applications are increasingly used in the area of both mental and physical illness, there is no quality of life (QoL) instrument that takes into account the specific context of the healthcare setting. Therefore, the aim of this study was to determine a concept of quality of life in telemedical care to inform the development of a setting-sensitive patient-reported outcome measure.

Methods

Overall, 63 semi-structured single interviews and 15 focus groups with 68 participants have been conducted to determine the impact of telemedical care on QoL. Participants were patients with chronic physical or mental illnesses, with or without telemedicine supported healthcare as well as telemedical professionals. Mayring's content analysis approach was used to encode the qualitative data using MAXQDA software.

Results

The majority of aspects that influence the QoL of patients dealing with chronic conditions or mental illnesses could be assigned to an established working model of QoL. However, some aspects that were considered important (e. g. perceived safety) were not covered by the pre-existing domains. For that reason, we re-conceptualized the working model of QoL and added a sixth domain, referred to as healthcare-related domain.

Conclusion

Interviewing patients and healthcare professionals brought forth specific aspects of QoL evolving in telemedical contexts. These results reinforce the assumption that existing QoL measurements lack sensitivity to assess the intended outcomes of telemedical applications. We will address this deficiency by a telemedicine-related re-conceptualization of the assessment of QoL and the development of a suitable add-on instrument based on the resulting category system of this study.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12955-021-01807-8.