Informing the NHS Outcomes Framework: evaluating meaningful health outcomes for children with neurodisability using multiple methods including systematic review, qualitative research, Delphi survey and consensus meeting

Child, family and professional views on valued communication outcomes for non-verbal children with neurodisability: A qualitative meta-synthesis

BACKGROUND

There are many children with neurodisability who are unable to rely on speech to communicate and so use a range of augmentative and alternative communication (AAC) methods and strategies to get their message across. Current instruments designed to measure the outcomes of speech and language therapy interventions lack specific attention to communication outcomes that are valued by non-verbal children with neurodisability, their families and support networks. This qualitative meta-synthesis was conducted to identify valued communication outcomes to inform the next stage of developing a novel outcome measure.

AIMS

To systematically identify and synthesise the qualitative evidence about which communication outcomes non-verbal children with neurodisability, their family members, healthcare professionals and educators think are important to achieve, specifically which communication outcomes are most valued by: (1) non-verbal children with neurodisability; (2) parents or other family members of non-verbal children with neurodisability; and (3) professionals who work with non-verbal children with neurodisability.

METHODS & PROCEDURES

A systematic search of bibliographic databases and the grey literature was undertaken to identify qualitative studies that included evidence of views expressed by children, family members, healthcare professionals and educators on outcomes in relation to the communication of non-verbal children with neurodisability. All papers meeting the inclusion criteria were quality appraised using the Critical Appraisal Skills Programme Qualitative checklist, although none were excluded on this basis. The data synthesis involved organising coded data into descriptive themes which were then synthesised into analytical themes.

MAIN CONTRIBUTION

We found 47 papers containing qualitative data meeting the inclusion criteria from research situated in 14 countries. The views of 35 children, 183 parents, six other family members, 42 healthcare professionals and 18 educators are represented in the review. The included studies contained very few data reported by children themselves; most data were provided by adults, especially parents. Three main analytical themes were identified: Experiences of communication and expectations; adapting to and acceptance of AAC; and becoming an autonomous communicator.

CONCLUSIONS & IMPLICATIONS

This meta-synthesis brings together the limited qualitative research findings about what parents, professionals and children consider are important communication outcomes for non-verbal children with neurodisability. The synthesis identifies key gaps in our knowledge about the perspectives of children and their siblings. This synthesis will inform primary research to understand valued communication outcomes in this group, and ultimately the development of a patient-reported outcome measure (PROM) that can be used to demonstrate the effect of interventions, at both clinical and service levels.

WHAT THIS PAPER ADDS

What is already known on the subject Studies of children with cerebral palsy and autism spectrum disorder indicate that at least 25% of children with these conditions are non-verbal. Studies on the health outcomes of children with neurodisability have identified that communication is rated as important by parents and health professionals. There is an evidence gap about which communication outcomes are important to non-verbal children, their families and the people who work with them. What this paper adds to the existing knowledge This is the first synthesis of data that relates to communication outcomes for non-verbal children with neurodisability. This qualitative meta-synthesis identifies from previous research studies the communication outcomes valued by children who are non-verbal, their parents or other family members, and the professionals who work with them. The findings will be used to shape further primary research and the development of a novel patient-reported communication outcome measure for non-verbal children with neurodisability. It is anticipated that this will be used by clinicians to measure the effect of their interventions. What are the practical and clinical implications of this work? Clinicians should reflect on parents' experiences of communication with their child before discussing potential outcomes with them. Gaining insight into the lived experience of communication for non-verbal children and their families will help healthcare professionals to understand which goals are important to them and why. Few studies have specifically asked which communication outcomes are important for non-verbal children with neurodisability. Further exploration is needed to determine which communication outcomes non-verbal children and their families would like to see included in outcome measures used by clinicians.

Meaningful Clinical Outcomes for Young People and Parents When Treated for Chronic Musculoskeletal Pain in the UK: Q Set Development

Previous studies have established a core outcome set for pediatric chronic pain clinical trials. The aim of this research was to establish which outcomes young people and parents considered important to measure during treatment for chronic musculoskeletal pain. To the best of our knowledge, this is the first study to explore which outcomes could be used to tailor interventions within a clinical setting. Twenty-one young people (aged 11-18 years) and 21 parents were recruited from 2 UK hospital sites and took part in semi-structured interviews that incorporated drawing a timeline of their treatment. They identified positive and negative outcomes showing the perceived effectiveness of treatment. Informed by Q methodology, the words and phases of young people and parents were developed into 101 statements that were mapped onto the core outcome set and represented wide-ranging opinions regarding the outcomes they considered important (Q set). This approach helped identify additional statements related to "parent and family functioning" not routinely considered. Outcomes related to the treatment experience and adverse effects were highlighted as important, yet are not routinely prioritized in clinical research. Parents prioritized outcomes related to the treatment experience, whereas young people prioritized their overall well-being. Over the course of treatment, outcome focus changed, with some outcomes only deemed relevant at a specific time point. Overall, the research highlighted the need for clinical guidance on which outcome domains to measure during the treatment course to gauge treatment effectiveness and optimally tailor interventions. PERSPECTIVE: This study established the range of outcomes that were important to young people and their parents during treatment for chronic musculoskeletal pain. The findings show how young people and parents have different outcome preferences and how their outcome focus changes during the treatment course.

The Validity and Reliability of the Turkish Version of the Autism Family Experience Questionnaire (AFEQ)

The aim of this study was to examine the reliability and validity of the Turkish version of the AFEQ for Turkish parents of children with ASD. The Turkish-translated version of the AFEQ was administered to 241 parents of children aged 2-12 years with ASD to examine the construct validity and internal consistencies. Parents completed the Autism Behavior Checklist (ABC), and Quality of Life in Autism Questionnaire Parent version, along with the AFEQ. The mean age of the children of 241 individuals in the study group was 7.63 ± 3.02 and 88.4% (n = 213) were male. Cronbach's alpha coefficient was 0.921 of the total variance. Cronbach alpha coefficients are 0.813 for the "Experience of being a parent" subscale, 0.768 for the "Family Life" subscale, 0.810 for the "Child Development, Understanding and Social Relationships" subscale, and 0.804 for the "Child Symptoms (Feelings and Behaviour)" subscale. In conclusion, the translated and culturally adapted AFEQ shows good reliability and validity to measure the priorities of autistic children and their families in Turkey. It can also be useful in monitoring the effectiveness of intervention programs and changes in the child.

Physicians' Self-Perceived Competence on Breaking Bad News to Parents of Children with Neurodisabilities

Delivering difficult news to parents of children with neurodisabilities, often involving new diagnoses, prognosis changes, or declines in function or health, presents a complex task. Our aim was to assess physicians' self-perceived competence in breaking bad news (BBN) within this context. An online survey was administered to neuropediatricians and developmental and rehabilitation pediatricians in Switzerland. Among 247 invited physicians, 62 (25.1%) responded (age of 51 ± 11 years; M/F ratio of 2:3). They rated their BBN competence at 7.5 ± 1.6 out of 10. Factors significantly associated with self-perceived competence in uni- and multivariate analyses included years of professional experience (≤10 years: 6.2 ± 1.8; >10 years: 8.2 ± 0.8), and region of pregraduate training (Switzerland: 7.3 ± 1.6; European Union: 8.3 ± 0.9). The respondents highlighted the positive roles of professional and personal experience, quality relationships with families, and empathy in BBN. In summary, physicians generally expressed a sense of competence in delivering difficult news to parents of children with neurodisabilities. They underscored the significance of life experiences and certain individual qualities in their effectiveness. These findings provide valuable insights into enhancing professional training and support in this crucial yet underexplored aspect of medical practice.

Consensus statements on optimal adult post-autism diagnosis support and services: Delphi process following a UK survey of autistic adults, relatives and clinicians

LAY ABSTRACT

Research has identified types of support helpful to autistic people, for example, physical and mental health interventions, psycho-education, peer support, developing positive identities and affiliation with social groups. However, accessing suitable post-autism diagnosis support and services is extremely difficult. We asked autistic adults, relatives and clinicians about their experiences of receiving and delivering post-autism diagnosis support/services. In Stage 1, 343 autistic adults and 45 relatives completed a survey. They answered questions about their experiences of UK autism post-diagnosis support/services for adults within 12 months after receiving a diagnosis. Thirty-five clinicians completed a similar survey. Just over half of adults and relatives said there was a follow-up appointment or discussion about support after diagnosis. Fewer than 40% received any support/services in 12 months after diagnosis. We used information from the surveys to create 11 statements describing characteristics of appropriate adult post-autism diagnosis support/services. In Stage 2, we asked clinicians for their views on the statements - they agreed with all of them. For example, those adults are offered an additional follow-up meeting after diagnosis and have access to mental and physical health services. We shared results with autistic adults, relatives and clinicians at two events. Some autistic adults, relatives and clinicians were positive about post-autism diagnosis support/services. However, they described many areas for improvement. The study findings can be used to define, develop and improve the types of adult post-diagnosis support services.

A survey of autistic adults, relatives and clinical teams in the United Kingdom: And Delphi process consensus statements on optimal autism diagnostic assessment for adults

LAY ABSTRACT

Living with undiagnosed autism can be distressing and may affect mental health. A diagnosis of autism can help self-awareness and self-understanding. However, it can be difficult for adults to access an autism assessment. Clinicians also sometimes find it hard to identify autism in adults. This may mean an autism diagnosis is delayed or missed. In this study, we asked autistic adults, relatives and clinicians how to improve this. The study was in two stages. In the first stage (stage 1), 343 autistic adults and 45 relatives completed a survey. In the survey, we asked questions about people's experiences of UK autism assessment services for adults. Thirty-five clinicians completed a similar survey. Clinicians reported that some autism assessment teams lacked key professionals, for example, psychologists and occupational therapists. We used the information from the three separate surveys to create 13 statements describing best autism assessment services for adults. In stage 2, we asked clinicians for their views on the 13 statements. Clinicians agreed with 11 of the statements. Some autistic adults, relatives and clinicians were positive about autism assessment services, and many also described areas that could be improved. The study findings can be used to improve UK adult autism assessment services and may be helpful for service developments worldwide.

Capturing Meaningful Outcomes in -Pediatric Neurology: Further Reflections on Principles, Challenges, and Opportunities

Patient and public involvement in health care is considered indispensable in the way we conduct daily pediatric neurology practice, and in the development and utilization of health outcome measurements. This essay examines what meaningful quality evaluations and measurements are, describes the development of approaches to measuring health and outcomes, explores the potential applications of patient-reported outcome measures in pediatric neurology, and identifies opportunities and challenges in using patient-reported outcome measurements in our daily clinical practice. Recent developments have transformed our attitude on how to help children with neurological and developmental conditions and their families: specifically, (1) the recognition of the fundamental rights of children with disabilities; (2) the application of the framework of the International Classification of Functioning, Disability and Health by the World Health Organization that views health from the perspective of both biopsychosocial strengths and functional abilities; (3) the application of qualitative research methodologies to children with neurological conditions and their caregivers to elucidate what they consider essential for their own good health and well-being; and (4) the development of core outcome measurements sets for children and adults with various neurological and developmental conditions. In summary, supporting patients in their role as full partners in clinical care and research enables them to contribute their experiential knowledge and helps ensure that results are relevant and address patient needs, preferences, and priorities. Recognizing the importance of involving young people in their health management decisions has become central in contemporary medicine and needs to be part of the curriculum of all health care professionals.

Caregiver assessment of quality of life in individuals with genetic developmental and epileptic encephalopathies

AIM

To summarize quality of life (QoL) and its determinants, including disease severity, in individuals with developmental and epileptic encephalopathies (DEEs) through a tailored questionnaire.

METHOD

A questionnaire containing 89 items addressing demographic characteristics, genetic diagnosis, clinical features, and QoL was distributed to primary caregivers of individuals with DEEs through patient advocacy organizations. Composite scores were generated from the mean values of QoL items, grouped into domain scores.

RESULTS

Out of 176 received responses, the most common genetic diagnoses reported were SCN2A (n=42/173, 24%), SLC6A1 (n=28/173, 16%), SCN1A (n=22/173, 13%), and KCNQ2 (n=21/173, 12%). Composite QoL scores centered around a mean score of 61.67 of 100 (SD 17.10). QoL scores were strongly associated with the number of days minimally disrupted by seizures, medication side effects, genetic diagnosis, and community type. The mean QoL scores for individuals with DEEs was significantly lower than for individuals with Rett syndrome, cerebral palsy, autism spectrum disorder, and Down syndrome.

INTERPRETATION

QoL in DEEs can be assessed through a standardized instrument. QoL only partially overlaps with objective measurements of disease severity and may represent an independent outcome measure in precision medicine trials.

Advances in measuring pediatric overall health: the PROMIS® Pediatric Global Health scale (PGH-7)

In this cross-sectional study, we aimed to assess the reliability, validity, and efficiency of the Patient-Reported Outcomes Measurement Information System (PROMIS) Pediatric Global Health scale (PGH-7) to reduce patient burden when assessing overall health in clinical practice. In total, 1082 children (8-18), representative of the Dutch population, completed the PGH-7 and the Pediatric Quality of Life Inventory (PedsQL™ 4.0), a common legacy instrument used in clinical practice to assess overall health. The assumptions for fitting an item response theory model were assessed: unidimensionality, local independence, and monotonicity. Subsequently, a model was fitted to the data to assess item fit and cultural differential item functioning (DIF) between Dutch and US children. A strong correlation (> .70) was expected between the PGH-7 and PedsQL, as both instruments measure physical, mental, and social domains of health. Percentages of participants reliably measured (> 0.90) were assessed using the standard error of measurement (SE(θ) < 0.32). Efficiency was calculated ((1 - SE(θ)²)/n_items) to compare how well both measures performed relative to number of items administered. The PGH-7 met all assumptions and displayed good structural and convergent (r = .69) validity. One item displayed cultural DIF. Both questionnaires measured reliably (%n_PGH-7 = 73.8%, %n_PedsQL = 76.6%) at the mean and 2SD in clinically relevant direction. PGH-7 items were 2.6 times more efficient in measuring overall health than the PedsQL.   Conclusion: The PGH-7 displays sufficient validity and reliability in the general Dutch pediatric population and measures more efficiently than the PedsQL, the most commonly used legacy instrument. The PGH-7 can be used in research and clinical practice to reduce patient burden when assessing overall health. What is Known: • Generic instruments which validly and reliably assess overall pediatric health are scarce. • Brief instruments are required for implementation of self-report patient-reported outcomes in clinical practice. What is New: • The PROMIS Pediatric Global Health (PGH-7) can be used in research and clinical practice to briefly assess overall pediatric health, while providing valid and reliable measurements. • The PGH-7 provides more efficient assessment of pediatric overall health than the Pediatric Quality of Life Inventory.

A Review of Data Gathering Methods for Evaluating Socially Assistive Systems

Social interactions significantly impact the quality of life for people with special needs (e.g., older adults with dementia and children with autism). They may suffer loneliness and social isolation more often than people without disabilities. There is a growing demand for technologies to satisfy the social needs of such user groups. However, evaluating these systems can be challenging due to the extra difficulty of gathering data from people with special needs (e.g., communication barriers involving older adults with dementia and children with autism). Thus, in this systematic review, we focus on studying data gathering methods for evaluating socially assistive systems (SAS). Six academic databases (i.e., Scopus, Web of Science, ACM, Science Direct, PubMed, and IEEE Xplore) were searched, covering articles published from January 2000 to July 2021. A total of 65 articles met the inclusion criteria for this systematic review. The results showed that existing SASs most often targeted people with visual impairments, older adults, and children with autism. For instance, a common type of SASs aimed to help blind people perceive social signals (e.g., facial expressions). SASs were most commonly assessed with interviews, questionnaires, and observation data. Around half of the interview studies only involved target users, while the other half also included secondary users or stakeholders. Questionnaires were mostly used with older adults and people with visual impairments to measure their social interaction, emotional state, and system usability. A great majority of observational studies were carried out with users in special age groups, especially older adults and children with autism. We thereby contribute an overview of how different data gathering methods were used with various target users of SASs. Relevant insights are extracted to inform future development and research.

Exploring the Outcomes That Matter Most to Young People Treated for Chronic Pain: A Qualitative Study

Global and national policies state that all children and young people should be part of decision making and that outcomes that matter to them should take priority, yet patient-centred outcomes have been identified as a gap in the paediatric chronic pain literature. This study gave youths experiencing chronic pain a platform to have their views heard. Using novel methods, twenty-one young people, aged 11 to 18 years old, completed a semi-structured interview in which they constructed a timeline drawing to symbolise their treatment. They identified when aspects of their life changed (outcomes) and described the importance of these changes. Thematic analysis identified four themes that emerged at different stages of the treatment: “perfect storm”; “turning points”; “disconnect”; and; “free”. “Turning points” were points in time when the narrative of the young person took a turn in a different direction. At these points, the outcomes important to them also changed. Youths initially prioritised outcomes related to pain, then during treatment the focus became their emotional functioning, with role functioning and “going out” becoming the focus at the end. The stage of treatment as perceived by the young person impacted which outcomes mattered most.

Powered mobility interventions for very young children with mobility limitations to aid participation and positive development: the EMPoWER evidence synthesis

BACKGROUND

One-fifth of all disabled children have mobility limitations. Early provision of powered mobility for very young children (aged < 5 years) is hypothesised to trigger positive developmental changes. However, the optimum age at which to introduce powered mobility is unknown.

OBJECTIVE

The aim of this project was to synthesise existing evidence regarding the effectiveness and cost-effectiveness of powered mobility for very young children, compared with the more common practice of powered mobility provision from the age of 5 years.

REVIEW METHODS

The study was planned as a mixed-methods evidence synthesis and economic modelling study. First, evidence relating to the effectiveness, cost-effectiveness, acceptability, feasibility and anticipated outcomes of paediatric powered mobility interventions was reviewed. A convergent mixed-methods evidence synthesis was undertaken using framework synthesis, and a separate qualitative evidence synthesis was undertaken using thematic synthesis. The two syntheses were subsequently compared and contrasted to develop a logic model for evaluating the outcomes of powered mobility interventions for children. Because there were insufficient published data, it was not possible to develop a robust economic model. Instead, a budget impact analysis was conducted to estimate the cost of increased powered mobility provision for very young children, using cost data from publicly available sources.

DATA SOURCES

A range of bibliographic databases [Cumulative Index to Nursing and Allied Health Literature (CINHAL), MEDLINE, EMBASE™ (Elsevier, Amsterdam, the Netherlands), Physiotherapy Evidence Database (PEDro), Occupational Therapy Systematic Evaluation of Evidence (OTseeker), Applied Social Sciences Index and Abstracts (ASSIA), PsycINFO, Science Citation Index (SCI; Clarivate Analytics, Philadelphia, PA, USA), Social Sciences Citation Index™ (SSCI; Clarivate Analytics), Conference Proceedings Citation Index - Science (CPCI-S; Clarivate Analytics), Conference Proceedings Citation Index - Social Science & Humanities (CPCI-SSH; Clarivate Analytics), Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects (DARE), NHS Economic Evaluation Database (NHS EED), Health Technology Assessment (HTA) Database and OpenGrey] was systematically searched and the included studies were quality appraised. Searches were carried out in June 2018 and updated in October 2019. The date ranges searched covered from 1946 to September 2019.

RESULTS

In total, 89 studies were included in the review. Only two randomised controlled trials were identified. The overall quality of the evidence was low. No conclusive evidence was found about the effectiveness or cost-effectiveness of powered mobility in children aged either < 5 or ≥ 5 years. However, strong support was found that powered mobility interventions have a positive impact on children's movement and mobility, and moderate support was found for the impact on children's participation, play and social interactions and on the safety outcome of accidents and pain. 'Fit' between the child, the equipment and the environment was found to be important, as were the outcomes related to a child's independence, freedom and self-expression. The evidence supported two distinct conceptualisations of the primary powered mobility outcome, movement and mobility: the former is 'movement for movement's sake' and the latter destination-focused mobility. Powered mobility should be focused on 'movement for movement's sake' in the first instance. From the budget impact analysis, it was estimated that, annually, the NHS spends £1.89M on the provision of powered mobility for very young children, which is < 2% of total wheelchair service expenditure.

LIMITATIONS

The original research question could not be answered because there was a lack of appropriately powered published research.

CONCLUSIONS

Early powered mobility is likely to have multiple benefits for very young children, despite the lack of robust evidence to demonstrate this. Age is not the key factor; instead, the focus should be on providing developmentally appropriate interventions and focusing on 'movement for movement's sake'.

FUTURE WORK

Future research should focus on developing, implementing, evaluating and comparing different approaches to early powered mobility.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42018096449.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology programme and will be published in full in Health Technology Assessment; Vol. 24, No. 50. See the NIHR Journals Library website for further project information.

Configuration of vascular services: a multiple methods research programme

Background

Vascular services is changing rapidly, having emerged as a new specialty with its own training and specialised techniques. This has resulted in the need for reconfiguration of services to provide adequate specialist provision and accessible and equitable services.

Objectives

To identify the effects of service configuration on practice, resource use and outcomes. To model potential changes in configuration. To identify and/or develop electronic data collection tools for collecting patient-reported outcome measures and other clinical information. To evaluate patient preferences for aspects of services other than health-related quality of life.

Design

This was a multiple methods study comprising multiple systematic literature reviews; the development of a new outcome measure for users of vascular services (the electronic Personal Assessment Questionnaire – Vascular) based on the reviews, qualitative studies and psychometric evaluation; a trade-off exercise to measure process utilities; Hospital Episode Statistics analysis; and the development of individual disease models and a metamodel of service configuration.

Setting

Specialist vascular inpatient services in England.

Data sources

Modelling and Hospital Episode Statistics analysis for all vascular inpatients in England from 2006 to 2018. Qualitative studies and electronic Personal Assessment Questionnaire – Vascular evaluation with vascular patients from the Sheffield area. The trade-off studies were based on a societal sample from across England.

Interventions

The data analysis, preference studies and modelling explored the effect of different potential arrangements for service provision on the resource use, workload and outcomes for all interventions in the three main areas of inpatient vascular treatment: peripheral arterial disease, abdominal aortic aneurysm and carotid artery disease. The electronic Personal Assessment Questionnaire – Vascular was evaluated as a potential tool for clinical data collection and outcome monitoring.

Main outcome measures

Systematic reviews assessed quality and psychometric properties of published outcome measures for vascular disease and the relationship between volume and outcome in vascular services. The electronic Personal Assessment Questionnaire – Vascular development considered face and construct validity, test–retest reliability and responsiveness. Models were validated using case studies from previous reconfigurations and comparisons with Hospital Episode Statistics data. Preference studies resulted in estimates of process utilities for aneurysm treatment and for travelling distances to access services.

Results

Systematic reviews provided evidence of an association between increasing volume of activity and improved outcomes for peripheral arterial disease, abdominal aortic aneurysm and carotid artery disease. Reviews of existing patient-reported outcome measures did not identify suitable condition-specific tools for incorporation in the electronic Personal Assessment Questionnaire – Vascular. Reviews of qualitative evidence, primary qualitative studies and a Delphi exercise identified the issues to be incorporated into the electronic Personal Assessment Questionnaire – Vascular, resulting in a questionnaire with one generic and three disease-specific domains. After initial item reduction, the final version has 55 items in eight scales and has acceptable psychometric properties. The preference studies showed strong preference for endovascular abdominal aortic aneurysm treatment (willingness to trade up to 0.135 quality-adjusted life-years) and for local services (up to 0.631 quality-adjusted life-years). A simulation model with a web-based interface was developed, incorporating disease-specific models for abdominal aortic aneurysm, peripheral arterial disease and carotid artery disease. This predicts the effects of specified reconfigurations on workload, resource use, outcomes and cost-effectiveness. Initial exploration suggested that further reconfiguration of services in England to accomplish high-volume centres would result in improved outcomes, within the bounds of cost-effectiveness usually considered acceptable in the NHS.

Limitations

The major source of evidence to populate the models was Hospital Episode Statistics data, which have limitations owing to the complexity of the data, deficiencies in the coding systems and variations in coding practice. The studies were not able to address all of the potential barriers to change where vascular services are not compliant with current NHS recommendations.

Conclusions

There is evidence of potential for improvement in the clinical effectiveness and cost-effectiveness of vascular services through further centralisation of sites where major vascular procedures are undertaken. Preferences for local services are strong, and this may be addressed through more integrated services, with a range of services being provided more locally. The use of a web-based tool for the collection of clinical data and patient-reported outcome measures is feasible and can provide outcome data for clinical use and service evaluation.

Future work

Further evaluation of the economic models in real-world situations where local vascular service reconfiguration is under consideration and of the barriers to change where vascular services do not meet NHS recommendations for service configuration is needed. Further work on the electronic Personal Assessment Questionnaire – Vascular is required to assess its acceptability and usefulness in clinical practice and to develop appropriate report formats for clinical use and service evaluation. Further studies to assess the implications of including non-health-related preferences for care processes, and location of services, in calculations of cost-effectiveness are required.

Study registration

This study is registered as PROSPERO CRD42016042570, CRD42016042573, CRD42016042574, CRD42016042576, CRD42016042575, CRD42014014850, CRD42015023877 and CRD42015024820.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 9, No. 5. See the NIHR Journals Library website for further project information.

Development of a core outcome set for use in routine orthodontic clinical trials

INTRODUCTION

A diverse range of outcomes is used in orthodontic research with a focus on measuring outcomes important to clinicians and little consistency in outcome selection and measurement. We aimed to develop a core outcome set for use in clinical trials of orthodontic treatment not involving cleft or orthognathic patient groups.

METHODS

A list of outcomes measured in previous orthodontic research was identified through a scoping literature review. Additional outcomes of importance to patients were obtained using qualitative interviews and focus groups with adolescents aged 10-16 years. Rating of outcomes was carried out in a 2-round electronic Delphi process involving health care professionals and patients using a 9-point scale. A face-to-face meeting was subsequently held with stakeholders to discuss the results before refining the core outcome set.

RESULTS

After triangulation, a final list of 34 outcomes grouped under 10 domains was obtained for rating in the e-Delphi surveys. Fifteen outcomes were voted "in" after the second Delphi round involving 274 participants with a further outcome being included after the consensus meeting. These were subsequently refined into a final set of 7 core outcomes, including the impact of self-perceived esthetics, alignment and/or occlusion, skeletal relationship, stability, patient-related adherence, breakages, and adverse effects on teeth or teeth-supporting structures.

CONCLUSIONS

A bespoke orthodontic core outcome set encompassing both clinician- and patient-focused outcomes was developed. Incorporating this is the first step into providing a more holistic assessment of the impact of treatment while allowing for meaningful comparisons and synthesis of results from individual trials.

Assistive products and childhood neurodisability: a retrospective study on factors associated with aids/orthoses prescription

BACKGROUND

Children affected by pathologies causing neurodisability go through motor, cognitive, sensory and other limitations. The selection of assistive products can influence their level of independence and quality of life.

AIM

The present study investigated the possibility to assess the equipment needs of children with neurodisabilities, based on their clinical characteristics.

DESIGN

A retrospective observational study.

SETTING

Outpatients.

POPULATION

Inclusion criteria: diagnosis of cerebral palsy or genetic/chromosomal/syndromic disorders, age range 0-18 years, intelligence quotient evaluation, medical history of positive or negative presence of epilepsy and of communication disorders, admission at our neurorehabilitation service between 2007 and 2017, and registration of all equipment prescribed to each child.

METHODS

In 192 children (111 males, 57.81%) we evaluated the relationship between several independent variables (diagnosis, sex, Gross Motor Function Classification System level, intelligence quotient, history of epilepsy and communication disorders) and equipment prescription by means of logistic regression models.

RESULTS

Our data showed significant correlation between the Gross Motor Function Classification System level and the equipment prescribed. A history of seizures was negatively correlated with walker prescriptions (the log odds of prescription decreases by -2.156; CI: -4.16 to -0.65) and positively with those of stroller (the log odds increases by 1.427; CI: 0.22 to 2.69). Stroller and knee-ankle-foot orthoses and hip-knee-ankle-foot orthoses prescriptions were negatively correlated with the cerebral palsy diagnosis. The prescription of foot orthoses was positively correlated with mental retardation (the log odds increases by 0.358; CI: 0.12 to 0.61). A negative correlation between communication disorders and the prescription of ankle-foot orthoses and communication/learning devices was also found (the log odds decreases by -0.833; CI -1.66 to -0.01).

CONCLUSIONS

Several clinical characteristics correlate with specific equipment needs.

CLINICAL REHABILITATION IMPACT

The definition of the clinical characteristics with a potential predicting value, may facilitate the task of physician on choosing what is more appropriate to prescribe, as well as the authorizing office responsible for evaluating the appropriateness of prescriptions. Furthermore, it could be possible to foresee the care needs in terms of type and number of aids/orthoses and to guarantee every disabled child the possibility to take advantage of the same opportunities.

Identifying Meaningful Patient Outcomes After Lower Extremity Injury, Part 1: Patient Experiences During Recovery

CONTEXT

Determining meaningful aspects of health is crucial for outcome assessment; however, limited literature exists on the aspects of health that are deemed meaningful by the athletic patient population.

OBJECTIVE

To identify experiences and meaningful outcomes after lower extremity (LE) musculoskeletal injury among collegiate athletes.

DESIGN

Qualitative study.

SETTING

University laboratory.

PATIENTS OR OTHER PARTICIPANTS

A purposive sample of 20 athletes (10 men, 10 women; age = 20.1 ± 1.83 years) from a National Collegiate Athletic Association Division I institution in the Midwest who had sustained an LE injury.

DATA COLLECTION AND ANALYSIS

Semistructured face-to-face interviews and inductive data analysis were conducted. Trustworthiness of the data was established using member checks and peer debriefing.

RESULTS

Four themes emerged from the data, revealing that physical changes, psychological changes, personal and lifestyle changes, and support were the most meaningful outcomes among athletes with an LE injury. The 4 themes were associated with 21 subthemes, indicating the complexity with which LE injury affects individuals.

CONCLUSIONS

Our findings demonstrate the importance of caring for the whole person. Athletic trainers must broaden their focus to provide the best patient care and consider the person's activities and life demands outside of athletic participation. The themes identified in this study provide a basis for selecting appropriate health markers and outcome measures.

Outcome domains and outcome measures used in studies assessing the effectiveness of interventions to manage non-respiratory sleep disturbances in children with neurodisabilities: a systematic review

OBJECTIVES

To assess whether a core outcome set is required for studies evaluating the effectiveness of interventions for non-respiratory sleep disturbances in children with neurodisabilities.

DESIGN

Survey of outcome measures used in primary studies identified by a systematic review.

DATA SOURCES

ASSIA, CENTRAL, Cochrane Database of Systematic Reviews, Conference Proceedings Citation Index, CINAHL, DARE, Embase, HMIC, MEDLINE, MEDLINE In-Process, PsycINFO, Science Citation Index, Social Care Online, Social Policy & Practice, ClinicalTrials.gov, WHO International Clinical Trials Registry Platform and the UK Clinical Trials Gateway were searched up to February 2017.

ELIGIBILITY CRITERIA

Studies evaluating pharmacological or non-pharmacological interventions for children (≤18 years old) with a neurodisability and experiencing non-respiratory sleep disturbance.

DATA EXTRACTION AND SYNTHESIS

Outcome measures were listed from each study and categorised into domains.

RESULTS

Thirty-nine studies assessed five core outcome areas: child sleep, other child outcomes, parent outcomes, adverse events and process measures. There were 54 different measures of child sleep across five domains: global measures; sleep initiation; maintenance; scheduling; and other outcomes. Fifteen non-pharmacological (58%) and four pharmacological studies (31%) reported child outcomes other than sleep using 29 different measures.One pharmacological and 14 non-pharmacological (54%) studies reported parent outcomes (17 different measures). Eleven melatonin studies (85%) recorded adverse events, with variation in how data were collected and reported. One non-pharmacological study reported an explicit method of collecting on adverse events. Several process measures were reported, related to adherence, feasibility of delivery, acceptability and experiences of receiving the intervention.

CONCLUSIONS

There is a lack of consistency between studies in the outcome measures used to assess the effectiveness of interventions for non-respiratory sleep disturbances in children with neurodisabilities. A minimum core outcome set, with international consensus, should be developed in consultation with parents, children and young people, and those involved in supporting families.

PROSPERO REGISTRATION NUMBER

CRD42016034067.

Delphi study to identify key features of community-based child and adolescent mental health services in the East of England

OBJECTIVE

To identify priorities for the delivery of community-based Child and Adolescent Mental health Services (CAMHS).

DESIGN

(1) Qualitative methods to gather public and professional opinions regarding the key principles and components of effective service delivery. (2) Two-round, two-panel adapted Delphi study. The Delphi method was adapted so professionals received additional feedback about the public panel scores. Descriptive statistics were computed. Items rated 8-10 on a scale of importance by ≥80% of both panels were identified as shared priorities.

SETTING

Eastern region of England.

PARTICIPANTS

(1) 53 members of the public; 95 professionals from the children's workforce. (2) Two panels. Public panel: round 1,n=23; round 2,n=16. Professional panel: round 1,n=44; round 2,n=33.

RESULTS

51 items met the criterion for between group consensus. Thematic grouping of these items revealed three key findings: the perceived importance of schools in mental health promotion and prevention of mental illness; an emphasis on how specialist mental health services are delivered rather than what is delivered (ie, specific treatments/programmes), and the need to monitor and evaluate service impact against shared outcomes that reflect well-being and function, in addition to the mere absence of mental health symptoms or disorders.

CONCLUSIONS

Areas of consensus represent shared priorities for service provision in the East of England. These findings help to operationalise high level plans for service transformation in line with the goals and needs of those using and working in the local system and may be particularly useful for identifying gaps in ongoing transformation efforts. More broadly, the method used here offers a blueprint that could be replicated by other areas to support the ongoing transformation of CAMHS.

Internet delivery of intensive speech and language therapy for children with cerebral palsy: a pilot randomised controlled trial

OBJECTIVES

To test the feasibility of recruitment, retention, outcome measures and internet delivery of dysarthria therapy for young people with cerebral palsy in a randomised controlled trial.

DESIGN

Mixed methods. Single blind pilot randomised controlled trial, with control offered Skype therapy at end of study. Qualitative study of the acceptability of therapy delivery via Skype.

SETTING

Nine speech and language therapy departments in northern England recruited participants to the study. Skype therapy was provided in a university setting.

PARTICIPANTS

Twenty-two children (14 M, 8 F) with dysarthria and cerebral palsy (mean age 8.8 years (SD 3.2)) agreed to take part. Participants were randomised to dysarthria therapy via Skype (n=11) or treatment as usual (n=11).

INTERVENTIONS

Children received either usual speech therapy from their local therapist for 6 weeks or dysarthria therapy via Skype from a research therapist. Usual therapy sessions varied in frequency, duration and content. Skype dysarthria therapy focused on breath control and phonation to produce clear speech at a steady rate, and comprised three 40 min sessions per week for 6 weeks.

PRIMARY AND SECONDARY OUTCOME MEASURES

Feasibility and acceptability of the trial design, intervention and outcome measures.

RESULTS

Departments recruited two to three participants. All participants agreed to random allocation. None withdrew from the study. Recordings of children's speech were made at all time points and rated by listeners. Families allocated to Skype dysarthria therapy judged internet delivery of the therapy to be acceptable. All families reported that the study design was acceptable. Treatment integrity checks suggested that the phrases practised in one therapy exercise should be reduced in length.

CONCLUSIONS

A delayed treatment design, in which dysarthria therapy is offered at the end of the study to families allocated to treatment as usual, is acceptable. A randomised controlled trial of internet delivered dysarthria therapy is feasible.

Qualitative focus groups with stakeholders identify new potential outcomes related to vaccination communication

Introduction

Communication interventions are widely used to promote childhood vaccination and sustain vaccine acceptance, but communication’s role in changing people’s beliefs and behaviours is not well understood. To determine why these interventions work or where they fail, evaluations must measure a range of outcomes in addition to vaccination uptake. As part of a larger project to develop a preliminary Core Outcome Set for vaccination communication, we conducted a qualitative focus group study exploring how parents and health professionals perceive and experience communication encounters and what outcomes are relevant to them.

Methods

Focus group participants included parents and health professionals involved in vaccination communication (healthcare providers, researchers and policymakers). Participants discussed their experiences with communication for childhood vaccination, and what made the communication ‘successful’ or 'unsuccessful.'

Our analysis involved two stages: first, we thematically analysed the discussions, identifying key parent and professional themes. In stage two, we used an interpretive analysis approach to translate the themes and quotes into measurable outcomes. We compared these outcomes with outcomes measured in vaccination communication trials (previously identified and mapped).

Results

We held three focus groups with parents (n = 12) and four with professionals (n = 19). In stage one, we identified six parent themes (primarily related to decision-making) and five professional themes (primarily related to intervention planning, delivery and evaluation).

In stage two, we translated 47 outcomes from parents and 73 from professionals (91 total, de-duplicated). All stakeholders discussed attitudes or beliefs and decision-making outcomes most frequently. Most (66%) of the focus group-generated outcomes were not measured in vaccination communication trials.

Conclusion

Consulting with stakeholders through focus groups allowed us to explore how parents and professionals experienced vaccination communication, identify those aspects of the experience that were important to them, and translate these into outcomes that can be prioritised into a Core Outcome Set and measured in intervention evaluations.

The Autism Family Experience Questionnaire (AFEQ): An Ecologically-Valid, Parent-Nominated Measure of Family Experience, Quality of Life and Prioritised Outcomes for Early Intervention

There is a lack of measures that reflect the intervention priorities of parents of children with autism spectrum disorder (ASD) and that assess the impact of interventions on family experience and quality of life. The Autism Family Experience Questionnaire (AFEQ) was developed through focus groups and online consultation with parents, and reflected parental priorities. It was then administered to the parents of children enrolled in the Pre-school Autism Communication Trial and its 6-year follow-up study. The AFEQ showed good convergent validity with well-established measures of child adaptive functioning, parental mental health and parental wellbeing. It was sensitive to change in response to a parent-mediated intervention for young children with autism, showing treatment effect at treatment endpoint which increased at six-year follow-up.

Systematic review assessing the measurement properties of patient-reported outcomes for venous leg ulcers

Background

A variety of instruments have been used to assess outcomes for patients with venous leg ulcers. This study sought to identify, evaluate and recommend the most appropriate patient‐reported outcome measures (PROMs) for English‐speaking patients with venous leg ulcers.

Methods

This systematic review used a two‐stage search approach. Electronic searches of major databases including MEDLINE were completed in October 2015, and then updated in July 2016. Additional studies were identified from citation checking. Study selection, data extraction and quality assessment were undertaken independently by at least two reviewers. Evaluation and summary of measurement properties of identified PROMs were done using standard and adapted study‐relevant criteria.

Results

Ten studies with data for four generic PROMS and six condition‐specific measures were identified. No generic PROM showed adequate content and criterion validity; however, the EuroQoL Five Dimensions (EQ‐5D™), Nottingham Health Profile (NHP) and 12‐item Short‐Form Health Survey (SF‐12®) had good acceptability. In general, the EQ‐5D™ showed poor responsiveness in patients with venous leg ulcers. Most condition‐specific PROMs demonstrated poor criterion and construct validity. Overall, there was some evidence of internal consistency for the Venous Leg Ulcer Quality of Life (VLU‐QoL) and the Sheffield Preference‐based Venous Ulcer questionnaire (SPVU‐5D). Test–retest reliability was satisfactory for the Venous Leg Ulcer Self‐Efficacy Tool (VeLUSET).

Conclusion

The NHP and VLU‐QoL questionnaire seemed the most suitable PROMs for use by clinicians. However, a valid condition‐specific PROM is still required.

Systematic review of patient-reported outcome measures in patients with varicose veins

Background

Varicose veins can affect quality of life. Patient-reported outcome measures (PROMs) provide a direct report from the patient about the impact of the disease without interpretation from clinicians or anyone else. The aim of this study was to examine the quality of the psychometric evidence for PROMs used in patients with varicose veins.

Methods

A systematic review was undertaken to identify studies that reported the psychometric properties of generic and disease-specific PROMs in patients with varicose veins. Literature searches were conducted in databases including MEDLINE, up to July 2016. The psychometric criteria used to assess these studies were adapted from published recommendations in accordance with US Food and Drug Administration guidance.

Results

Nine studies were included which reported on aspects of the development and/or validation of one generic (36-Item Short Form Health Survey, SF-36®) and three disease-specific (Aberdeen Varicose Vein Questionnaire, AVVQ; Varicose Veins Symptoms Questionnaire, VVSymQ®; Specific Quality-of-life and Outcome Response – Venous, SQOR-V) PROMs. The evidence from included studies provided data to support the construct validity, test–retest reliability and responsiveness of the AVVQ. However, its content validity, including weighting of the AVVQ questions, was biased and based on the opinion of clinicians, and the instrument had poor acceptability. VVSymQ® displayed good responsiveness and acceptability rates. SF-36® was considered to have satisfactory responsiveness and internal consistency.

Conclusion

There is a scarcity of psychometric evidence for PROMs used in patients with varicose veins. These data suggest that AVVQ and SF-36® are the most rigorously evaluated PROMs in patients with varicose veins.

Defining health-related quality of life for young wheelchair users: A qualitative health economics study

BACKGROUND

Wheelchairs for children with impaired mobility provide health, developmental and psychosocial benefits, however there is limited understanding of how mobility aids affect the health-related quality of life of children with impaired mobility. Preference-based health-related quality of life outcome measures are used to calculate quality-adjusted life years; an important concept in health economics. The aim of this research was to understand how young wheelchair users and their parents define health-related quality of life in relation to mobility impairment and wheelchair use.

METHODS

The sampling frame was children with impaired mobility (≤18 years) who use a wheelchair and their parents. Data were collected through semi-structured face-to-face interviews conducted in participants' homes. Qualitative framework analysis was used to analyse the interview transcripts. An a priori thematic coding framework was developed. Emerging codes were grouped into categories, and refined into analytical themes. The data were used to build an understanding of how children with impaired mobility define health-related quality of life in relation to mobility impairment, and to assess the applicability of two standard measures of health-related quality of life.

RESULTS

Eleven children with impaired mobility and 24 parents were interviewed across 27 interviews. Participants defined mobility-related quality of life through three distinct but interrelated concepts: 1) participation and positive experiences; 2) self-worth and feeling fulfilled; 3) health and functioning. A good degree of consensus was found between child and parent responses, although there was some evidence to suggest a shift in perception of mobility-related quality of life with child age.

CONCLUSIONS

Young wheelchair users define health-related quality of life in a distinct way as a result of their mobility impairment and adaptation use. Generic, preference-based measures of health-related quality of life lack sensitivity in this population. Development of a mobility-related quality of life outcome measure for children is recommended.

Improving participation outcomes and interventions in neurodisability: co-designing future research

There is an urgent, agreed need to improve participation outcomes and interventions for children and young people with neurodisability. We worked together with service users and providers to design research into participation outcomes and interventions in neurodisability. We built on existing evidence about participation outcomes and interventions and the WHO International Classification of Functioning, Disability and Health. We: (1) specified seven participation outcome categories for measurement; (2) prioritized these for improvement: self-care, friends and social, and physical activity ranked the highest; (3) identified 11 potential intervention categories for targeting the top priority, self-care, through eight hypothesized change mechanisms and agreed for the interventions to be delivered as a 'Menu of Interventions' for personalized self-care support; and (4) designed a before-and-after mixed methods feasibility study to evaluate the Menu with children and young people (0-12 years) and their parents and therapists.

Systematic review and qualitative evidence synthesis of patient-reported outcome measures for abdominal aortic aneurysm

BACKGROUND

The aim was to identify and evaluate existing patient-reported outcome measures (PROMs) for use in patients with an abdominal aortic aneurysm (AAA) to inform the selection for use in surgical practice.

METHODS

Two reviews were conducted: a systematic review to identify valid, reliable and acceptable PROMs for patients with an AAA, and a qualitative evidence synthesis to assess the relevance to patients of the identified PROM items. PROM studies were evaluated for their psychometric properties using established assessment criteria, and for their methodological quality using the COSMIN checklist. Qualitative studies were synthesized using framework analysis, and concepts identified were then triangulated using a protocol with the item concepts of the identified PROMs.

RESULTS

Four PROMs from three studies were identified in the first review: Short Form 36, Australian Vascular Quality of Life Index, Aneurysm Dependent Quality of Life (AneurysmDQoL) and Aneurysm Symptoms Rating Questionnaire (AneurysmSRQ). None of the identified PROMs had undergone a rigorous psychometric evaluation within the AAA population. Four studies were included in the qualitative synthesis, from which 28 concepts important to patients with an AAA were identified. The AneurysmDQoL and AneurysmSRQ together provided the most comprehensive assessment of these concepts. Fear of rupture, control, ability to forget about the condition and size of aneurysm were all concepts identified in the qualitative studies but not covered by items in the identified PROMs.

CONCLUSION

Further research is needed to develop PROMs for AAA that are reliable, valid and acceptable to patients.

IMPRoving Outcomes for children exposed to domestic ViolencE (IMPROVE): an evidence synthesis

Background

Exposure to domestic violence and abuse (DVA) during childhood and adolescence increases the risk of negative outcomes across the lifespan.

Objectives

To synthesise evidence on the clinical effectiveness, cost-effectiveness and acceptability of interventions for children exposed to DVA, with the aim of making recommendations for further research.

Design

(1) A systematic review of controlled trials of interventions; (2) a systematic review of qualitative studies of participant and professional experience of interventions; (3) a network meta-analysis (NMA) of controlled trials and cost-effectiveness analysis; (4) an overview of current UK provision of interventions; and (5) consultations with young people, parents, service providers and commissioners.

Settings

North America (11), the Netherlands (1) and Israel (1) for the systematic review of controlled trials of interventions; the USA (4) and the UK (1) for the systematic review of qualitative studies of participant and professional experience of interventions; and the UK for the overview of current UK provision of interventions and consultations with young people, parents, service providers and commissioners.

Participants

A total of 1345 children for the systematic review of controlled trials of interventions; 100 children, 202 parents and 39 professionals for the systematic review of qualitative studies of participant and professional experience of interventions; and 16 young people, six parents and 20 service providers and commissioners for the consultation with young people, parents, service providers and commissioners.

Interventions

Psychotherapeutic, advocacy, parenting skills and advocacy, psychoeducation, psychoeducation and advocacy, guided self-help.

Main outcome measures

Internalising symptoms and externalising behaviour, mood, depression symptoms and diagnosis, post-traumatic stress disorder symptoms and self-esteem for the systematic review of controlled trials of interventions and NMA; views about and experience of interventions for the systematic review of qualitative studies of participant and professional experience of interventions and consultations.

Data sources

MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, EMBASE, Cochrane Central Register of Controlled Trials, Science Citation Index, Applied Social Sciences Index and Abstracts, International Bibliography of the Social Sciences, Social Services Abstracts, Social Care Online, Sociological Abstracts, Social Science Citation Index, World Health Organization trials portal and clinicaltrials.gov.

Review methods

A narrative review; a NMA and incremental cost-effectiveness analysis; and a qualitative synthesis.

Results

The evidence base on targeted interventions was small, with limited settings and types of interventions; children were mostly < 14 years of age, and there was an absence of comparative studies. The interventions evaluated in trials were mostly psychotherapeutic and psychoeducational interventions delivered to the non-abusive parent and child, usually based on the child’s exposure to DVA (not specific clinical or broader social needs). Qualitative studies largely focused on psychoeducational interventions, some of which included the abusive parent. The evidence for clinical effectiveness was as follows: 11 trials reported improvements in behavioural or mental health outcomes, with modest effect sizes but significant heterogeneity and high or unclear risk of bias. Psychoeducational group-based interventions delivered to the child were found to be more effective for improving mental health outcomes than other types of intervention. Interventions delivered to (non-abusive) parents and to children were most likely to be effective for improving behavioural outcomes. However, there is a large degree of uncertainty around comparisons, particularly with regard to mental health outcomes. In terms of evidence of cost-effectiveness, there were no economic studies of interventions. Cost-effectiveness was modelled on the basis of the NMA, estimating differences between types of interventions. The outcomes measured in trials were largely confined to children’s mental health and behavioural symptoms and disorders, although stakeholders’ concepts of success were broader, suggesting that a broader range of outcomes should be measured in trials. Group-based psychoeducational interventions delivered to children and non-abusive parents in parallel were largely acceptable to all stakeholders. There is limited evidence for the acceptability of other types of intervention. In terms of the UK evidence base and service delivery landscape, there were no UK-based trials, few qualitative studies and little widespread service evaluation. Most programmes are group-based psychoeducational interventions. However, the funding crisis in the DVA sector is significantly undermining programme delivery.

Conclusions

The evidence base regarding the acceptability, clinical effectiveness and cost-effectiveness of interventions to improve outcomes for children exposed to DVA is underdeveloped. There is an urgent need for more high-quality studies, particularly trials, that are designed to produce actionable, generalisable findings that can be implemented in real-world settings and that can inform decisions about which interventions to commission and scale. We suggest that there is a need to pause the development of new interventions and to focus on the systematic evaluation of existing programmes. With regard to the UK, we have identified three types of programme that could be justifiably prioritised for further study: psycho-education delivered to mothers and children, or children alone; parent skills training in combination with advocacy: and interventions involving the abusive parent/caregiver. We also suggest that there is need for key stakeholders to come together to explicitly identify and address the structural, practical and cultural barriers that may have hampered the development of the UK evidence base to date.

Future work recommendations

There is a need for well-designed, well-conducted and well-reported UK-based randomised controlled trials with cost-effectiveness analyses and nested qualitative studies. Development of consensus in the field about core outcome data sets is required. There is a need for further exploration of the acceptability and effectiveness of interventions for specific groups of children and young people (i.e. based on ethnicity, age, trauma exposure and clinical profile). There is also a need for an investigation of the context in which interventions are delivered, including organisational setting and the broader community context, and the evaluation of qualities, qualifications and disciplines of personnel delivering interventions. We recommend prioritisation of psychoeducational interventions and parent skills training delivered in combination with advocacy in the next phase of trials, and exploratory trials of interventions that engage both the abusive and the non-abusive parent.

Study registration

This study is registered as PROSPERO CRD42013004348 and PROSPERO CRD420130043489.

Funding

The National Institute for Health Research Public Health Research programme.

Patient-reported outcome measures in patients with peripheral arterial disease: a systematic review of psychometric properties

Background

Peripheral arterial disease (PAD) is generally associated with considerable morbidity and reduced quality of life. Patient-reported outcome measures (PROMs) provide important information about the burden of disease and impact of treatment in affected patients.

Objectives

The objective of the review was to identify and appraise studies reporting the psychometric evaluation of PROMs administered to a specified population of patients with PAD with a view to recommending suitable PROMs.

Methods

A systematic review of peer-reviewed English language articles was undertaken to identify primary studies reporting psychometric properties of PROMs in English-speaking patients with various stages of PAD. Comprehensive searches were completed up until January 2015. Study selection, data extraction and quality assessment were undertaken independently by at least two researchers. Findings were presented as tabular and narrative summaries based on accepted guidance.

Results

Psychometric evaluation of 6 generic and 7 condition-specific PROMs reported in 14 studies contributed data to the review. The frequently reported measure was the SF-36 (n = 11 studies); others included the Walking Impairment Questionnaire (n = 8 studies), EQ-5D (n = 5 studies) and the Vascular Quality of Life Questionnaire (n = 3 studies). Studies included a diverse PAD population and varied in methodology, including approach to validation of PROMs.

Conclusions

Various PROMs have been validated in patients with PAD but no study provided evidence of a full psychometric evaluation in the patient population. Careful selection is required to identify reliable and valid PROMs to use in clinical and research settings.

Electronic supplementary material

The online version of this article (doi:10.1186/s12955-016-0563-y) contains supplementary material, which is available to authorized users.

What makes for a 'good' or 'bad' paediatric diabetes service from the viewpoint of children, young people, carers and clinicians? A synthesis of qualitative findings

BACKGROUND

There is mounting evidence that experience of care is a crucial part of the pathway for successful management of long-term conditions.

DESIGN AND OBJECTIVES

To carry out (1) a systematic mapping of qualitative evidence to inform selection of studies for the second stage of the review; and (2) a narrative synthesis addressing the question, What makes for a 'good' or a 'bad' paediatric diabetes service from the viewpoint of children, young people, carers and clinicians?

RESULTS

The initial mapping identified 38 papers. From these, the findings of 20 diabetes-focused papers on the views on care of ≥650 children, parents and clinicians were synthesised. Only five studies included children under 11 years. Children and young people across all age groups valued positive, non-judgemental and relationship-based care that engaged with their social, as well as physical, health. Parents valued provision responsive to the circumstances of family life and coordinated across services. Clinicians wanting to engage with families beyond a child's immediate physical health described finding this hard to achieve in practice.

LIMITATIONS

Socioeconomic status and ethnicity were poorly reported in the included studies.

CONCLUSIONS

In dealing with diabetes, and engaging with social health in a way valued by children, parents and clinicians, not only structural change, such as more time for consultation, but new skills for reworking relations in the consultation may be required.

Meaningful health outcomes for paediatric neurodisability: Stakeholder prioritisation and appropriateness of patient reported outcome measures

BACKGROUND

Health services are increasingly focused on measuring and monitoring outcomes, particularly those that reflect patients' priorities. To be meaningful, outcomes measured should be valued by patients and carers, be consistent with what health professionals seek to achieve, and be robust in terms of measurement properties. The aim of this study was (i) to seek a shared vision between families and clinicians regarding key aspects of health as outcomes, beyond mortality and morbidity, for children with neurodisability, and (ii) to appraise which multidimensional patient reported outcome measures (PROMs) could be used to assess salient health domains.

METHODS

Relevant outcomes were identified from (i) qualitative research with children and young people with neurodisability and parent carers, (ii) Delphi survey with health professionals, and (iii) systematic review of PROMs. The International Classification of Functioning Disability and Health provided a common language to code aspects of health. A subset of stakeholders participated in a prioritisation meeting incorporating a Q-sorting task to discuss and rank aspects of health.

RESULTS

A total of 33 pertinent aspects of health were identified. Fifteen stakeholders from the qualitative and Delphi studies participated in the prioritisation meeting: 3 young people, 5 parent carers, and 7 health professionals. Aspects of health that emerged as more important for families and targets for health professionals were: communication, emotional wellbeing, pain, sleep, mobility, self-care, independence, mental health, community and social life, behaviour, toileting and safety. Whilst available PROMs measure many aspects of health in the ICF, no single PROM captures all the key domains prioritised as for children and young people with neurodisability. The paucity of scales for assessing communication was notable.

CONCLUSIONS

We propose a core suite of key outcome domains for children with neurodisability that could be used in evaluative research, audit and as health service performance indicators. Future work could appraise domain-specific PROMs for these aspects of health; a single measure assessing the key aspects of health that could be applied across paediatric neurodisability remains to be developed.

The ICF, Relationship-Centred Care and Research Outcome Measurement: Carol Frattali's Impact on Aphasia Research

Outcome measurement was a major focus of Carol Frattali's work. This article describes three aphasia research initiatives that have followed from her early publications. The first is the application of the World Health Organization (WHO) International Classification of Functioning, Disability and Health (ICF) to aphasia. The Living with Aphasia: A Framework for Outcome Measurement (A-FROM) is a reinterpretation of the ICF specifically as it applies to aphasia. The Assessment for Living with Aphasia (ALA) is an assessment that is derived from the A-FROM. The second initiative is the program of research that has described aphasia and aphasia rehabilitation from the patient perspective. Using qualitative methodologies, this research has highlighted the need for relationship-centred care in aphasia services. Finally, a current project is described that seeks to gain international consensus on a core outcome set for aphasia treatment research. This will help researchers combine data in effectiveness studies. To achieve the best outcomes for people with aphasia, there is a need to realize Carol Frattali's vision and ensure the continued use of unifying frameworks, relationship-centered practice, consumer-focused research, and consistent outcome measurement practices.

Systematic review of tools to measure outcomes for young children with autism spectrum disorder

BACKGROUND

The needs of children with autism spectrum disorder (ASD) are complex and this is reflected in the number and diversity of outcomes assessed and measurement tools used to collect evidence about children's progress. Relevant outcomes include improvement in core ASD impairments, such as communication, social awareness, sensory sensitivities and repetitiveness; skills such as social functioning and play; participation outcomes such as social inclusion; and parent and family impact.

OBJECTIVES

To examine the measurement properties of tools used to measure progress and outcomes in children with ASD up to the age of 6 years. To identify outcome areas regarded as important by people with ASD and parents.

METHODS

The MeASURe (Measurement in Autism Spectrum disorder Under Review) research collaboration included ASD experts and review methodologists. We undertook systematic review of tools used in ASD early intervention and observational studies from 1992 to 2013; systematic review, using the COSMIN checklist (Consensus-based Standards for the selection of health Measurement Instruments) of papers addressing the measurement properties of identified tools in children with ASD; and synthesis of evidence and gaps. The review design and process was informed throughout by consultation with stakeholders including parents, young people with ASD, clinicians and researchers.

RESULTS

The conceptual framework developed for the review was drawn from the International Classification of Functioning, Disability and Health, including the domains 'Impairments', 'Activity Level Indicators', 'Participation', and 'Family Measures'. In review 1, 10,154 papers were sifted - 3091 by full text - and data extracted from 184; in total, 131 tools were identified, excluding observational coding, study-specific measures and those not in English. In review 2, 2665 papers were sifted and data concerning measurement properties of 57 (43%) tools were extracted from 128 papers. Evidence for the measurement properties of the reviewed tools was combined with information about their accessibility and presentation. Twelve tools were identified as having the strongest supporting evidence, the majority measuring autism characteristics and problem behaviour. The patchy evidence and limited scope of outcomes measured mean these tools do not constitute a 'recommended battery' for use. In particular, there is little evidence that the identified tools would be good at detecting change in intervention studies. The obvious gaps in available outcome measurement include well-being and participation outcomes for children, and family quality-of-life outcomes, domains particularly valued by our informants (young people with ASD and parents).

CONCLUSIONS

This is the first systematic review of the quality and appropriateness of tools designed to monitor progress and outcomes of young children with ASD. Although it was not possible to recommend fully robust tools at this stage, the review consolidates what is known about the field and will act as a benchmark for future developments. With input from parents and other stakeholders, recommendations are made about priority targets for research.

FUTURE WORK

Priorities include development of a tool to measure child quality of life in ASD, and validation of a potential primary outcome tool for trials of early social communication intervention.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42012002223.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.