Outcome assessment in dermatology clinical trials and cochrane reviews: call for a dermatology-specific outcome taxonomy

A core domain set for pyoderma gangrenosum trial outcomes: an international eDelphi and consensus study from the UPGRADE initiative

BACKGROUND

Pyoderma gangrenosum (PG) is a rare ulcerative skin condition with no current standardized outcomes or outcome measures. With a rich investigational therapeutic pipeline, standardization of outcomes and improvement of data quality and interpretability will promote the appropriate and consistent evaluation of potential new therapies. Core outcome sets (COS) are agreed, standardized sets of outcomes that represent the minimum that should be measured and reported in all clinical trials of a specific condition.

OBJECTIVES

To identify and reach a consensus on which domains (what to be measured) should be included in the Understanding Pyoderma Gangrenosum: Review and Analysis of Disease Effects (UPGRADE) core domain set for clinical trials in PG.

METHODS

Collaborative discussions between patients and PG experts, and a systematic review of the literature identified items and prospective domains. A three-round international eDelphi exercise was performed to prioritize the domains and refine the provisional items (consensus: ≥ 70% of participants rating a domain as 'extremely important' and < 15% of participants voting 'not important'), followed by an international meeting to reach consensus on the core domain set (consensus: < 30% disagreement). Item-generation discussions and consensus meetings were hosted via online videoconferences. The eDelphi exercise and consensus voting were performed using Qualtrics survey software. Participants were adults with PG, healthcare professionals, researchers and industry representatives.

RESULTS

Collaborative discussions and systematic reviews yielded 115 items, which were distilled into 15 prospective domains. The eDelphi exercise removed the three lowest-priority domains ('laboratory tests', 'treatment costs' and 'disease impact on family') and ranked 'pain', 'quality of life' and 'physical symptoms' as the highest-priority prospective domains. Consensus was reached on the domains of 'pain', 'quality of life' and 'clinical signs'. The domain of 'disease course/disease progression' narrowly failed to reach consensus for inclusion in the core set (32% of participants voted 'no'). Refinement of this domain definition will be required and presented for consideration at future consensus meetings.

CONCLUSIONS

The UPGRADE core domain set for clinical trials in PG has been agreed by international multistakeholder consensus. Future work will develop and/or select outcome measurement instruments for these domains to establish a COS.

Protocol of a scoping review of outcome domains in dermatology

INTRODUCTION

Core outcome sets (COSs) are agreed outcomes (domains (subdomains) and instruments) that should be measured as a minimum in clinical trials or practice in certain diseases or clinical fields. Worldwide, the number of COSs is increasing and there might be conceptual overlaps of domains (subdomains) and instruments within disciplines. The aim of this scoping review is to map and to classify all outcomes identified with COS projects relating to skin diseases.

METHODS AND ANALYSIS

We will conduct a scoping review of outcomes of skin disease-related COS initiatives to identify all concepts and their definitions. We will search PubMed, Embase and Cochrane library. The search dates will be 1 January 2010 (the point at which Core Outcome Measures in Effectiveness Trials (COMET) was established) to 1 January 2024. We will also review the COMET database and C3 website to identify parts of COSs (domains and/or instruments) that are being developed and published. This review will be supplemented by querying relevant stakeholders from COS organisations, dermatology organisations and patient organisations for additional COSs that were developed. The resulting long lists of outcomes will then be mapped into conceptually similar concepts.

ETHICS AND DISSEMINATION

This study was supported by departmental research funds from the Department of Dermatology at Northwestern University. An ethics committee review was waived since this protocol was done by staff researchers with no involvement of patient care. Conflicts of interests, if any, will be addressed by replacing participants with relevant conflicts or reassigning them. The results will be disseminated through publication in peer-reviewed journals, social media posts and promotion by COS organisations.

A core outcome domain set to assess cutaneous neurofibromas related to neurofibromatosis type 1 in clinical trials

BACKGROUND

Cutaneous neurofibromas (cNF) are considered one of the highest burdens of neurofibromatosis type 1 (NF1). To date, no medical treatment can cure cNF or prevent their development. In that context, there is an urgent need to prepare and standardize the methodology of future trials targeting cNF.

OBJECTIVES

The objective was to develop a core outcome domain set suitable for all clinical trials targeting NF1-associated cNF.

METHODS

The validated approach of this work consisted of a three-phase methodology: (i) generating the domains [systematic literature review (SLR) and qualitative studies]; (ii) agreeing (three-round international e-Delphi consensus process and working groups); and (iii) voting.

RESULTS

(i) The SLR and the qualitative studies (three types of focus groups and a French e-survey with 234 participants) resulted in a preliminary list of 31 candidate items and their corresponding definitions. (ii) A total of 229 individuals from 29 countries participated in the first round of the e-Delphi process: 71 patients, relatives or representatives (31.0%), 130 healthcare professionals (HCPs, 56.8%) and 28 researchers, representatives of a drug regulatory authority, industry or pharmaceutical company representatives or journal editors (12.2%). The overall participation rate was 74%. After round 2, five candidate items were excluded. Between rounds 2 and 3, international workshops were held to better understand the disagreements among stakeholders. This phase led to the identification of 19 items as outcome subdomains. (iii) The items were fused to create four outcome domains ('clinical assessment', 'daily life impact', 'patient satisfaction' and 'perception of health') and prioritized. The seven items that did not reach consensus were marked for the research agenda. The final core outcome domain set reached 100% of the votes of the steering committee members.

CONCLUSIONS

Although numerous outcomes can be explored in studies related to cNF in NF1, the present study offers four outcome domains that should be reported in all trial studies, agreed on by international patients, relatives and representatives of patients; HCPs; researchers, representatives of drug regulatory authorities or pharmaceutical companies and journal editors. The next step will include the development of a set of core outcome measurement instruments to further standardize how these outcomes should be assessed.

The development of a core outcome set for clinical effectiveness studies of bordered foam dressings in the treatment of complex wounds

AIM

The aim of this project was to develop a core outcome set (COS) for clinical effectiveness studies of bordered foam dressings in the treatment of complex wounds.

METHODS

The research project followed the Core Outcome Measures in Effectiveness Trials (COMET) initiative and consisted of two phases. The first phase prepared the background and process, while the second phase had three steps: outcome list generation via systematic review and qualitative study, Delphi consensus study, and consensus meeting. The study has been registered in the Core Outcome Measures in Effectiveness Trials database.

RESULTS

The systematic review resulted in 82 outcomes and 20 additional outcomes were obtained during the interviews. After refinement, 111 panellists from 23 countries rated a list of 51 outcomes. In the following consensus meeting, six outcomes were prioritized to be included in the core outcome set. After the consensus meeting, a patient-reported outcome was added to the core outcome set.

CONCLUSION

The COS for evaluating the effectiveness of bordered foam dressings in treating complex wounds includes 7 outcomes: "ability to stay in place", "leakage", "pain", "dressing related periwound skin changes", "change in wound size over time", and "overall satisfaction". These identified outcomes are correlated with contemporary bioengineering testing and evaluation methods for dressing performance, which underpins the need for a close multidisciplinary collaboration to advance the field of wound dressings. The outcome 'overall satisfaction' reflects the impact of complex wounds and their treatment on a patient's daily life. The use of these outcomes is recommended to improve data synthesis and promote evidence-based practice. Future developments in COS development involve creating measurement instruments and relevant endpoints for these outcomes.

A core outcome domain set for clinical research on capillary malformations (the COSCAM project): an e-Delphi process and consensus meeting

BACKGROUND

There is limited evidence on the best available treatment options for capillary malformations (CMs), mainly due to the absence of uniform outcome measures in trials on therapies. A core outcome set (COS) enables standard reporting of trial outcomes, which facilitates comparison of treatment results.

OBJECTIVES

To develop a core outcome domain set (CDS), as part of a core outcome set (COS), for clinical research on CMs.

METHODS

Sixty-seven potentially relevant outcome subdomains were recognized based on the literature, focus group sessions, and input from the COSCAM working group. These outcome subdomains were presented in an online Delphi study to CM experts (medical specialists and authors of relevant literature) and (parents of) patients with CM (international patient associations). During three e-Delphi study rounds, the participants repeatedly scored the importance of these outcome subdomains on a seven-point Likert scale. Participants could also propose other relevant outcome subdomains. Consensus was defined as ≥ 80% agreement as to the importance of an outcome subdomain among both stakeholder groups. The CDS was finalized during an online consensus meeting.

RESULTS

In total 269 participants from 45 countries participated in the first e-Delphi study round. Of these, 106 were CM experts from 32 countries, made up predominantly of dermatologists (59%) and plastic surgeons (18%). Moreover, 163 (parents of) patients with CM from 28 countries participated, of whom 58% had Sturge-Weber syndrome. During the two subsequent e-Delphi study rounds, 189 and 148 participants participated, respectively. After the entire consensus process, consensus was reached on 11 outcome subdomains: colour/redness, thickness, noticeability, distortion of anatomical structures, glaucoma, overall health-related quality of life, emotional functioning, social functioning, tolerability of intervention, patient satisfaction with treatment results, and recurrence.

CONCLUSIONS

We recommend the CDS to be used as a minimum reporting standard in all future trials of CM therapy. Our next step will be to select suitable outcome measurement instruments to score the core outcome subdomains. What is already known about this topic? Besides physical and functional sequelae, capillary malformations (CMs) often cause emotional and social burden. The lack of uniform outcome measures obstructs proper evaluation and comparison of treatment strategies. As a result, there is limited evidence on the best available treatment options. The development of a core outcome set (COS) may improve standardized reporting of trial outcomes. What does this study add? A core outcome domain set (CDS), as part of a COS, was developed for clinical research on CMs. International consensus was reached on the recommended core outcome subdomains to be measured in CM trials: colour/redness, thickness, noticeability, distortion of anatomical structures, glaucoma, overall health-related quality of life, emotional functioning, social functioning, tolerability of intervention, patient satisfaction with treatment results, and recurrence. This CDS enables the next step in the development of a COS, namely to reach consensus on the core outcome measurement instruments to score the core outcome subdomains. What are the clinical implications of this work? The obtained CDS will facilitate standardized reporting of treatment outcomes, thereby enabling proper comparison of treatment results. This comparison is likely to provide more reliable information for patients about the best available treatment options.

The “Understanding Pyoderma Gangrenosum, Review and Assessment of Disease Effects (UPGRADE)” Project: a protocol for the development of the core outcome domain set for trials in pyoderma gangrenosum

INTRODUCTION

Pyoderma gangrenosum (PG) is a rare neutrophilic dermatosis that affects approximately 0.3-6 out of every 100,000 people worldwide. Clinical trials are scarce but there is growing interest in using newer and more targeted therapeutics to achieve disease remission. However, there are no standardized instruments to measure outcomes in PG and, therefore, future clinical trials are hampered by the absence of established and accurate means of assessment and comparison. Therefore, we aim to produce an internationally accepted core outcome set (COS) that will overcome this obstacle. This protocol outlines our intended approach to achieve the first part of this process, establishing a core outcome domain set.

METHODS

An international team of PG stakeholders, consisting of physicians, wound care nurses, patients, scientists and industry representatives, has been assembled for the purpose of building a comprehensive and universally established set of core outcome domains. During the first step, we will generate items of relevance using a nominal process from all stakeholders. Items will be distilled and collapsed into potential domains and subdomains. A systematic review of current methods for reporting PG has already been published and domains identified in this work will be considered in the generation of the core domains set. During the second step, after the potential domains and subdomains are identified, stakeholders will participate in an e-Delphi exercise to rate the importance of (sub)domains. A final consensus meeting will be organized with the goal of establishing a core domain set.

CONCLUSION

Pyoderma gangrenosum lacks an established COS and previously published clinical trials have used inconsistent measures established from similarly inconsistent domains. As a first step this study seeks to create a core domain set within the COS, to build the foundation for future core outcome work for PG.

Core outcomes for pressure ulcer prevention trials: results of an international consensus study

BACKGROUND

There is substantial heterogeneity between trial outcomes in pressure ulcer prevention research. The development of core outcome sets (COS) is one strategy to improve comparability between trial results and thus increase the quality of evidence.

OBJECTIVES

The aim of this study was to identify core outcomes for pressure ulcer prevention trials.

METHODS

A workshop was held with service users to discuss their views and understanding of the outcomes identified by a scoping review and to identify any missing outcomes. In a next step a Delphi survey comprising three rounds was conducted to evaluate a compiled list of outcomes by their importance. Afterwards the preselection from the Delphi survey was discussed in a virtual consensus meeting with the aim of agreeing on a final set of core outcomes. Individuals who had completed all three rounds of the Delphi survey were eligible to participate in this meeting. Participants included practitioners, service users, researchers and industry representatives.

RESULTS

The workshop did not reveal any missing outcomes, but the need for further efforts to make lay people understand what an outcome is in a study setting. The Delphi survey took place between December 2020 and June 2021. After the three rounds, 18 out of 37 presented outcomes were rated to be critically important. In the following consensus meeting six outcomes were prioritized to be included in the COS for pressure ulcer prevention trials: (1) pressure ulcer occurrence, (2) pressure ulcer precursor signs and symptoms, (3) mobility, (4) acceptability and comfort of intervention, (5) adherence/compliance and (6) adverse events/safety.

CONCLUSION

Based on a comprehensive list of outcomes in pressure ulcer prevention research, there was clear agreement on the six identified core outcomes in three international Delphi rounds and in the consensus meeting. Although outcome measurement instruments need to be identified next, the six identified core outcomes should already be considered in future trials, as service users, practitioners, researchers and industry representatives have agreed that they are critically important.

Protocol for development of a core outcome set for clinical trials in melasma

INTRODUCTION

Melasma is a pigmentation disorder of the skin. Characterised by brown to gray-brown patches on the face and neck, the condition predominantly affects women and has been associated with pregnancy, hormonal variation and sun exposure. Melasma can be disfiguring and anxiety-provoking, and quality of life is often adversely impacted. Management includes sun protection, laser and energy device therapy, topical and oral skin-bleaching agents and chemical peels. While clinical trials of melasma exist, there is a lack of consistency in reported outcomes, which has been a barrier to the aggregation of data in systematic reviews and meta-analyses. This protocol describes a planned process for development of a minimum set of outcomes (ie, 'core outcome set') that should be measured in all clinical trials of melasma.

METHODS AND ANALYSIS

An exhaustive list of potential outcomes will be extracted from four sources: (1) systematic literature review of outcomes in clinical trials; (2) semistructured patient interviews; (3) brochures, pamphlets, clinical trial registries, and other published and unpublished sources and documentation; and (4) interviews with non-patient, non-physician stakeholders, including federal regulators, industry scientists and non-physician providers. An international two-round Delphi process will then be performed to identify the outcomes deemed most important to patients and physicians. Subsequently, a consensus meeting will be convened to review and process the results, and to vote on a final set of core outcomes.

ETHICS AND DISSEMINATION

Ethics approval was provided by the Northwestern University Institutional Review Board (protocol ID: STU00201637). This study is registered with both the Core Outcome Measures in Effectiveness Trials and Cochrane Skin-Core Outcome Set Initiative initiatives, and this protocol is in accordance with the guidelines for protocol development of both groups. All findings from the study described in this protocol will be disseminated to all stakeholders involved in the development process and will be submitted for publication in peer-reviewed journals.

PROSPERO REGISTRATION NUMBER

CRD42020214189.

Development of a core outcome domain set for clinical research on capillary malformations (the COSCAM project)

Background

Due to a large variety in treatment outcomes reported in therapeutic trials and lacking patient‐relevant outcomes, it is hard to adequately compare and improve current therapies for patients with capillary malformations (CMs). The Core Outcome Set for Capillary Malformations (COSCAM) project aims to develop a core outcome set (COS) for use in future CM trials, in which we will first develop a core outcome (sub)domain set (CDS). Here, we describe the methods for the development of a CDS and present the results of the first development stage.

Methods

The COSCAM project is carried out according to the recommendations of the Cochrane Skin Core OUtcomes Set INitiative (CS‐COUSIN) and the Core Outcome Measures in Effectiveness Trials (COMET) initiative. During the first stage, we identified all potentially relevant outcome subdomains based on a systematic review, two focus group sessions and input from patient representatives of Dutch patient organizations and the COSCAM‐founding group. In stage two, we will present the subdomains in a three‐round e‐Delphi study and online consensus meeting, in which CM patients, parents/caregivers and CM experts worldwide rate the importance of the proposed subdomains, hereby finalizing the core outcome (sub)domains of the CDS.

Results

A total of 67 potential outcome subdomains were included; sixteen were previously used in the literature, 20 were proposed by Dutch patients and their parents/caregivers (n = 13) in focus group sessions and 38 were suggested by the experts of the COSCAM‐founding group. Seven were excluded because of overlap.

Conclusion

The final CDS may serve as a minimum standard in future CM trials, thereby facilitating adequate comparison of treatment outcomes. After this CDS development, we will select appropriate outcome measurement instruments to measure the core outcome subdomains.

Postinflammatory hyperpigmentation: protocol for development of a core outcome set for clinical trials

Postinflammatory hyperpigmentation (PIH) is a disorder of pigmentation that is a common presenting complaint, especially in individuals with skin of color. It is associated with a significant psychological burden and decrement of quality of life. Management options include photoprotection, topical lightening agents, and lasers and energy devices. Clinical trials of melasma report a diversity of outcomes, which often impedes synthesis of results across trials, or comparison of results associated with different treatment modalities. This protocol describes the design of a consensus process that would culminate in the development of a core set of outcomes to be assessed in all clinical trials for PIH. A long list of candidate outcomes will be developed through a systematic review, combined with semi-structured interviews with various stakeholders, including patients, scientists, regulators, and health care professionals. This long list of outcomes will be reviewed and refined by a steering committee. Then two rounds of Delphi surveys of patient and physician groups, respectively, will be used to cull the list, with provisional inclusion of those items deemed "important" by 70% of the respondents. A consensus meeting will be held virtually or in person to vote on these items, and also to consider any changes necessary before acceptance of a final core outcome set. Development of a core outcome set for PIH is expected to improve and standardize outcomes reporting in current and future clinical trials. This, in turn, may facilitate aggregation of research results and permit comparison of outcomes across multiple studies.

Outcome assessment in dermatology: a tree in need of pruning

Linked article: T. Lange et al. J Eur Acad Dermatol Venereol 2021; 35: 523–535. https://doi.org/10.1111/jdv.16854.