Delphi methodology in healthcare research: How to decide its appropriateness

Proposal for a physiotherapy assessment form for the evaluation of women patients with uro-gynecological disorders: A Delphi study

BACKGROUND

The correct selection of treatment techniques and methods in physiotherapy depends directly on a well-structured anamnesis, examination and assessment. Within urogynecological and obstetric physiotherapy there is no standardized and protocolized assessment that allows to follow established steps. For all this, the main objective of this study was to identify the assessment items that should be included in the a physiotherapeutic uro-gynecological assessment.

METHODS

Delphi study through a group of experts. Prior to this, a systematic search was carried out, accompanied by a review of grey literature, to obtain the possible items to be included in the forms. Subsequently, a Delphi study with two consecutive rounds of questionnaires was developed. A total of 6 expert physiotherapists participated in the study.

RESULTS

The initial questionnaire had 97 items and after two rounds one item was eliminated to obtain a total of 96 items in the final questionnaire.

CONCLUSIONS

The experts agreed on most of the choices and finally obtained a standardized and protocolized assessment in uro-gynecological physiotherapy. Furthermore, this proposal should be considered by other professionals involved in the process of evaluation and treatment of pelvi-perineal alterations.

Consensus on acute behavioural disturbance in the UK: a multidisciplinary modified Delphi study to determine what it is and how it should be managed

BACKGROUND

Acute behavioural disturbance (ABD) is a term used in law enforcement and healthcare, but there is a lack of clarity regarding its meaning. Common language should be used across staff groups to support the identification, prioritisation and delivery of care to this group of patients. The terminology currently used is inconsistent and confusing. This study aimed to reach a consensus on the criteria for identification and management of ABD, and to agree when other care pathways or guidelines might be more appropriately used.

METHODS

A modified Delphi study with participation from stakeholder organisation representatives was conducted in January-April 2023 online. In round 1, statements were generated by participants in response to broad questions. Participants then rated their level of agreement with statements in subsequent rounds, with statements achieving a consensus removed for inclusion in the final derived consensus statement. Non-consensus statement responses were assessed for stability.

RESULTS

Of 430 unique statements presented for rating, 266 achieved a consensus among 30 participants representing eight stakeholder organisations. A derived consensus statement was generated from these statements. The median group response to statements which failed to achieve a consensus was reliable (Krippendorff's alpha=0·67).

CONCLUSIONS

There is a consensus across stakeholder organisations that ABD is not a separate entity to agitation, and guidance should instead be altered to address the full range of presentations of agitation. While the features of concern in this severely agitated group of patients can be described, the advice for recognition may vary depending on staff group. Criteria for recognition are provided and potential new terminology is described.

Development of Quality Indicators for the Ultrasound Department through a Modified Delphi Method

This study aims to establish precise quality indicators for evaluating and enhancing ultrasound performance, employing a methodology based on a comprehensive review of the literature, expert insights, and practical application experiences. We conducted a thorough review of both the domestic and international literature on ultrasound quality control to identify potential indicators. A dedicated team was formed to oversee the complete indicator development process. Utilizing a three-round modified Delphi method, we sought expert opinions through personalized email correspondence. Subsequently, data from diverse hospital indicators were collected to validate and assess feasibility. A novel set of seven indicators was compiled initially, followed by the convening of a 36-member nationally representative expert panel. After three rounds of meticulous revisions, consensus was reached on 13 indicators across three domains. These finalized indicators underwent application in various hospital settings, demonstrating their initial validity and feasibility. The development of thirteen ultrasound quality indicators represents a significant milestone in evaluating ultrasound performance. These indicators empower hospitals to monitor changes in quality effectively, fostering efficient quality management practices.

A sociotechnical framework to assess patient-facing eHealth tools: results of a modified Delphi process

Among the thousands of eHealth tools available, the vast majority do not get past pilot phases because they cannot prove value, and only a few have been systematically assessed. Although multiple eHealth assessment frameworks have been developed, these efforts face multiple challenges. This study aimed to address some of these challenges by validating and refining an initial list of 55 assessment criteria based on previous frameworks through a two-round modified Delphi process with in-between rounds of interviews. The expert panel (n = 57) included participants from 18 countries and 9 concerned parties. A consensus was reached on 46 criteria that were classified into foundational and contextual criteria. The 36 foundational criteria focus on evaluating the eHealth tool itself and were grouped into nine clusters: technical aspects, clinical utility and safety, usability and human centricity, functionality, content, data management, endorsement, maintenance, and developer. The 10 contextual criteria focus on evaluating the factors that vary depending on the context the tool is being evaluated for and were grouped into seven clusters: data-protection compliance, safety regulatory compliance, interoperability and data integration, cultural requirements, affordability, cost-benefit, and implementability. The classification of criteria into foundational and contextual helps us assess not only the quality of an isolated tool, but also its potential fit in a specific setting. Criteria subscales may be particularly relevant when determining the strengths and weaknesses of the tool being evaluated. This granularity enables different concerned parties to make informed decisions about which tools to consider according to their specific needs and priorities.

Building bridges of excellence: a comprehensive competence framework for nurses in hospice and palliative care-a mixed method study

BACKGROUND

Hospice and Palliative Care (HPC) is in high demand in China; however, the country is facing the shortage of qualified HPC nurses. A well-suited competence framework is needed to promote HPC human resource development. Nevertheless, existing unstandardized single-structured frameworks may not be sufficient to meet this need. This study aimed at constructing a comprehensive multi-structured HPC competence framework for nurses.

METHODS

This study employed a mixed-method approach, including a systematic review and qualitative interview for HPC competence profile extraction, a two-round Delphi survey to determine the competences for the framework, and a cross-sectional study for framework structure exploration. The competence profiles were extracted from publications from academic databases and interviews recruiting nurses working in the HPC field. The research team synthesized profiles and transferred them to competences utilizing existing competence dictionaries. These synthesized competences were then subjected to Delphi expert panels to determine the framework elements. The study analyzed theoretical structure of the framework through exploratory factor analysis (EFA) based on a cross-sectional study receiving 491 valid questionnaires.

RESULTS

The systematic review involved 30 publications from 10 countries between 1995 and 2021, while 13 nurses from three hospitals were interviewed. In total, 87 and 48 competence profiles were respectively extracted from systematic review and interview and later synthesized into 32 competences. After the Delphi survey, 25 competences were incorporated into the HPC competence framework for nurses. The EFA found a two-factor structure, with factor 1 comprising 18 competences namely Basic Competences; factor 2 concluding 7 competences namely Developmental Competences.

CONCLUSIONS

The two-factor HPC competence framework provided valuable insights into the need and directions of Chinese HPC nurses' development.

Consensus building on definitions and types of child maltreatment to improve recording and surveillance in Europe: protocol for a multi-sectoral, European, electronic Delphi study

INTRODUCTION

Child maltreatment (CM) is a complex global public health issue with potentially devastating effects on individuals' physical and mental health and well-being throughout the life course. A lack of uniform definitions hinders attempts to identify, measure, respond to, and prevent CM. The aim of this electronic Delphi (e-Delphi) study is to build consensus on definitions and types of CM for use in surveillance and multi-sectoral research in the 34 countries in the Euro-CAN (Multi-Sectoral Responses to Child Abuse and Neglect in Europe) project (COST Action CA19106).

METHODS AND ANALYSIS

The e-Delphi study will consist of a maximum of three rounds conducted using an online data collection platform. A multi-disciplinary expert panel consisting of researchers, child protection professionals (health and social care), police, legal professionals and adult survivors of CM will be purposefully recruited. We will approach approximately 100 experts, with between 50 and 60 of these anticipated to take part. Participants will rate their agreement with a range of statements relating to operational definitions and types of CM, and free-text comments on each of the statements to give further detail about their responses and areas of uncertainty. Consensus has been defined a priori as ≥70% of the panel agreeing or disagreeing with the statement after the final round. The responses to the open-ended questions will be analysed using a 'codebook' approach to thematic analysis, and used to refine the statements between rounds where no consensus is reached.

ETHICS AND DISSEMINATION

Ethical approval has been granted from the Cardiff University School of Medicine ethics committee (reference number SMREC22/96). Results will be submitted for publication in a peer-reviewed journal and presented at workshops (including for the participants) and international academic conferences. The Euro-CAN network will also be used to disseminate the results, with results briefings and presentations to key public health and other relevant organisations in the field.

Healthy sleep practices for shift workers: consensus sleep hygiene guidelines using a Delphi methodology

STUDY OBJECTIVES

The unique requirements of shift work, such as sleeping and working at variable times, mean that current sleep hygiene guidelines may be inappropriate for shift workers. Current guidelines may also contradict fatigue management advice (e.g. advising against daytime napping). The present study utilized a Delphi methodology to determine expert opinion regarding the applicability of current guidelines for shift workers, the appropriateness of the term "sleep hygiene," and develop tailored guidelines for shift workers.

METHODS

The research team reviewed current guidelines and existing evidence to draft tailored guidelines. Seventeen individual guidelines, covering sleep scheduling, napping, sleep environment, bedtime routine, substances, light exposure, diet, and exercise were drafted. Experts from sleep, shift work, and occupational health fields (n = 155) were invited to review the draft guidelines using a Delphi methodology. In each round, experts voted on individual guidelines, with 70% agreement considered consensus. Where consensus was not reached, written feedback from experts was discussed and incorporated into subsequent iterations.

RESULTS

Of the experts invited, 68 (44%) agreed to participate, with 55 (35%) completing the third (final) round. Most experts (84%) agreed that tailored guidelines were required for shift workers. Consensus was reached on all guidelines after three rounds. One additional guideline (sleep inertia) and an introductory statement were developed, resulting in a final set of 18 individual guidelines, termed "healthy sleep practices for shift workers."

CONCLUSIONS

This is the first study to develop tailored sleep hygiene guidelines for shift workers. Future research should investigate the acceptability and effectiveness of these guidelines amongst shift workers.

Interventions to promote cost-effectiveness in adult intensive care units: consensus statement and considerations for best practice from a multidisciplinary and multinational eDelphi study

BACKGROUND

There is limited evidence to guide interventions that promote cost-effectiveness in adult intensive care units (ICU). The aim of this consensus statement is to identify globally applicable interventions for best ICU practice and provide guidance for judicious use of resources.

METHODS

A three-round modified online Delphi process, using a web-based platform, sought consensus from 61 multidisciplinary ICU experts (physicians, nurses, allied health, administrators) from 21 countries. Round 1 was qualitative to ascertain opinions on cost-effectiveness criteria based on four key domains of high-value healthcare (foundational elements; infrastructure fundamentals; care delivery priorities; reliability and feedback). Round 2 was qualitative and quantitative, while round 3 was quantitative to reiterate and establish criteria. Both rounds 2 and 3 utilized a five-point Likert scale for voting. Consensus was considered when > 70% of the experts voted for a proposed intervention. Thereafter, the steering committee endorsed interventions that were identified as 'critical' by more than 50% of steering committee members. These interventions and experts' comments were summarized as final considerations for best practice.

RESULTS

At the conclusion of round 3, consensus was obtained on 50 best practice considerations for cost-effectiveness in adult ICU. Finally, the steering committee endorsed 9 'critical' best practice considerations. This included adoption of a multidisciplinary ICU model of care, focus on staff training and competency assessment, ongoing quality audits, thus ensuring high quality of critical care services whether within or outside the four walls of ICUs, implementation of a dynamic staff roster, multidisciplinary approach to implementing end-of-life care, early mobilization and promoting international consensus efforts on the Green ICU concept.

CONCLUSIONS

This Delphi study with international experts resulted in 9 consensus statements and best practice considerations promoting cost-effectiveness in adult ICUs. Stakeholders (government bodies, professional societies) must lead the efforts to identify locally applicable specifics while working within these best practice considerations with the available resources.

Development of a Tool to Determine Excellence in the Provision of Physical Therapist Clinical Education: A Modified Delphi Study

OBJECTIVE

The purpose of this study was to create a Site of Excellence in Clinical Education (SECE-PT) tool with the essential criteria used to determine excellence in the provision of physical therapist clinical education at a clinical site using a consensus-building approach.

METHODS

The development of the SECE-PT tool was divided into 2 parts. Part 1 involved the development of an initial set of proposed criteria, whereas part 2 employed a modified Delphi approach for consensus building. Purposive selection and snowball sampling techniques were used to recruit clinical instructors, recent graduates, site coordinators of clinical education, and directors of clinical education who met the inclusion criteria for the modified Delphi study. Three web-based survey rounds were used to achieve consensus, defined as a mean score of ≥7 on the 11-point Likert scale. The first round gathered demographic information on participants and collected information about clarity and redundancy in the criteria provided, the second gathered information once again about clarity and redundancy on the revised criteria provided, and the third asked participants to rate how essential it was for a site of excellence to demonstrate each of the final criteria.

RESULTS

A total of 123 participants, equally representing clinical and academic perspectives, completed the demographic survey and round 1. Ninety-four participants completed round 2, and 80 participants completed the third and final round. Consensus revealed that 44 criteria were deemed essential for a SECE-PT to demonstrate.

CONCLUSION

This study provides a measure to evaluate clinical sites providing clinical education. The SECE-PT tool should be widely adopted to evaluate the quality of the clinical site providing the education to student physical therapists.

IMPACT

The SECE-PT tool can be used by clinical sites for self-assessment to examine aspects of their clinical education programs and determine whether parts of their program should be further developed. This can provide a framework for discussion and collaboration between clinical and academic partners, as well as regional consortia.

Developing Ethics and Equity Principles, Terms, and Engagement Tools to Advance Health Equity and Researcher Diversity in AI and Machine Learning: Modified Delphi Approach

BACKGROUND

Artificial intelligence (AI) and machine learning (ML) technology design and development continues to be rapid, despite major limitations in its current form as a practice and discipline to address all sociohumanitarian issues and complexities. From these limitations emerges an imperative to strengthen AI and ML literacy in underserved communities and build a more diverse AI and ML design and development workforce engaged in health research.

OBJECTIVE

AI and ML has the potential to account for and assess a variety of factors that contribute to health and disease and to improve prevention, diagnosis, and therapy. Here, we describe recent activities within the Artificial Intelligence/Machine Learning Consortium to Advance Health Equity and Researcher Diversity (AIM-AHEAD) Ethics and Equity Workgroup (EEWG) that led to the development of deliverables that will help put ethics and fairness at the forefront of AI and ML applications to build equity in biomedical research, education, and health care.

METHODS

The AIM-AHEAD EEWG was created in 2021 with 3 cochairs and 51 members in year 1 and 2 cochairs and ~40 members in year 2. Members in both years included AIM-AHEAD principal investigators, coinvestigators, leadership fellows, and research fellows. The EEWG used a modified Delphi approach using polling, ranking, and other exercises to facilitate discussions around tangible steps, key terms, and definitions needed to ensure that ethics and fairness are at the forefront of AI and ML applications to build equity in biomedical research, education, and health care.

RESULTS

The EEWG developed a set of ethics and equity principles, a glossary, and an interview guide. The ethics and equity principles comprise 5 core principles, each with subparts, which articulate best practices for working with stakeholders from historically and presently underrepresented communities. The glossary contains 12 terms and definitions, with particular emphasis on optimal development, refinement, and implementation of AI and ML in health equity research. To accompany the glossary, the EEWG developed a concept relationship diagram that describes the logical flow of and relationship between the definitional concepts. Lastly, the interview guide provides questions that can be used or adapted to garner stakeholder and community perspectives on the principles and glossary.

CONCLUSIONS

Ongoing engagement is needed around our principles and glossary to identify and predict potential limitations in their uses in AI and ML research settings, especially for institutions with limited resources. This requires time, careful consideration, and honest discussions around what classifies an engagement incentive as meaningful to support and sustain their full engagement. By slowing down to meet historically and presently underresourced institutions and communities where they are and where they are capable of engaging and competing, there is higher potential to achieve needed diversity, ethics, and equity in AI and ML implementation in health research.

Development of a nutritional screening and assessment indicator system for patients with esophageal cancer in China: Findings from the Delphi method

BACKGROUND

In China, individuals diagnosed with esophageal cancer are confronted with an elevated risk of nutritional inadequacy or malnutrition throughout the course of their disease, a condition that contributes to various adverse clinical outcomes. A vast corpus of data are burgeoning at an unprecedented rate, primarily due to the revolutionary growth of digitalization technologies and artificial intelligence, notably within the domains of health care and medicine. The purpose of this investigation is to initiate the development of a nutritional screening and assessment indicator framework for patients with esophageal cancer within the Chinese context. We seek to furnish an instrumental reference to facilitate preparations for the forthcoming era of advanced, "deep," evidence-based medicine.

METHODS

An integrative methodology was employed to forge the preliminary draft of the nutritional screening and assessment indicator system for preoperative patients with esophageal cancer. This encompassed a rigorous literature survey, in-depth clinical practice investigation, and the facilitation of expert panel discussions. Thereafter, two iterative consultation phases were conducted using the Delphi method in China. The analytic hierarchy process was deployed to ascertain the weighting of each index within the definitive evaluation indicator system.

RESULTS

The effective response rates for the dual rounds of expert consultation were 91.7% and 86.4%, with commensurate authority coefficients of 0.97 and 0.91. The Kendall harmony coefficients were ascertained to be 0.19 and 0.14 (p < 0.01), respectively. The culminating nutritional screening and assessment indicator system for patients with esophageal cancer comprised 5 primary-level indicators and 38 secondary-level indicators.

CONCLUSIONS

The nutritional screening and assessment indicator system contrived for patients with esophageal cancer is underpinned by cogent theoretical principles, leverages an astute research methodology, and manifests dependable outcomes. This system may be appositely utilized as a meaningful reference for the nutritional screening and assessment process in patients afflicted with esophageal cancer.

Current treatment landscape of HR+/HER2- advanced breast cancer in the Nordics: a modified Delphi study

BACKGROUND

This Delphi study aimed to assess current perspectives on hormone receptor-positive/human epidermal growth factor receptor 2-negative(HR+/HER2-) advanced breast cancer (aBC) treatment strategies across the Nordics, and to establish where consensus exists across the Nordics on HR+/HER2- aBC treatment.

MATERIAL AND METHODS

A modified, three-round Delphi method was followed. A steering committee was appointed for study coordination, panellist selection, and questionnaire development. The questionnaires covered relevant topics on HR+/HER2- aBC treatment: treatment patterns in different lines of therapy (first [1L], second [2L], and third [3L]), oligometastatic disease, de novo aBC, brain metastases, age as influential factor, visceral crisis, radiotherapy, diagnostics, and clinical guidelines. Both open and closed-ended questions were included. Consensus was defined as at least 70% agreement.

RESULTS

In total, 28 experienced BC oncologists participated in the study from all five Nordic countries. Overall, topics reaching consensus included: preferred treatment approach in 1L and 2L therapy, treatment of oligometastatic disease, visceral crisis, brain metastases, and age-related treatment considerations. No consensus was reached for 3L therapy and local treatment for primary tumour in de novo aBC. Endocrine therapy (ET) combined with a cyclin-dependent kinase (CDK)4/6 inhibitor was the treatment of choice for 1L and 2L therapy. Treatment patterns in clinical practice did not always follow recommendations in current Nordic guidelines, as seen in the case of recently approved treatments.

DISCUSSION

ET in combination with a CDK4/6 inhibitor is the preferred frontline treatment for HR+/HER2- aBC in the Nordics. The observed discrepancy between current guidelines and clinical practice could be due to differences in the reimbursement of novel treatments in the Nordics. Collaborative research efforts are warranted for topics that lack consensus.

Crisis Scenarios for Simulation-Based Nontechnical Skills Training for Cardiac Surgery Teams: A National Survey Among Cardiac Anesthesiologists, Cardiac Surgeons, Clinical Perfusionists, and Cardiac Operating Room Nurses

BACKGROUND

Nontechnical skills in cardiac surgery are vital in ensuring patient safety in the operating room (OR). To train these skills in a simulation-based scenario, a collection of commonly accepted crisis scenarios is needed to serve as a framework for a simulation-based training program.

OBJECTIVE

The objective of this study was to identify and reach consensus on a collection of relevant crisis scenarios in cardiac surgery suitable for simulation-based team training focusing on nontechnical skills.

METHODS

Using the Delphi method, a national assessment was performed among cardiac surgeons, cardiac anesthesiologists, clinical perfusionists, and cardiac OR nurses in the Netherlands. In the first Delphi round, potential crisis scenarios for simulation-based team training in cardiac surgery were identified. In the second round, the identified scenarios were rated using a 5-point Likert scale. Finally, based on consensus (two-thirds majority), scenarios were prioritized and explored for feasibility.

RESULTS

One hundred fourteen experts participated in the study (26 cardiac anesthesiologists, 24 cardiac surgeons, 25 clinical perfusionists, and 39 OR nurses), representing all 16 cardiac surgical centers in the Netherlands. In the first round, 237 scenarios were identified. After eliminating duplicates and grouping similar scenarios, 44 scenarios were scored in round 2, which finally resulted in 13 relevant crisis scenarios with an expert consensus higher than 67%.

CONCLUSIONS

Thirteen crisis scenarios relevant to simulation-based team training were identified by an expert panel consisting of all members of the cardiac surgical team. Further research is needed to evaluate the educational value of the respective scenarios.

Defining Sentinel Injuries of Suspected Child Abuse by Age Using International Classification of Diseases-10: A Delphi Study

OBJECTIVE

To address child abuse effectively requires accurate assessment of the magnitude of the problem. Although it is difficult to assess the scale of child abuse cases nationwide, it can be estimated through the incidence of sentinel injuries, which are defined as minor but unusual injuries such as bruises or wounds in children of precruising age. Therefore, this study aimed to define disease codes for sentinel injuries by age as a preliminary study to elucidate the incidence of sentinel injuries among patients who visited hospitals nationwide.

METHOD

This study was designed using the Delphi method with a structured questionnaire. An extensive literature review was conducted to develop the questionnaire. The 9 participants selected as experts in child abuse were all experienced pediatric emergency medicine specialists working at pediatric emergency medicine training hospitals in South Korea, and 8 participants responded to the first survey. The Delphi method comprised 3 rounds of online surveys using Google Forms and Excel sheet questionnaire via e-mail. Only questions that achieved consensus were selected and assigned a sentinel injury disease code.

RESULTS

In total, 105 questions regarding the definition of sentinel injury disease codes were surveyed as to whether they should be included as sentinel injuries, categorized by type (bruises, burns, open wounds/lacerations, and others) and anatomical location. Among them, 5 (62.5%) or more participants agreed on 92 items.

CONCLUSIONS

Using the Delphi method, we defined disease codes for sentinel injuries in children aged younger than 12 months, possibly enabling assessment of the incidence of child abuse based on national data. Future research is needed to validate this result and investigate the incidence of sentinel injuries using the defined disease codes and to determine their association with actual cases of child abuse.

Validating a framework to guide the implementation of high-quality virtual primary care: an international eDelphi study protocol

BACKGROUND

There is an urgent need to support primary care organisations in implementing safe and high-quality virtual consultations. We have previously performed qualitative research to capture the views of 1600 primary care physicians across 20 countries on the main benefits and challenges of using virtual consultations. Subsequently, a prototype of a framework to guide the implementation of high-quality virtual primary care was developed.

AIM

To explore general practitioners' perspectives on the appropriateness and relevance of each component of the framework's prototype, to further refine it and optimise its practical use in primary care facilities.

METHODS AND ANALYSIS

Participants will be primary care physicians with active experience providing virtual care, recruited through convenience and snowball sampling. This study will use a systematic and iterative online Delphi research approach (eDelphi), with a minimum of three rounds. A pre-round will be used to circulate items for initial feedback and adjustment. In subsequent rounds, participants will be asked to rate the relevance of the framework's components. Consensus will be defined as >70% of participants agreeing/strongly agreeing or disagreeing/strongly disagreeing with a component. Data will be collected using structured online questionnaires. The primary outcome of the study will be a list of the essential components to be incorporated in the final version of the framework.

ETHICS AND DISSEMINATION

The study has received ethical approval conceded by the Imperial College London Science, Engineering and Technology Research Ethics Committee (SETREC) (reference no .6559176/2023). Anonymous results will be made available to the public, academic organisations and policymakers.

Setting research priorities for prevention and response to child marriage in communities in the Arab region: findings from a multi-stage Delphi study involving practitioners across the region

Globally, more than 12 million girls under the age of 18 are forced to marry every year. Progress on ending child marriage in the Arab region is slowing, and risks being reversed, due to an increase in conflict-affected populations and widespread economic crisis. The aim of this paper is to consider the research priorities across the region to inform effective and accelerated child marriage prevention and response programming within the Arab region. Seventy-three specialists supporting child marriage prevention and response programming in the Arab region engaged with up to three phases of an online Delphi consultation process on research gaps and the research environment between July 2019 and December 2021. Proposals of research gaps were elicited, reviewed, and rated by participants to confirm a shared learning agenda. Participants identified 50 different research gaps across 7 main areas, reaching a high level of consensus support for 23 of 50 statements. Clear consensus was reached in relation to an increased need to produce and use evidence to support programme development, and further research on specific drivers and consequences of child marriage. The least consensus was found in relation to how research can inform prevention and response efforts within the law and legal system. The results provide the foundation of a child marriage research agenda for the Arab region which takes into account regional distinctiveness and builds on the global momentum for child marriage research. Mechanisms are in place to do this through the Regional Action Forum, and other networks across the region.

[Measures and Recommendations for Ensuring Adequate Inpatient Care Capacities for Pandemic Management within a Region: Results of a Hybrid Delphi Method]

INTRODUCTION

Since the beginning of the pandemic in spring 2020, inpatient healthcare has been under enormous burden, which is reflected especially in overworked staff, imprecise bed planning and/or data transfer. According to the recommendation of the Science Council, university clinics should play a controlling role in regional healthcare and act in conjunction with surrounding hospitals and practices.

METHODS

In September 2021, 31 representatives from 18 university hospitals were invited to a hybrid Delphi study with a total of 4 survey rounds to discuss criteria for effective inpatient care in a pandemic situation, which were extracted from previous expert interviews. Criteria that were classified as very important/relevant by≥75% of the participants in the first round of the survey (consensus definition) were then further summarized in 4 different small groups. In a third Delphi round, all participants came together again to discuss the results of the small group discussions. Subsequently, these were prioritized as Optional ("can"), Desirable ("should") or Necessary ("must") recommendations.

RESULTS

Of the invited clinical experts, 21 (67.7%) participated in at least one Delphi round. In an online survey (1st Delphi round), 233 criteria were agreed upon and reduced to 84 criteria for future pandemic management in four thematic small group discussions (2nd Delphi round) and divided into the small groups as follows: "Crisis Management and Crisis Plans" (n=20), "Human Resources Management and Internal Communication" (n=16), "Regional Integration and External Communication" (n=24) and "Capacity Management and Case & Care" (n=24). In the following group discussion (3rd Delphi round), the criteria were further modified and agreed upon by the experts, so that in the end result, there were 23 essential requirements and recommendations for effective inpatient care in a pandemic situation.

CONCLUSION

The results draw attention to key demands of clinical representatives, for example, comprehensive digitization, standardization of processes and better (supra) regional networking in order to be able to guarantee needs-based care even under pandemic conditions. The present consensus recommendations can serve as guidelines for future pandemic management in the inpatient care sector.

Management of Children With Uncomplicated Cellulitis in Emergency and Hospital Settings

OBJECTIVE

The aim of the study is to establish consensus recommendations on features used to determine the route of antibiotic administration and disposition for children with uncomplicated cellulitis.

METHODS

Modified Delphi methodology was performed with 2 rounds of confidential surveys of Emergency medicine and hospital medicine (HM) providers at Lurie Children's Hospital to assess cellulitis management in children (ages 6 months-18 years) without signs of sepsis or abscess formation. Using a 9-point Likert scale, emergency medicine providers ranked features by perceived level of importance when deciding initial antibiotic route and HM providers ranked features on importance when transitioning to oral antibiotics. Responses were grouped as not important (1-3), neutral (4-6), and important (7-9) and re-evaluated in the second round to reach consensus, defined as ≥70% agreement.

RESULTS

Emergency medicine providers (n = 17) reached consensus on 15 of 16 features (93.8%), 10 deemed important. Participants reached greatest consensus (100%) on fevers/chills, lymphangitis, and functional impairment as considerations for initiating intravenous antibiotics. HM providers (n = 15) reached consensus on 9 of 11 factors (81.8%), with 7 considered important when deciding on readiness for oral antibiotics. Providers indicated that stability, rather than reduction, of erythematous margins is sufficient to consider transition and de-escalation of therapy at less than 24 hours if all other clinical improvement criteria are met.

CONCLUSIONS

This study achieved consensus on important features for treatment and disposition of children with uncomplicated cellulitis in both emergency and inpatient contexts. These features have the potential to aid in decision making and improve standardization of clinical practice.

SAVE Testis-sparing score: a multicenter retrospective study of a novel predictive tool for quantifying testicular tumors

BACKGROUND

Testis-sparing surgery (TSS) is a safe treatment for patients with benign testicular tumors. Presently, assessments for evaluating the suitability of TSS are poorly standardized, partially because testicular anatomical elements cannot be quantitatively described.

MATERIALS AND METHODS

The authors developed a scoring method known as the SAVE testis-sparing score based on four critical and accessible anatomical features of a testicular tumor. The SAVE score ranges from 0 to 8 and is divided into four risk classes ( low , medium , high , and extremely high ) to evaluate the feasibility of TSS, wherein low-risk indicates high feasibility and vice versa. This study included 444 testicular tumor patients from eight centers. Among them, 216 patients (model group: 151 patients, validation group: 65 patients) were included in the modeling analysis, and the other 228 patients from children's centers were included in the proportion analysis. Using retrospective data, patient characteristics associated with surgical methods were identified. Furthermore, a multivariate logistic regression model was built quantify the associations between these characteristics and the surgery method. The receiver operator characteristic curve was used to evaluate the classification efficiency of SAVE.

RESULTS

The SAVE testis-sparing score includes size (tumor size as maximal diameter), available testicular tissue volume, volume ratio of the tumor to the testis, and the exophytic / endophytic properties of the tumor. The SAVE scoring system accurately classified the suitability of TSS based on the complexity of benign testicular tumors.

CONCLUSION

The SAVE score is a reproducible and robust tool for quantitatively describing the anatomical characteristics of benign testicular tumors and guide the preoperative evaluation of TSS.

Pediatric Tracheostomy Emergency Readiness Assessment Tool: International Consensus Recommendations

OBJECTIVE

To achieve consensus on critical steps and create an assessment tool for actual and simulated pediatric tracheostomy emergencies that incorporates human and systems factors along with tracheostomy-specific steps.

METHODS

A modified Delphi method was used. Using REDCap software, an instrument comprising 29 potential items was circulated to 171 tracheostomy and simulation experts. Consensus criteria were determined a priori with a goal of consolidating and ordering 15 to 25 final items. In the first round, items were rated as "keep" or "remove". In the second and third rounds, experts were asked to rate the importance of each item on a 9-point Likert scale. Items were refined in subsequent iterations based on analysis of results and respondents' comments.

RESULTS

The response rates were 125/171 (73.1%) for the first round, 111/125 (88.8%) for the second round, and 109/125 (87.2%) for the third round. 133 comments were incorporated. Consensus (>60% participants scoring ≥8, or mean score >7.5) was reached on 22 items distributed across three domains. There were 12, 4, and 6 items in the domains of tracheostomy-specific steps, team and personnel factors, and equipment respectively.

CONCLUSIONS

The resultant assessment tool can be used to assess both tracheostomy-specific steps as well as systems factors affecting hospital team response to simulated and clinical pediatric tracheostomy emergencies. The tool can also be used to guide debriefing discussions of both simulated and clinical emergencies, and to spur quality improvement initiatives.

LEVEL OF EVIDENCE

5 Laryngoscope, 133:3588-3601, 2023.

Severe Asthma Network Italy Definition of Clinical Remission in Severe Asthma: A Delphi Consensus

Severe asthma affects about 10% of the population with asthma and is characterized by low lung function and a high count of blood leukocytes, mainly eosinophils. Various definitions are used in clinical practice and in the literature to identify asthma remission: clinical remission, inflammatory remission, and complete remission. This work highlights a consensus for asthma remission using a Delphi method. In the context of the Severe Asthma Network Italy, which accounts for 57 severe asthma centers and more than 2,200 patients, a board of six experts drafted a list of candidate statements in a questionnaire, which has been revised to minimize redundancies and ensure clear and consistent wording for the first round (R1) of the analysis. Thirty-two statements were included in the R1 questionnaire and then submitted to a panel of 80 experts, which used a 5-point Likert scale to measure agreement regarding each statement. Then, an interim analysis of R1 data was performed, and items were discussed and considered to produce a consistent questionnaire for round 2 (R2) of the analysis. Then, the board set the R2 questionnaire, which included only important topics. Panelists were asked to vote on the statements in the R2 questionnaire afterward. During R2, the criteria of complete clinical remission (the absence of the need for oral corticosteroids, symptoms, exacerbations or attacks, and pulmonary function stability) and those of partial clinical remission (the absence of the need for oral corticosteroids, and two of three criteria: the absence of symptoms, exacerbations or attacks, and pulmonary stability) were confirmed. This Severe Asthma Network Italy Delphi analysis defined a valuable and independent tool that is easy to use, to test the efficacy of different treatments in patients with severe asthma enrolled into the SANI registry.

Orthopedics and Traumatology Skill Matrix for Musculoskeletal System Approach by Medical Graduates

Objective  This study aimed to build a matrix of orthopedics and traumatology skills focusing on the musculoskeletal system for graduates of a medical course in Brazil. Methods  The study used the e-Delphi methodology to retrieve opinions anonymously. The first proposal included 42 items determined at a bibliographical review and their epidemiological relevance. This proposal was available via Google Forms, and we sent it using the instant messaging application WhatsApp. We grouped the panel of 26 specialists into three categories: Orthopedics and Traumatology professors, Primary Care doctors, and Emergency Physicians. We reached a consensus after three rounds, with at least 75% agreement between the items initially presented. We also considered the following four indicators: prerequisite, essential, desirable, and advanced skills. Results  We created a matrix with 34 musculoskeletal system-related skills, including diagnostic and management actions for all age groups. Conclusion  We devised a skill matrix in Orthopedics and Traumatology for medical graduation for complete or partial use according to the institutional curriculum.

Management of psoriatic arthritis: a consensus opinion by expert rheumatologists

Background

Psoriatic arthritis (PsA) is a chronic inflammatory musculoskeletal disease involving several articular and extra-articular structures. Despite the important progresses recently made in all of the aspects of this disease, its management is still burdened by unresolved issues. The aim of this exercise was to provide a set of statements that may be helpful for the management of PsA.

Methods

A group of 38 Italian rheumatologists with recognized expertise in PsA selected and addressed the following four topics: "early PsA," "axial-PsA," "extra-articular manifestations and comorbidities," "therapeutic goals." Relevant articles from the literature (2016-2022) were selected by the experts based on a PubMed search. A number of statements for each topic were elaborated.

Results

Ninety-four articles were selected and evaluated, 68 out of the 1,114 yielded by the literature search and 26 added by the Authors. Each of the four topic was subdivided in themes as follows: transition from psoriasis to PsA, imaging vs. CASPAR criteria in early diagnosis, early treatment for "early PsA"; axial-PsA vs. axialspondyloarthritis, diagnosis, clinical evaluation, treatment, standard radiography vs. magnetic resonance imaging for "axial PsA"; influence of inflammatory bowel disease on the therapeutic choice, cardiovascular comorbidity, bone damage, risk of infection for "comorbidities and extra-articular manifestations"; target and tools, treat-to-target strategy, role of imaging for "therapeutic goals." The final document consisted of 49 statements.

Discussion

The final product of this exercise is a set of statements concerning the main issues of PsA management offering an expert opinion for some unmet needs of this complex disease.

Defining the pathway to timely diagnosis and treatment of interstitial lung disease: a US Delphi survey

INTRODUCTION

Timely diagnosis of interstitial lung disease (ILD) is limited by obstacles in the current patient pathway. Misdiagnosis and delays are common and may lead to a significant burden of diagnostic procedures and worse outcomes. This Delphi survey aimed to identify consensus on the key steps that facilitate the patient journey to an accurate ILD diagnosis and appropriate management in the US.

METHODS

A modified Delphi analysis was conducted, comprising three online surveys based on a comprehensive literature search. The surveys spanned five domains (guidelines, community screening, diagnosis, management and specialist referral) and were completed by a panel of US physicians, including primary care physicians and pulmonologists practising in community or academic settings. A priori definitions of consensus agreement were median scores of 2-3 (agree strongly/agree), with an IQR of 0-1 for questions on a 7-point Likert scale from -3 to 3, or ≥80% agreement for binary questions.

RESULTS

Forty-nine panellists completed the surveys and 62 statements reached consensus agreement. There was consensus agreement on what should be included in the primary care evaluation of patients with suspected ILD and the next steps following workup. Regarding diagnosis in community pulmonology care, consensus agreement was reached on the requisition and reporting of high-resolution CT scans and the appropriate circumstances for holding multidisciplinary discussions. Additionally, there was consensus agreement on which symptoms and comorbidities should be monitored, the frequency of consultations and the assessment of disease progression. Regarding specialist referral, consensus agreement was reached on which patients should receive priority access to ILD centres and the contents of the referral package.

CONCLUSIONS

These findings clarify the most common issues that should merit further evaluation for ILD and help define the steps for timely, accurate diagnosis and appropriate collaborative specialty management of patients with ILD.

Mapping a comprehensive assessment tool to a holistic definition of health for person-centred care planning in home care: a modified eDelphi study

BACKGROUND

Researchers in the Netherlands proposed the Pillars for Positive Health (PPH) as a broadly encompassing health definition to support more realistic and meaningful care planning for people living with chronic disease and other life-long health conditions. The PPH was subsequently converted to the My Positive Health (MPH) spider web visualization tool. This study sought to identify opportunities for more person-centred care planning at the point of care in home care, using the MPH tool as a framework to link comprehensive assessment and dialogue-based goal-setting.

METHODS

A modified eDelphi method was used to conduct domain mapping with a purposively sampled expert panel (n = 25). The panel consisted of researchers, health care providers, older adults and caregivers. A two-stage eDelphi process was conducted, with each stage consisting of three survey rounds. In the first stage, participants were asked to map 201 elements of the interRAI Home Care (interRAI HC) comprehensive assessment tool to the six MPH domains or "No pillar of best fit". The second stage focused on identifying opportunities to adapt or expand comprehensive assessment as it relates to the MPH domains.

RESULTS

In Stage 1, 189 of 201 elements reached consensus in domain mapping. These included: 80 elements for Bodily Functions, 32 for Daily Functioning, 32 for Mental Wellbeing, 24 for Quality of Life, 10 for Participation, and 1 for Meaningfulness. Ten elements were identified to have no pillar of best fit. The 12 elements that did not reach consensus in Stage 1 formed the basis for Stage 2, where expert panel participants proposed four new assessment elements in Meaningfulness and Participation and 11 additional descriptors across the six MPH domains. Of these, two elements and nine of the 11 descriptors reached consensus.

CONCLUSION

Findings show that elements of the interRAI HC are oriented toward the physical, functional, and mental health domains. Consequently, complementary assessment elements and/or tools may be needed to support comprehensive assessment of 'Meaningfulness' and 'Participation' in person-centred home and community care. Additional descriptors may also be needed to aid communication regarding the understanding and application of MPH domains.

Expert Consensus on Comprehensive Early Rhythm Control in Addition to Guideline-Based Care for Atrial Fibrillation: A Modified Delphi Survey

Atrial fibrillation (AF) practice guidelines recommend a rhythm-control strategy to improve symptoms and quality of life, noting the side effects of antiarrhythmic drugs and catheter ablation. Emerging evidence indicates that comprehensive early rhythm control with antiarrhythmic drugs or catheter ablation is associated with a lower risk of adverse cardiovascular outcomes versus the usual care. Using an online modified Delphi survey approach, perspectives and expert consensus among electrophysiologists were examined through a series of ranking and likelihood questions around treatment decision-making on (1) the use of comprehensive early rhythm-control strategies in patients with AF based on guidelines and emerging research and (2) treatment selection factors. A panel of 17 electrophysiologists reached a consensus on using early rhythm control (median 90, interquartile range 14) based on the view that early intervention improved cardiovascular outcomes (mean rank 1.6 of 3, 82% within 1 SD) and symptoms (1.8 of 3, 41%). AF-related symptoms were identified as the most important in making a treatment initiation decision (1.1 of 7, 88%), followed by AF type (2.5 of 7, 82%). Participants were most likely to initiate treatment at AF symptom onset (median 80; interquartile range 6). In making treatment selection decisions, participants ranked short-term/long-term safety (1.9 of 7, 88%) and efficacy (1.8 of 7, 53%) as the top 2 considerations. In conclusion, experts were in favor of early rhythm control; however, additional research is needed to address the role that early rhythm-control strategies play in current AF treatment management algorithms.

How Much Dialogic Coordination Practices Matter to Healthcare Professionals-A Delphi Approach towards a Tool for Identification and Measurement

The study of coordination practices in health policy is a central aspect. The need for further research has been recently highlighted because of COVID-19. In this sense, dialogic practices (DP) have been identified but not validated yet. The purpose of this study is to develop and validate a DP questionnaire for healthcare teams. Items were identified based on a literature review, and the content validation was carried out by means of a Delphi study. A total of 10 experts assessed the clarity and appropriateness of the items and their corresponding measurement scales. After two rounds, a high level of consensus was reached, with agreement of 90% or higher on all items, and a high degree of stability and concordance in the results. This study resulted in a questionnaire consisting of four items, one for each identified DP initially proposed to the experts, as no other practices were revealed. From a practical perspective, the validation of these items constitutes a methodological innovation that responds to the call in the literature to open new avenues for comparative studies, and the possibility of generalising the findings and bringing together different approaches to the problem of coordination, which is key in health policy where unforeseen situations emerge.

Cultural Adaptation of the Actionable Health App Evaluation in Japan: Protocol for a Web-Based Modified Delphi Expert Consensus Study

BACKGROUND

With an increase in both the number of mental health disorders people are experiencing and the difficulty in accessing mental health care, the demand for accessible mental health care services has increased. The use of mobile devices has allowed people to receive care in their daily lives without restrictions on time or location. However, the majority of publicly available mobile health apps are not evidence-based, and the top-rated apps are not always safe or user-friendly and may not offer clinically beneficial results.

OBJECTIVE

This study aims to create a cultural adaptation of the American Psychiatric Association's comprehensive app evaluation framework in Japan using a web-based modified Delphi expert consensus.

METHODS

A web-based modified Delphi study includes developing the Japanese version of the comprehensive app evaluation framework and 3 Delphi rounds. In the first round, our working group sends a questionnaire to the panelists, who then complete it. In the second and third rounds, the working group sends a questionnaire and a summary of the panelists' answers based on each of the previous rounds. The panelists answer the questionnaires based on this summary. The summarization procedure is automated to help reduce the biases that can be generated when panelists' answers are summarized and when the panelists receive them. The working group sends only the result of the summarization with the next round's questionnaire. All interactions between the working group and the panelists will be conducted on Qualtrics (Qualtrics Japan LLC), a questionnaire platform. To culturally validate the comprehensive mental health app evaluation framework, participants from the following three categories will be recruited in Japan: (1) researchers, (2) practitioners, and (3) app developers.

RESULTS

This study received funding from a crowdfunding campaign in Japan (April 2023). The Delphi study began in January 2023 and will be completed in December 2023. We had already completed the translation of the 105 original app evaluation item questions by December 2022.

CONCLUSIONS

While the need for treatment using mental health apps is increasing, no framework that can be used to develop a centralized database for health apps is available or accessible, and no consensus has been reached among stakeholders in Japan about an appropriate framework. The results of the web-based modified Delphi method presented in this paper may provide direction for the development and use of mental health apps in the future among the relevant stakeholders. Furthermore, this study will enhance recognition of the framework among researchers, clinicians, mental health app developers, and users, in addition to devising new instruments to help users or practitioners efficiently choose the right app for their situations.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/44469.

Development of a Scoring Tool for Australian Rural Food Retail Environments

Current tools scoring the healthiness of food retail outlets do not reflect outlets found in rural locations. This study aimed to adapt pre-existing Australian scoring tools to represent non-metropolitan areas. Rural nutrition experts were identified, and a modified Delphi technique was used to adapt two pre-existing, food-scoring tools in five iterative stages. Stages included identifying all relevant outlets, providing a description and score for each, ensuring consistency between outlet scores and pre-existing, metro-centric tools, and providing instructions for correct use. Six rural nutrition experts were identified and engaged in the modified Delphi technique. The final tool consisted of 12 categories of food outlets and listed 35 individual outlets. Consistent with pre-existing Australian tools, scores ranged from +10 to -10 and included descriptions reflective of rural retail outlets. Scores were based on whether the majority of foods offered within the outlet were consistent with foods recommended in national health guidelines. The developed tool was designed to accommodate the diverse nature of food retail outlets found in non-metropolitan areas. This study assists in explaining the link between the food environment and health in populations living rurally.

Expert Consensus on SABA Use for Asthma Clinical Decision-Making: A Delphi Approach

PURPOSE OF REVIEW

A modified Delphi process was undertaken to provide a US expert-led consensus to guide clinical action on short-acting beta2-agonist (SABA) use. This comprised an online survey (Phase 1), forum discussion and statement development (Phase 2), and statement adjudication (Phase 3).

RECENT FINDINGS

In Phase 1 (n = 100 clinicians), 12% routinely provided patients with ≥4 SABA prescriptions/year, 73% solicited SABA use frequency at every patient visit, and 21% did not consult asthma guidelines/expert reports. Phase 3 experts (n = 8) reached consensus (median Likert score, interquartile range) that use of ≥3 SABA canisters/year is associated with increased risk of exacerbation and asthma-related death (5, 4.75-5); SABA use history should be solicited at every patient visit (5, 4.75-5); usage patterns over time, not absolute thresholds, should guide response to SABA overuse (5, 4.5-5). Future asthma guidelines should include clear recommendations regarding SABA usage, using expert-led thresholds for action.

The MoXFo Initiative: Using consensus methodology to move forward towards internationally shared vocabulary in multiple sclerosis exercise research

BACKGROUND

Multiple sclerosis (MS) exercise terminology lacks consistency across disciplines, hindering research synthesis.

OBJECTIVE

The 'Moving exercise research in MS forward initiative' (MoXFo) aims to establish agreed definitions for key MS exercise terms.

METHODS

The Lexicon development methodology was employed. A three-step process identified key exercise terminology for people with multiple sclerosis (pwMS): (1) consensus and systematic review, (2) Delphi round 1 and consideration of existing definitions and (3) Delphi round 2 for consensus among MoXFo steering group and exercise experts. Final definitions and style harmonisation were agreed upon.

RESULTS

The two-stage Delphi process resulted in the selection and scoring of 30 terminology definitions. The agreement was 100% for resistance exercise, balance and physical activity. Most terms had agreement >75%, but 'posture' (60%) and 'exercise' (65%) had a lower agreement.

CONCLUSION

This study identified key terms and obtained agreement on definitions for 30 terms. The variability in agreement for some terms supports the need for clearly referencing or defining terminology within publications to enable clear communication across disciplines and to support precise synthesis and accurate interpretation of research.

A survey of United States obstetric anesthesiologists' perceived value of obstetric anesthesiology fellowship

INTRODUCTION

Subspecialty training in obstetric anesthesiology is associated with improved patient outcomes and reduced anesthesia-related morbidity and mortality. Despite this, the demand for fellowship-trained obstetric anesthesiologists far exceeds the supply. This survey study aimed to evaluate the perceived value of obstetric anesthesiology subspecialty training on career trajectory, job satisfaction, quality of life, and job autonomy.

METHODS

After Institutional Review Board approval, we conducted a cross-sectional study of fellowship-trained obstetric anesthesiologists in the United States of America. In March and April 2022, program directors of obstetric anesthesiology fellowships distributed an electronic survey link containing 29 multiple-choice questions to their program alumni. Survey content included respondent demographic characteristics, practice models, career information, and perceived value of an obstetric anesthesiology fellowship.

RESULTS

We surveyed 217/502 (43%) fellowship-trained obstetric anesthesiologists with a response rate of 158/217 (73%). Most worked in urban, academic, and level IV perinatal health centers. The majority believed an obstetric anesthesiology fellowship was "extremely beneficial" (77%), enhanced quality of life (84%), improved the quality of patient care (99%), and was influential in helping obtain their first post-training job (86%). The perceived value of the fellowship included an enhanced career trajectory, a sense of purpose, improved job satisfaction, a sense of work community, lower burnout, involvement in maternal health initiatives, increased mentorship, and departmental leadership.

CONCLUSION

In this survey study, fellowship-trained obstetric anesthesiologists perceived a positive impact of fellowship training on career trajectory, job protection and autonomy, quality of life, and job satisfaction. This information may be meaningful to trainees considering pursuing a fellowship and a career in obstetric anesthesiology.

Expert consensus on training and accreditation for extracorporeal cardiopulmonary resuscitation an international, multidisciplinary modified Delphi Study

BACKGROUND

A multidisciplinary group of stakeholders were used to identify: (1) the core competencies of a training program required to perform in-hospital ECPR initiation (2) additional competencies required to perform pre-hospital ECPR initiation and; (3) the optimal training method and maintenance protocol for delivering an ECPR program.

METHODS

A modified Delphi process was undertaken utilising two web based survey rounds and one virtual meeting. Experts rated the importance of different aspects of ECPR training, competency and governance on a 9-point Likert scale. A diverse, representative group was targeted. Consensus was achieved when greater than 70% respondents rated a domain as critical (> or = 7 on the 9 point Likert scale).

RESULTS

35 international ECPR experts from 9 countries formed the expert panel, with a median number of 14 years of ECMO practice (interquartile range 11-38). Participant response rates were 97% (survey round one), 63% (virtual meeting) and 100% (survey round two). After the second round of the survey, 47 consensus statements were formed outlining a core set of competencies required for ECPR provision. We identified key elements required to safely train and perform ECPR including skill pre-requisites, surrogate skill identification, the importance of competency-based assessment over volume of practice and competency requirements for successful ECPR practice and skill maintenance.

CONCLUSIONS

We present a series of core competencies, training requirements and ongoing governance protocols to guide safe ECPR implementation. These findings can be used to develop training syllabus and guide minimum standards for competency as the growth of ECPR practitioners continues.

Delphi expert consensus for whole slide imaging in thyroid cytopathology

OBJECTIVE

Despite an increase in thyroid fine needle aspiration (FNA) and advances in whole slide imaging (WSI) adoption, digital pathology is still considered inadequate for primary diagnosis of these cases. Herein, we aim to validate the utility of WSI in thyroid FNAs employing the Delphi method strategy.

METHODS

A panel of experts from seven reference cytology centres was recruited. The study consisted of two consecutive rounds: (1) an open-ended, free-response questionnaire generating a list of survey items; and (2) a consensus analysis of 80 selected shared WSIs from 80 cases by six investigators answering six morphological questions utilising a 1 to 5 Likert scale.

RESULTS

High consensus was achieved for all parameters, with an overall average score of 4.27. The broad majority of items (84%) were ranked either 4 or 5 by each physician. Two badly scanned cases were responsible for more than half of the low-ranked (≤2) values (57%). Good to excellent (≥3) diagnostic confidence was reached in more than 95.2% of cases. For most cases (78%) WSI assessment was not limited by technical issues linked to the image acquisition process.

CONCLUSION

This systematic Delphi study indicates broad consensus among participating physicians on the application of DP to thyroid cytopathology, supporting expert opinion that WSI is reliable and safe for primary diagnostic purposes.

Historical Insights and Current Perspectives on the Diagnosis and Management of Presymptomatic Type 1 Diabetes

Objective: The article provides practical guidance for (1) interpreting and confirming islet autoantibody screening results for type 1 diabetes (T1D) and (2) follow-up of individuals with early stages of T1D with the goal of ensuring medical safety and providing patients and their families with an assessment of risk for progression to a clinical diagnosis of T1D. Research Design and Methods: We used an explicit a priori methodology to identify areas of agreement and disagreement in how to manage patients with early T1D. We used a modified Delphi method, which is a systematic, iterative approach to identifying consensus. We developed a list of topic questions, ranked them by importance, and developed consensus statements based on available evidence and expert opinion around each of the 30 topic questions consistently ranked as being most important. Results: Consensus statements for screening and monitoring are supported with figures proposing an algorithm for confirmation of T1D diagnosis and management of early T1D until clinical diagnosis. Conclusions: Disseminating and increasing knowledge related to how to interpret T1D screening tests, confirm early T1D diagnosis and monitor for medical safety and clinical disease risk prediction is critically important as there are currently no clinical recommendations. Published guidance will promote better management of T1D screening-detected individuals.

What should all health professionals know about movement behaviour change? An international Delphi-based consensus statement

The WHO has called for action to integrate physical activity promotion into healthcare settings, yet there is a lack of consensus on the competencies required by health professionals to deliver effective movement behaviour change support. The objective of this study was to establish key competencies relevant for all health professionals to support individuals to change their movement behaviours. Consensus was obtained using a three-phase Delphi process. Participants with expertise in physical activity and sedentary behaviour were asked to report what knowledge, skills and attributes they believed health professionals should possess in relation to movement behaviour change. Proposed competencies were developed and rated for importance. Participants were asked to indicate agreement for inclusion, with consensus defined as group level agreement of at least 80%. Participants from 11 countries, working in academic (55%), clinical (30%) or combined academic/clinical (13%) roles reached consensus on 11 competencies across 3 rounds (n=40, n=36 and n=34, respectively). Some competencies considered specific to certain disciplines did not qualify for inclusion. Participants agreed that health professionals should recognise, take ownership of, and practise interprofessional collaboration in supporting movement behaviour change; support positive culture around these behaviours; communicate using person-centred approaches that consider determinants, barriers and facilitators of movement behaviours; explain the health impacts of these behaviours; and recognise how their own behaviour influences movement behaviour change support. This consensus defines 11 competencies for health professionals, which may serve as a catalyst for building a culture of advocacy for movement behaviour change across health disciplines.

Initiating Evaluation of Composite Outcome Measures for Psoriatic Arthritis: 2022 Updates From the GRAPPA-OMERACT Working Group

The Group for Research and Assessment of Psoriasis and Psoriatic Arthritis (GRAPPA)-Outcome Measures in Rheumatology (OMERACT) Psoriatic Arthritis (PsA) working group-comprising rheumatologists, dermatologists, methodologists, and patient research partners-provided updates at the GRAPPA 2022 annual meeting on its work to evaluate composite outcome measures for PsA. Ten composite outcome measures were considered. Initial steps were to define the population, the purpose of use, and the proposed pros and cons of the 10 candidate composite instruments for PsA. Preliminary Delphi exercises within the working group and GRAPPA stakeholders confirmed high priority for evaluating minimal disease activity (MDA); moderate priority for Disease Activity in PsA (DAPSA), American College of Rheumatology (ACR) response criteria, Psoriatic Arthritis Disease Activity Score (PASDAS), Composite Psoriatic Disease Activity Index (CPDAI), 3 visual analog scale (VAS), and 4VAS; and low priority for Disease Activity Score in 28 joints (DAS28), Psoriatic Arthritis Responder Criteria (PsARC), and Routine Assessment of Patient Index Data 3 (RAPID3). Further appraisal of candidate composite instruments is ongoing.

Addressing the Pediatric Mental Health Crisis in Emergency Departments in the US: Findings of a National Pediatric Boarding Consensus Panel

BACKGROUND

In 2021, several professional organizations declared a national state of emergency in child and adolescent mental health. Rising volume and acuity of pediatric mental health emergencies, coupled with reduced access to inpatient psychiatric care, has caused tremendous downstream pressures on EDs resulting in long lengths of stay, or "boarding", for youth awaiting psychiatric admission. Nationally, boarding times are highly heterogeneous, with medical / surgical patients experiencing much shorter boarding times compared to patients with primary mental health needs. There is little guidance on best practices in the care of the pediatric patient with significant mental health need "boarding" in the hospital setting.

OBJECTIVE

There is a significant increase in the practice of "boarding" pediatric patients within emergency departments and inpatient medical floors while awaiting psychiatric admission. This study aims to provide consensus guidelines for the clinical care of this population.

METHODS

Twenty-three panel participants of fifty-five initial participants (response rate 41.8%) committed to completing four successive rounds of questioning using Delphi consensus gathering methodology. Most (70%) were child psychiatrists and represented 17 health systems.

RESULTS

Thirteen participants (56%) recommended maintaining boarded patients in the emergency department, while 78% indicated a temporal limit on boarding in the emergency department should prompt transfer to an inpatient pediatric floor. Of this group, 65% recommended a 24-hour threshold. Most participants (87%) recommended not caring for pediatric patients in the same space as adults. There was unanimous agreement that emergency medicine or hospitalists maintain primary ownership of patient care, while 91% agreed that child psychiatry should maintain a consultative role. Access to social work was deemed most important for staffing, followed by behavioral health nursing, psychiatrists, child life, rehabilitative services, and lastly, learning specialists. There was unanimous consensus that daily evaluation is necessary with 79% indicating vitals should be obtained every 12 hours. All agreed that if a child psychiatric provider is not available on-site, a virtual consultation is sufficient to provide mental health assessment.

CONCLUSIONS

This study highlights findings of the first national consensus panel regarding the care of youth boarding in hospital-based settings and provides promising beginnings to standardizing clinical practice while informing future research efforts.

Evaluating Rural Health Disparities in Colombia: Identifying Barriers and Strategies to Advancing Refugee Health

Health disparities within rural communities, notably those affecting migrant and refugee populations, are well-documented. Refugees often grapple with high disease burdens and mortality rates due to limited access to primary healthcare and their vulnerable socio-economic and political situations. This issue is particularly acute in the rural areas around Medellin, Colombia, where the refugee influx exacerbates the existing public health challenges. Studies highlight a substantial gap between community needs and public health policies, resulting in inadequate healthcare access. Our study, utilizing the Delphi technique, aimed to identify common barriers and strategies to enhance rural healthcare for refugees. Through consensus-building with community leaders, we identified six primary barriers to healthcare access and five barriers to healthcare quality. Community leaders endorsed five strategies to address the access barriers and eight strategies to improve healthcare quality. This research provides valuable insights for optimizing resource allocation and designing effective support programs for these vulnerable populations.

Development of a Malaysian potentially inappropriate prescribing screening tool in older adults (MALPIP): a Delphi study

INTRODUCTION

Polypharmacy and potentially inappropriate medications (PIM) are common among older adults. To guide appropriate prescribing, healthcare professionals often rely on explicit criteria to identify and deprescribe inappropriate medications, or to start medications due to prescribing omission. However, most explicit PIM criteria were developed with inadequate guidance from quality metrics or integrating real-world data, which are rich and valuable data source.

AIM

To develop a list of medications to facilitate appropriate prescribing among older adults.

METHODS

A preliminary list of PIM and potential prescribing omission (PPO) were generated from systematic review, supplemented with local pharmacovigilance data of adverse reaction incidents among older people. Twenty-one experts from nine specialties participated in two Delphi to determine the list of PIM and PPO in February and March 2023. Items that did not reach consensus after the second Delphi round were adjudicated by six geriatricians.

RESULTS

The preliminary list included 406 potential candidates, categorised into three sections: PIM independent of diseases, disease dependent PIM and omitted drugs that could be restarted. At the end of Delphi, 92 items were decided as PIM, including medication classes, such as antacids, laxatives, antithrombotics, antihypertensives, hormones, analgesics, antipsychotics, antidepressants, and antihistamines. Forty-two disease-specific PIM criteria were included, covering circulatory system, nervous system, gastrointestinal system, genitourinary system, and respiratory system. Consensus to start potentially omitted treatment was achieved in 35 statements across nine domains.

CONCLUSIONS

The newly developed PIM criteria can serve as a useful tool to guide clinicians and pharmacists in identifying PIMs and PPOs during medication review and facilitating informed decision-making for appropriate prescribing.

Developing a framework for regular and sustainable qualitative assessment of antibiotic use in Korean medical institutions: a Delphi study

BACKGROUND

We aimed to develop a roadmap for conducting regular, sustainable, and strategic qualitative assessments of antibiotic use in medical institutions within the Republic of Korea.

METHODS

A literature review on the current state of qualitative antibiotic assessments was conducted, followed by one open round to collect ideas, two scoring rounds to establish consensus, and one panel meeting between them. The expert panel comprised 20 experts in infectious disease or antibiotic stewardship.

RESULTS

The response rate for all three surveys was 95% (19/20), while the panel meeting attendance rate was 90% (18/20). The following long-term goals were defined to assess the annual use of antibacterial and antifungal agents in all medical institutions, including clinics. The panel agreed that random sampling of antibiotic prescriptions was the most suitable method of selecting antibiotics for qualitative assessment, with the additional possibility of evaluating specific antibiotics or infectious diseases that warrant closer evaluation for promoting appropriate antibiotic use. The plan for utilization of results from evaluation involves providing feedback while maintaining anonymity and disclosure. It includes a quantitative assessment of antibiotic prescriptions and resistance rates to compare against institutional benchmarks. Furthermore, it was agreed to link the evaluation findings to the national antibiotic stewardship programme, enabling policy and institutional approaches to address frequently misused items, identified during the evaluation.

CONCLUSION

This study provides a framework for establishing a qualitative assessment of antimicrobial use for medical institutions at a national level in the Republic of Korea.

Defining medical deserts-an international consensus-building exercise

BACKGROUND

Medical deserts represent a pressing public health and health systems challenge. The COVID-19 pandemic further exacerbated the gap between people and health services, yet a commonly agreed definition of medical deserts was lacking. This study aims to define medical deserts through a consensus-building exercise, explaining the phenomenon to its full extent, in a manner that can apply to countries and health systems across the globe.

METHODS

We used a standard Delphi exercise for the consensus-building process. The first phase consisted of one round of individual online meetings with selected key informants; the second phase comprised two rounds of surveys when a consensus was reached in January 2023. The first phase-the in-depth individual meetings-was organized online. The dimensions to include in the definition of medical deserts were identified, ranked and selected based on their recurrence and importance. The second phase-the surveys-was organized online. Finally, external validation was obtained from stakeholders via email.

RESULTS

The agreed definition highlight five major dimensions: 'Medical deserts are areas where population healthcare needs are unmet partially or totally due to lack of adequate access or improper quality of healthcare services caused by (i) insufficient human resources in health or (ii) facilities, (iii) long waiting times, (iv) disproportionate high costs of services or (v) other socio-cultural barriers'.

CONCLUSIONS

The five dimensions of access to healthcare: (i) insufficient human resources in health or (ii) facilities, (iii) long waiting times, (iv) disproportionate high costs of services and (v) other socio-cultural barriers-ought to be addressed to mitigate medical deserts.

An ethical code for collecting, using and transferring sensitive health data: outcomes of a modified Policy Delphi process in Singapore

One of the core goals of Digital Health Technologies (DHT) is to transform healthcare services and delivery by shifting primary care from hospitals into the community. However, achieving this goal will rely on the collection, use and storage of large datasets. Some of these datasets will be linked to multiple sources, and may include highly sensitive health information that needs to be transferred across institutional and jurisdictional boundaries. The growth of DHT has outpaced the establishment of clear legal pathways to facilitate the collection, use and transfer of potentially sensitive health data. Our study aimed to address this gap with an ethical code to guide researchers developing DHT with international collaborative partners in Singapore. We generated this code using a modified Policy Delphi process designed to engage stakeholders in the deliberation of health data ethics and governance. This paper reports the outcomes of this process along with the key components of the code and identifies areas for future research.

Therapeutic Exercise Parameters, Considerations, and Recommendations for Migraine Treatment: An International Delphi Study

OBJECTIVE

The goal of this study was to reach consensus about the best exercise prescription parameters, the most relevant considerations, and other recommendations that could be useful for prescribing exercise to patients with migraine.

METHODS

This was an international study conducted between April 9, 2022 and June 30, 2022. An expert panel of health care and exercise professionals was assembled, and a 3-round Delphi survey was performed. Consensus was reached for each item if an Aiken V Validity Index ≥ 0.7 was obtained.

RESULTS

The study included 14 experts who reached consensus on 42 items by the third round. The most approved prescription parameters were 30 to 60 minutes of exercise per session, 3 days per week of moderate-intensity continuous aerobic exercise, and relaxation and breathing exercises for 5 to 20 minutes every day. When considering an exercise prescription, initial exercise supervision should progress to patient self-regulation; catastrophizing, fear-avoidance beliefs, headache-related disability, anxiety, depression, physical activity baseline level, and self-efficacy could influence the patients' exercise participation and efficacy; and gradual exposure to exercise could help improve these psychological variables and increase exercise efficacy. Yoga and concurrent exercise were also included as recommended interventions.

CONCLUSION

From the experts in the study, exercise prescriptions should be adapted to patients with migraine considering different exercise modalities, such as moderate-intensity aerobic exercise, relaxation, yoga, and concurrent exercise, based on the patients' preferences and psychological considerations, level of physical activity, and possible adverse effects.

IMPACT

The consensus reached by the experts can help prescribe exercise accurately to patients with migraine. Offering various exercise modalities can improve exercise participation in this population. The evaluation of the patients' psychological and physical status can also facilitate the adaptation of the exercise prescription to their abilities and diminish the risk of adverse events.

Identifying and Addressing Barriers to Implementing Core Electronic Health Record Use Metrics for Ambulatory Care: Virtual Consensus Conference Proceedings

Precise, reliable, valid metrics that are cost-effective and require reasonable implementation time and effort are needed to drive electronic health record (EHR) improvements and decrease EHR burden. Differences exist between research and vendor definitions of metrics. PROCESS:  We convened three stakeholder groups (health system informatics leaders, EHR vendor representatives, and researchers) in a virtual workshop series to achieve consensus on barriers, solutions, and next steps to implementing the core EHR use metrics in ambulatory care. CONCLUSION:  Actionable solutions identified to address core categories of EHR metric implementation challenges include: (1) maintaining broad stakeholder engagement, (2) reaching agreement on standardized measure definitions across vendors, (3) integrating clinician perspectives, and (4) addressing cognitive and EHR burden. Building upon the momentum of this workshop's outputs offers promise for overcoming barriers to implementing EHR use metrics.

High degree of consensus on diagnosis and management of rotator cuff tears: a Delphi approach

PURPOSE

To develop a consensus on diagnosis and treatment of rotator cuff tears. The study focused on selected areas: imaging, prognostic factors, treatment options, surgical techniques.

METHODS

Panel was composed of all members of the shoulder committee of the Italian Society of Arthroscopy, Knee, Upper arm, Sport, Cartilage and Orthopedic techniques (SIAGASCOT). Four rounds were performed. The first round consisted of gathering questions which were then divided into seven blocks referring to: imaging, patient-related prognostic factors, treatment options, surgical steps, reparative techniques, surgical predictive factors, advanced techniques. Subsequent rounds consisted of condensation by means of online questionnaire and debates. Consensus was defined as two-thirds agreement on one answer. Descriptive statistic was used to summarize the data.

RESULTS

Forty-one shoulder experts were involved. Fifty-six statements were finally formulated. A consensus could be achieved on 51. Experts agreed that preoperative magnetic resonance imaging is strongly recommended because it allows a careful evaluation of tear characteristics, while the role of US remains debatable. Controversial patient-related factors such as age, comorbidities, smoking and stiffness do not contraindicate the repair. From a surgical standpoint, the experts highlighted that pseudo-paralysis is not a contraindication to rotator cuff repair. Consensus on specific surgical steps was also achieved: capsular release should be performed only in stiff shoulders; footprint preparation is mandatory, while debridement of tendon edges is not essential. If necessary, a rotator interval release could be performed without interrupting the continuity between subscapularis and supraspinatus tendon; posterior delamination should be always included in the repair. Advanced techniques such as tendon transfers should be selected based on the main clinical deficit, while the superior capsule reconstruction plays a role only in combination with a functional repair.

CONCLUSION

A consensus was achieved almost on every topic of controversy explored. Particularly, MRI was deemed necessary to determine tear characteristics, while radiographs remain important for differential diagnosis; age should not be considered a contraindication to surgery; pseudo-paralysis does not represent a contraindication to arthroscopic rotator cuff repair, but superior capsule reconstruction plays a role only in combination with a functional repair. Latissimus dorsi transfer plays a role when the main functional deficit is in elevation, while the lower trapezius transfer plays a role when the main functional deficit is the external-rotation.

LEVEL OF EVIDENCE

V.

Phyllodes Tumors of the Breast: Canadian National Consensus Document Using Modified Delphi Methodology

PURPOSE

Phyllodes tumors are rare breast neoplasms with limited prospective data to guide treatment, leading to heterogeneous management of this disease. We developed National consensus statements using modified Delphi methodology including patients and practitioners across Canada.

METHODS

Statements were developed based on a literature review. Two iterations of surveys were distributed with a planned virtual consensus meeting. Panelists were invited from surgery, radiation oncology, medical oncology, pathology, radiology, and plastic surgery.

RESULTS

Twenty-three participants attended the virtual conference. One hundred statements regarding diagnostics, pathology, surgical planning, adjuvant therapies, recurrence, surveillance, and patient support were approved with an a priori defined consensus of ≥ 80%. Two tables on locoregional management were developed and approved. The management of borderline phyllodes tumors was a source of uncertainty, and recommendations reflect the lack of evidence in this rare presentation.

CONCLUSION

A consensus document containing all approved statements for the care and management of phyllodes tumors was developed to help guide practice and future research.

Clinical Guidance on the Monitoring and Management of Trastuzumab Deruxtecan (T-DXd)-Related Adverse Events: Insights from an Asia-Pacific Multidisciplinary Panel

Trastuzumab deruxtecan (T-DXd)-an antibody-drug conjugate targeting the human epidermal growth factor receptor 2 (HER2)-improved outcomes of patients with HER2-positive and HER2-low metastatic breast cancer. Guidance on monitoring and managing T-DXd-related adverse events (AEs) is an emerging unmet need as translating clinical trial experience into real-world practice may be difficult due to practical and cultural considerations and differences in health care infrastructure. Thus, 13 experts including oncologists, pulmonologists and a radiologist from the Asia-Pacific region gathered to provide recommendations for T-DXd-related AE monitoring and management by using the latest evidence from the DESTINY-Breast trials, our own clinical trial experience and loco-regional health care considerations. While subgroup analysis of Asian (excluding Japanese) versus overall population in the DESTINY-Breast03 uncovered no major differences in the AE profile, we concluded that proactive monitoring and management are essential in maximising the benefits with T-DXd. As interstitial lung disease (ILD)/pneumonitis is a serious AE, patients should undergo regular computed tomography scans, but the frequency may have to account for the median time of ILD/pneumonitis onset and access. Trastuzumab deruxtecan appears to be a highly emetic regimen, and prophylaxis with serotonin receptor antagonists and dexamethasone (with or without neurokinin-1 receptor antagonist) should be considered. Health care professionals should be vigilant for treatable causes of fatigue, and patients should be encouraged to use support groups and practice low-intensity exercises. To increase treatment acceptance, patients should be made aware of alopecia risk prior to starting T-DXd. Detailed monitoring and management recommendations for T-DXd-related AEs are discussed further.

Conservative management for lumbar radiculopathy based on the stage of the disorder: a Delphi study

PURPOSE

Conservative management of lumbar radiculopathy (LR) is the first treatment option. To date, systematic reviews and clinical practice guidelines have not considered the most appropriate timing of management. This study aimed to establish consensus on effective conservative treatment modalities across different stages (i.e., acute, sub-acute, or chronic) of LR.

MATERIALS AND METHODS

Through an iterative multistage Delphi process, experts rated agreement with proposed treatment modalities across stages of LR and could suggest additional treatment modalities. The agreement was measured using a 5-point Likert scale. Descriptive statistics were used to measure agreement (median, interquartile ranges, and percentage of agreement). Consensus criteria were defined a priori for each round.

RESULTS

Fourteen panelists produced a consensus list of effective treatment modalities across stages of LR. Acute stage management should focus on providing patients with information about the condition including pain education, individualized physical activity, and directional preference exercises, supported with NSAIDs. In the sub-acute stage, strength training and neurodynamic mobilization could be added and transforaminal/epidural injections considered. In the chronic stage, spinal manipulative therapy, specific exercise, and function-specific physical training should be combined with individualized vocational, ergonomic and postural advice.

CONCLUSIONS

Experts agree effectiveness of interventions differs through the evolution of LR.IMPLICATIONS FOR REHABILITATIONTo date clinical guideline for conservative management of lumbar radiculopathy do not consider the evolution of the condition.Acute stage management of lumbar radiculopathy should focus on providing information about the condition and support individualized physical activity with pain medication.Sub-acute management should add neurodynamic mobilization to strength training, while transforaminal and/or epidural injections could be considered.Chronic stage management should consider spinal manipulative therapy and focus on restoring personalized functional capacity.