Delphi methodology in healthcare research: How to decide its appropriateness

Development of a telemedicine group educational program for patients with heart failure: A delphi study

AIMS

Evidence regarding the most effective and feasible videoconferencing group educational program for patients with heart failure is still equivocal. This study aimed to reach consensus about the structure, acceptability, and feasibility of videoconferencing for people with heart failure in Jordan that improves access to healthcare and clinical outcomes.

METHODS

There were two Delphi survey studies of three rounds each. Delphi one survey involved 32 healthcare staff, experienced in heart failure clinical practice and telehealth, to obtain a consensus of opinion on a proposed group videoconferencing program for patients with heart failure. Delphi two involved seven staff of the information technology center, experienced in videoconferencing and using supporting applications, to obtain their consensus on the current capabilities of the healthcare system and patients about information technology. Descriptive statistics were used for each item to determine whether consensus was achieved or not. Items that received 80% disagreement or 80% agreement of participants were not presented for re-rating in the third round, while the items that scored varying degrees of agreement were presented for experts for re-rating.

RESULTS

In Delphi one a group of items reached consensus regarding structure, factors influencing, and effectiveness of the videoconferencing program. In Delphi two, the findings indicated that videoconferencing modality is applicable and feasible in Jordan.

CONCLUSION

This is the first study that addresses the equivocal evidence for the design and implementation of heart failure videoconferencing programs. The framework of the current proposed program can be utilized as a guideline to test or develop a future videoconference program.

PROCURE European consensus on breast cancer multigene signatures in early breast cancer management

Breast cancer multigene signatures (BCMS) have changed how patients with early-stage breast cancer (eBC) are managed, as they provide prognostic information and can be used to select patients who may avoid adjuvant chemotherapy. Clinical guidelines make recommendations on the use of BCMS; however, little is known on the current use of BCMS in clinical practice. We conduct a two-round Delphi survey to enquire about current use and perceived utility for specific patient profiles, and unmet needs of BCMS. Overall, 133 panellists experienced in breast cancer across 11 European countries have participated, most using BCMS either routinely (66.2%) or in selected cases (27.1%). Our results show that BCMS are mainly used to assess the risk of recurrence and to select patients for adjuvant chemotherapy; notably, no consensus has been reached on the lack of utility of BCMS for selecting the type of chemotherapy to administer. Also, there are discrepancies between the recommended and current use of BCMS in clinical practice, with use in certain patient profiles for which there is no supporting evidence. Our study suggests that physician education initiatives are needed to ensure the correct use and interpretation of BCMS to, ultimately, improve management of patients with eBC.

The First Modified Delphi Consensus-Building Exercise on Surgical Ward Rounds in the United Kingdom National Health Service

BACKGROUND

The ward round is an integral part of everyday surgical practice. It is a complex clinical activity that requires both sound clinical management and communication skills. This study reports the results of a consensus-building exercise on the common aspects of the general surgical ward rounds.

METHODS

The consensus-building committee involving a range of stakeholders from 16 United Kingdom (UK) National Health Service trusts took part in this consensus exercise. The members discussed and suggested a series of statements concerning surgical ward round. An agreement of ≥ 70% among members was regarded as a consensus.

RESULTS

Thirty-two members voted on 60 statements. There was a consensus on fifty-nine statements after the first round of voting, and one statement was modified before it reached consensus in the second round. The statements covered nine sections: a preparation phase, team allocation, multidisciplinary approach to the ward round, structure of the round, teaching considerations, confidentiality and privacy, documentation, post-round arrangements, and weekend round. There was a consensus on spending time to prepare for the round, a consultant-led round, involvement of the nursing staff, an MDT round at the beginning and end of the week, a minimum of 5 min allocated to each patient, utilisation of a round checklist, afternoon virtual round, and a clear handover and plan for the weekend.

CONCLUSION

The consensus committee achieved agreement on several aspects concerning the surgical ward rounds in the UK NHS. This should help improve the care of surgical patients in the UK.

Management of Locally Advanced Unresectable or Metastatic Urothelial Carcinoma: Expert Opinion from an Indian Panel via Delphi Consensus Method

Introduction Currently, there are no guidelines for the management of locally advanced unresectable or metastatic urothelial carcinoma (mUC) from an Indian perspective. There is a lack of consensus on the utility of treatment options in first-line (1L) and second-line (2L) settings, especially in cisplatin- and platinum-unfit mUC patient subgroups.

Objective This articles aims to develop evidence-based practical consensus recommendations for the management of mUC in Indian settings.

Methods Modified Delphi consensus methodology was considered to arrive at a consensus. An expert scientific committee of 15 medical oncologists from India constituted the panel. Twelve clinically relevant questions were grouped into five categories for presentation and discussion: (1) cisplatin and platinum ineligibility criteria; (2) programmed death ligand 1 and fibroblast growth factor receptor (FGFR) testing in mUC patients; (3) treatment options in 1L settings; (4) role of switch maintenance; and (5) treatment options in 2L. Statements that reached high (≥ 80%) and moderate (60–79%) levels of consensus in the first round (electronic survey) did not undergo the second Delphi round. The questions that received a low level of consensus (< 60%) were discussed during the virtual meeting.

Results Renal impairment (creatinine clearance [CrCl] < 60 mL/min) and New York Heart Association class 3 heart failure are important assessment criteria for determining cisplatin ineligibility. Patients are unfit for any platinum-based chemotherapy in case of Eastern Cooperative Oncology Group performance status> 3 or severe renal impairment (CrCl < 30 mL/min). Gemcitabine and platinum with cisplatin over carboplatin were preferred in 1L settings. In patients unfit for cisplatin-based regimens, carboplatin–gemcitabine chemotherapy was preferred over immunotherapy (atezolizumab or pembrolizumab). Selected patients who are platinum ineligible may be considered for immunotherapy. Post-induction chemotherapy, those who do not progress may be strongly considered for avelumab maintenance. Experts recommended erdafitinib in FGFR-positive mUC patients in 2L settings. In FGFR-negative patients, immunotherapy (pembrolizumab, nivolumab, or avelumab) may be preferred over chemotherapy (paclitaxel, docetaxel, or vinflunine). Enfortumab vedotin and sacituzumab govitecan may be considered for further lines of therapy.

Conclusion Expert panel consensus will offer expert guidance to oncologists/clinicians on the management of mUC in Indian settings.

Key Points

Textbook outcomes in DIEP flap breast reconstruction: a Delphi study to establish consensus

PURPOSE

Composite measures, like textbook outcomes, may be superior to individual metrics when assessing hospital performance and quality of care. This study utilized a Delphi process to define a textbook outcome in DIEP flap breast reconstruction.

METHODS

A two-round Delphi survey defined: (1) A textbook outcome, (2) Exclusion criteria for a study population, and (3) Respondent opinion regarding textbook outcomes. An a priori threshold of ≥ 70% agreement among respondents established consensus among the tested statements.

RESULTS

Out of 85 invitees, 48 responded in the first round and 41 in the second. A textbook outcome was defined as one that meets the following within 90 days: (1) No intraoperative complications, (2) Operative duration ≤ 12 h for bilateral and ≤ 10 h for unilateral/stacked reconstruction, (3) No post-surgical complications requiring re-operation, (4) No surgical site infection requiring IV antibiotics, (5) No readmission, (6) No mortality, (7) No systemic complications, and (8) Length of stay < 5 days. Exclusion criteria for medical and surgical characteristics (e.g., BMI > 40, HgbA1c > 7) and case-volume cut-offs for providers (≥ 21) and institutions (≥ 44) were defined. Most agreed that textbook outcomes should be defined for complex plastic surgery procedures (75%) and utilized to gauge hospital performance for microsurgical breast reconstruction (77%).

CONCLUSION

This Delphi study identified (1) Key elements of a textbook outcome for DIEP flap breast reconstruction, (2) Exclusion criteria for future studies, and (3) Characterized surgeon opinions regarding the utility of textbook outcomes in serving as quality metric for breast reconstruction care.

Priorities in updating training paradigms in orthopedic manual therapy: an international Delphi study

PURPOSE

Orthopedic manual therapy (OMT) education demonstrates significant variability between philosophies and while literature has offered a more comprehensive understanding of the contextual, patient specific, and technique factors which interact to influence outcome, most OMT training paradigms continue to emphasize the mechanical basis for OMT application. The purpose of this study was to establish consensus on modifications & adaptions to training paradigms which need to occur within OMT education to align with current evidence.

METHODS

A 3-round Delphi survey instrument designed to identify foundational knowledge to include and omit from OMT education was completed by 28 educators working within high level manual therapy education programs internationally. Round 1 consisted of open-ended questions to identify content in each area. Round 2 and Round 3 allowed participants to rank the themes identified in Round 1.

RESULTS

Consensus was reached on 25 content areas to include within OMT education, 1 content area to omit from OMT education, and 34 knowledge components which should be present in those providing OMT. Support was seen for education promoting understanding the complex psychological, neurophysiological, and biomechanical systems as they relate to both evaluation and treatment effect. While some concepts were more consistently supported there was significant variability in responses which is largely expected to be related to previous training.

CONCLUSION

The results of this study indicate manual therapy educators understanding of evidence-based practice as support for all 3 tiers of evidence were represented. The results of this study should guide OMT training program development and modification.

Agile Delphi methodology: A case study on how technology impacts burnout syndrome in the post-pandemic era

Introduction

In the post-pandemic era, many habits in different areas of our lives have changed. The exponential growth in the use of technology to perform work activities is one of them. At the same time, there has been a marked increase in burnout syndrome. Is this a coincidence? Could they be two interconnected developments? What if they were? Can we use technology to mitigate this syndrome? This article presents the agile Delphi methodology (MAD), an evolved version of the Delphi method, adapted to the needs of modern-day society.

Methods

To drive Occupational Health and Safety (OHS) experts to reach a consensus on what technological and non-technological factors could be causing the burnout syndrome experienced by workers in the post-pandemic era, MAD has been used in a specific case study. This study formally presents MAD and describes the stages enacted to run Delphi experiments agilely.

Results

MAD is more efficient than the traditional Delphi methodology, reducing the time taken to reach a consensus and increasing the quality of the resulting products.

Discussion

OHS experts identified factors that affect and cause an increase in burnout syndrome as well as mechanisms to mitigate their effects. The next step is to evaluate whether, as the experts predict, burnout syndrome decreases with the mechanisms identified in this case study.

Country score tool to assess readiness and guide evidence generation of immunization programs in aging adults in Europe

Objectives

Delaying of policies for immunization of aging adults, low vaccine uptake, and the lack of supportive evidence at the national level could diminish the value in health and economics of such programs. This study aims to develop a "country score tool" to assess readiness and to facilitate evidence generation for aging adult immunization programs in Europe, and examine the comprehensiveness, relevance, acceptability, and feasibility of the tool.

Methods

The tool was developed in two phases. First, a modified Delphi process was used to construct the tool. The process included a literature review, stakeholder consultations, and a three-round Delphi study. The Delphi panel included researchers, supra-national and national decision-makers of immunization programs recruited from five countries, using snowball sampling method. The consensus was predefined at the agreement rate of 70%. Pilot testing of the tool was conducted in the Netherlands, Germany, Serbia, and Hungary involving researchers in the field of health technology assessment. After assessing the countries' readiness, researchers evaluated four features, namely comprehensiveness, relevance, acceptability, and feasibility of the tool via an online survey that included 5-scale Likert questions. The percentages of affirmative answers including "agree" and "totally agree" choices were presented.

Results

The review identified 16 tools and frameworks that formed the first version of our tool with 14 items. Eight experts were involved in the Delphi panel. Through three Delphi rounds, four items were added, one was dropped, and all others were amended. The consensus was achieved on the tool with 17 items divided into decision-making and implementation parts. Each item has a guiding question, corresponding to explanations and rationales to inform assessment with readiness scores. Eight researchers completed the pilot testing. The tool was rated as comprehensive (75%), relevant (100%), acceptable (75%), and feasible (88%) by participants.

Conclusion

Through a thorough and transparent process, a country score tool was developed helping to identify strengths, weaknesses, and evidential requirements for decision-making and implementation of immunization programs of aging adults. The tool is relevant for different European contexts and shows good comprehensiveness, acceptability, and feasibility.

Computational pathology in 2030: a Delphi study forecasting the role of AI in pathology within the next decade

BACKGROUND

Artificial intelligence (AI) is rapidly fuelling a fundamental transformation in the practice of pathology. However, clinical integration remains challenging, with no AI algorithms to date in routine adoption within typical anatomic pathology (AP) laboratories. This survey gathered current expert perspectives and expectations regarding the role of AI in AP from those with first-hand computational pathology and AI experience.

METHODS

Perspectives were solicited using the Delphi method from 24 subject matter experts between December 2020 and February 2021 regarding the anticipated role of AI in pathology by the year 2030. The study consisted of three consecutive rounds: 1) an open-ended, free response questionnaire generating a list of survey items; 2) a Likert-scale survey scored by experts and analysed for consensus; and 3) a repeat survey of items not reaching consensus to obtain further expert consensus.

FINDINGS

Consensus opinions were reached on 141 of 180 survey items (78.3%). Experts agreed that AI would be routinely and impactfully used within AP laboratory and pathologist clinical workflows by 2030. High consensus was reached on 100 items across nine categories encompassing the impact of AI on (1) pathology key performance indicators (KPIs) and (2) the pathology workforce and specific tasks performed by (3) pathologists and (4) AP lab technicians, as well as (5) specific AI applications and their likelihood of routine use by 2030, (6) AI's role in integrated diagnostics, (7) pathology tasks likely to be fully automated using AI, and (8) regulatory/legal and (9) ethical aspects of AI integration in pathology.

INTERPRETATION

This systematic consensus study details the expected short-to-mid-term impact of AI on pathology practice. These findings provide timely and relevant information regarding future care delivery in pathology and raise key practical, ethical, and legal challenges that must be addressed prior to AI's successful clinical implementation.

FUNDING

No specific funding was provided for this study.

Eliciting and prioritising determinants of improved care in multimorbidity: A modified online Delphi study

Background

Multimorbidity is a major challenge to health and social care systems around the world. There is limited research exploring the wider contextual determinants that are important to improving care for this cohort. In this study, we aimed to elicit and prioritise determinants of improved care in people with multiple conditions.

Methods

A three-round online Delphi study was conducted in England with health and social care professionals, data scientists, researchers, people living with multimorbidity and their carers.

Results

Our findings suggest a care system which is still predominantly single condition focused. 'Person-centred and holistic care' and 'coordinated and joined up care', were highly rated determinants in relation to improved care for multimorbidity. We further identified a range of non-medical determinants that are important to providing holistic care for this cohort.

Conclusions

Further progress towards a holistic and patient-centred model is needed to ensure that care more effectively addresses the complex range of medical and non-medical needs of people living with multimorbidity. This requires a move from a single condition focused biomedical model to a person-based biopsychosocial approach, which has yet to be achieved.

Determining a common understanding of interprofessional competencies for pre-registration health professionals in Aotearoa New Zealand: A Delphi study

There is growing awareness that factors such as the growing incidence of co-morbidity and increasing complexity of patient health needs cannot be addressed by health professionals practicing in isolation. Given this, there is an increasing emphasis on preparing students in health-related programs for effective interprofessional practice. Less clear, however, are the specific skills and clinical or learning opportunities necessary for students to develop effectiveness in interprofessional practice. These factors drove a team associated with a tertiary health education provider in Hamilton, New Zealand to transform traditional clinical student experiences in the form of an interprofessional student-assisted clinic. The clinic was intended, in part, to provide students with opportunities to learn and experience interprofessionalism in practice but was hampered by limited information available regarding the specific skill requirements necessary for students in New Zealand to learn in this context. In this Delphi study, we synthesize national expert opinion on student competency indicators necessary for effective interprofessional practice. The resultant set of indicators is presented and opportunities for application and further research discussed. The paper offers guidance to others seeking to innovate health curricula, develop novel service-oriented learning experiences for students, and foster interprofessional practice competence in the future health workforce.

Cross-cultural adaptation and validation of the Chinese version of the short-form of the Central Sensitization Inventory (CSI-9) in patients with chronic pain: A single-center study

Chronic pain affects more than 30% of the general population. The 9-item Central Sensitization Inventory (CSI-9) is a shortened version of the CSI-25, which is a patient-reported instrument used to screen people at risk of central sensitization (CS). The aim of this study was to cross-culturally adapt and validate a Chinese version of the CSI-9. The Chinese CSI-9 was generated by translation of the original English version, back-translation, cultural adaptation, and revision using the Delphi method. The Chinese CSI-9 was administered to 235 patients with chronic pain and 55 healthy controls. Structural validity (confirmatory factor analysis), construct validity (correlations with other scales), test-retest reliability (intraclass correlation coefficient, ICC), and internal consistency (Cronbach's α) were evaluated. Confirmatory factor analysis was performed using one factor. The Chinese CSI-9 score was positively correlated with the Pain Catastrophic Scale (PCS) total score (r = 0.463), PCS subscale scores (r = 0.347-0.463), Brief Pain Inventory (BPI) mean item score (r = 0.524), BPI total score (r = 0.773), and the number of painful sites (r = 0.451). The Chinese CSI-9 had excellent test-retest reliability (ICC = 0.958) and excellent internal consistency (Cronbach's α = 0.902 in the overall sample and 0.828 in the chronic pain population). The optimal cut-off value for the Chinese CSI-9 was 18 points. The Chinese CSI-9 had excellent test-retest reliability and satisfactory structural validity and construct validity. The CSI-9 could potentially be utilized in China as a self-report questionnaire in both clinical practice and research settings.

Standards for Scaffolding in Health Sciences Programmes: A Delphi Consensus Study

Introduction

Health sciences programmes operate in complex, unpredictable contexts, underscoring the need for comprehensive scaffolding of the learning processes. Yet, the scaffolding approaches remain fragmented, and lack a shared approach to how programmes could integrate scaffolding across the curricula. The literature argues that standards result in the comprehensive implementation of educational practices. There are no reported standards related to scaffolding practices in these programmes.

OBJECTIVES

To develop standards for scaffolding in health sciences programmes utilising a consensus approach through a modified Delphi Technique.

METHODS

Following the recommendations on Conducting and REporting of DElphi Studies (CREDES), an online modified Delphi technique was applied. Evidence on the application of scaffolding in health sciences programmes, obtained through an integrative review, was synthesised to draft standards. Using purposive and snowball sampling, an international panel from diverse geographical and professional backgrounds refined and validated the standards. Descriptive statistics was utilised to analyse demographic data and consensus agreements to include standards and criteria. Qualitative analysis of textual comments ensured the synthesis and inclusion of critical divergent views and additions.

RESULTS

A total of 22 experts from around the globe agreed to participate in the study and one did not complete Delphi surveys. Most experts (n = 18) held a PhD; and an average of 19 years of teaching in health sciences programmes. Four standards and 27 criteria were included after achieving consensus during the two Delphi surveys rounds. The included standards focused on four areas: structuring and sequencing educational activities, resources/tools for scaffolding, structuring the programme and instructional strategies to support learning.

CONCLUSION

The principle-based standards developed in this study could direct and support scaffolding practices in health sciences programmes. The standards' emphases on macro-, meso- and micro-scaffolding present numerous opportunities for designing and applying contextually sensitive scaffolding strategies at every level of curriculum implementation.

Possible solutions to enhance evidence-based practice proposed by rehabilitation professionals in Japan: a Delphi study

[Purpose] We aimed to identify possible solutions to enhance evidence-based practice (EBP) in rehabilitation professionals in Japan. [Participants and Methods] A three-round Delphi method was undertaken among a cohort of clinical therapists (328 physical therapists, 55 occupational therapists, and 6 speech therapists). In the first round, the participants listed possible solutions for promoting EBP, other than 12 solutions presented in a previous study; subsequently, a new list was created. In the second round, a newly-created list of solutions was presented, and the participants responded on a 5-point Likert scale on how much they agreed with the solutions promoting EBP in Japanese rehabilitation professionals. In the third round, the distribution of responses obtained in the second round was presented, and participant's agreement was again assessed on a 5-point Likert scale. [Results] Across the three rounds, data were collected from 33.7% to 47.0% of all eligible participants. After the first round, 17 possible solutions were developed, and a list of 29 solutions was used in the second round. After the third round, 10 solutions reached the predetermined criteria for consensus. [Conclusion] In this study, ten possible solutions to promote EBP were proposed by the Japanese rehabilitation professionals.

Quality assessment of breast cancer studies conducted with the Delphi technique

BACKGROUND

The Delphi technique is a consensus method aiming to obtain statistical estimations from a qualitative approach, through an iterative process that leads to consensus within experts. The main characteristics of the technique include iteration, anonymity, feedback, and consensus reaching. When high-quality, quantitative evidence on a particular topic is insufficient, the Delphi technique can be used for making decisions in clinical scenarios. However, the quality of studies on breast cancer conducted with this technique, has not been assessed.

OBJECTIVE

We aim to evaluate the quality of studies on breast cancer which used the Delphi technique as their method.

METHODS

A quality assessment tool (Quali-D) was created through consensus among experts on the Delphi technique. Then, the tool was applied to studies on breast cancer which used the Delphi technique as their method.

RESULTS

Studies conducted through the Delphi technique mainly assessed for quality indicators and expressed needs in patients with breast cancer. High-quality characteristics were reported in 63.89% of the studies. 98.61% used the Delphi technique due to lack of a more adequate method to solve their research question. 98.61% summarized and presented results in a clear way. In 91.67% of the studies, at least two rounds were conducted. 86.11% described the methods for expert selection in a complete manner. Only 54.17% of the studies reported an anonymous process and 4.17% of the studies disclosed conflicts of interest thoroughly.

CONCLUSIONS

A variety of topics were assessed through the Delphi technique in cases where no other technique would have been more appropriate for assessing these issues. Significant limitations are present in terms of anonymity and full disclosure of conflicts of interest. We found that the quality of studies conducted with the Delphi technique regarding breast cancer is overall good. However, the limitations of each study must be considered when applying their results to clinical practice.

Patient centered care in primary health care teleconsultations: an exploratory study

With the current evolution of health digitalization driven by the COVID-19 pandemic, it is expected that teleconsultations - specifically, synchronous audio consultations (by telephone) or video-based (video calls) between health professionals (Doctors and Nurses) and patients - will be more used in Primary Health Care. The provision of health care through teleconsultations must be evaluated by the quality management of health organizations to ensure that the needs of patients are met. For this reason, this study was carried out under the objective of identifying indicators to create a culture of Patient-Centered Care (PCC) in teleconsultations in Primary Health Care. The methodology followed was based on the Delphi method. The research aimed to analyze the suitability of 48 indicators (organized in Donabedian's quality dimensions) to assess the implementation of PCC in Primary Health Care. Despite all indicators were viewed as very important, the disparity in responses was significant. Future research should extend this study by involving other groups of experts (like academics who study the subject and members of patient associations).

Management of B-cell lineage acute lymphoblastic leukemia: expert opinion from an Indian panel via Delphi consensus method

Introduction

Currently, there are no guidelines for the management of B-cell lineage acute lymphoblastic leukemia (B-ALL) from an Indian perspective. The diagnostic workup, monitoring, and treatment of B-ALL vary among different physicians and institutes.

Objective

To develop evidence-based practical consensus recommendations for the management of B-ALL in Indian settings.

Methods

Modified Delphi consensus methodology was considered to arrive at a consensus. An expert scientific committee of 15 experts from India constituted the panel. Clinically relevant questions belonging to three major domains were drafted for presentation and discussion: (i) diagnosis and risk assignment; (ii) frontline treatment; and (iii) choice of therapy (optimal vs. real-world practice) in relapsed/refractory (R/R) settings. The questionnaire was shared with the panel members through an online survey platform. The level of consensus was categorized into high (≥ 80%), moderate (60%-79%), and no consensus (< 60%). The process involved 2 rounds of discussion and 3 rounds of Delphi survey. The questions that received near or no consensus were discussed during virtual meetings (Delphi rounds 1 and 2). The final draft of the consensus was emailed to the panel for final review.

Results

Experts recommended morphologic assessment of peripheral blood or bone marrow, flow cytometric immunophenotyping, and conventional cytogenetic analysis in the initial diagnostic workup. Berlin-Frankfurt-Münster (BFM)-based protocol is the preferred frontline therapy in pediatric and adolescent and young adult patients with B-ALL. BFM/German Multicenter Study Group for Adult Acute Lymphoblastic Leukemia-based regimen is suggested in adult patients with B-ALL. Immunotherapy (blinatumomab or inotuzumab ozogamicin) followed by allogeneic hematopoietic cell transplantation (allo-HCT) is the optimal choice of therapy that would yield the best outcomes if offered in the first salvage in patients with R/R B-ALL. In patients with financial constraints or prior allo-HCT (real-world practice) at first relapse, standard-intensive chemotherapy followed by allo-HCT may be considered. For subsequent relapses, chimeric antigen receptor T-cell therapy or palliative care was suggested as the optimal choice of therapy.

Conclusion

This expert consensus will offer guidance to oncologists/clinicians on the management of B-ALL in Indian settings.

Therapeutic Appropriateness of Cariprazine in the Management of Schizophrenia: Experts' Opinion using a Delphi Approach

BACKGROUND

Schizophrenia is a psychiatric disorder whose therapeutic objectives are aimed at reducing symptoms and improving patient's quality of life. First- and second-generation antipsychotics present numerous side effects. Recently introduced in the treatment of schizophrenia, cariprazine has shown to improve positive and negative symptoms as well as cognitive impairment, with good tolerability.

OBJECTIVE

To assess the level of consensus among Italian psychiatrists in relation to the use of cariprazine in the treatment of schizophrenia by using the Delphi technique.

METHOD

A Delphi study was undertaken between January and July 2022. Two questionnaires were consecutively sent to a panel of 97 psychiatrists from all over Italy, of which 81 actively participated, anonymously, in at least one of the two consultations with a sufficiently high response rate (83%).

RESULTS

Broad consensus in terms of the efficacy and safety of cariprazine in the treatment of schizophrenia during all phases of the disorder. The young first-episode schizophrenia patient with or without substance abuse seems to be an excellent candidate for cariprazine therapy. In addition, the lack of side effects makes cariprazine a suitable drug for adult and elderly patients with schizophrenia. However, there is still limited experience with the use of cariprazine, along with little knowledge of the most recent real-life data.

CONCLUSION

These results could encourage wider dissemination of evidence-based practices with the final aim of optimizing the clinical use of cariprazine in patients with schizophrenia.

Implementing health system improvement: resources and strategies for interprofessional teams

Health system improvement (HSI) is focused on systematic changes to organisational processes and practices to improve the efficient delivery of safe care and quality outcomes. Guidelines that specify how interprofessional teams conduct HSI and knowledge translation are needed. We address this urgent requirement providing health professional teams with resources and strategies to investigate, analyse and implement system-level improvements. HSI encompasses similar, yet different, inter-related activities across a continuum. The continuum spans three categories of activities, such as quality improvement, health management research and translational health management research. A HSI decision making guide and checklist, comprising six-steps, is presented that can be used to select and plan projects. This resource comprises six interconnected steps including, defining the activity, project outcome, aim, use of evidence, appropriate methodology and implementation plan. Each step has been developed focusing on an objective, actions and resources. HSI activities provide a foundation for interprofessional collaboration, allowing multiple professions to create, share and disseminate knowledge for improved healthcare. When planned and executed well, HSI projects assist clinical and corporate staff to make evidence-informed decisions and directions for the benefit of the service, organisation and sector.

How to establishing an indicators framework for evaluating the performances in primary TB control institutions under the new TB control model? Based on a Delphi study conducted in Guangxi, China

BACKGROUND

In China, the new TB control model of trinity form had been implemented in all parts, and the comprehensively evaluation to the performances in primary TB control institutions were closely related to the working capacity and quality of TB service, but there was still no an unified evaluation indicators framework in practice and few relevant studies. The purpose of this study was to establish an indicators framework for comprehensively evaluating the performances in primary TB control institutions under the new TB control model of trinity form in Guangxi, China.

METHODS

The Delphi method was used to establish an indicators framework for comprehensively evaluating the performances in primary TB control institutions under the new TB control model of trinity form, and the analytic hierarchy process(AHP) was used to determine the weights of all levels of indicators, from September 2021 to December 2021 in Guangxi, China.

RESULTS

A total of 14 experts who had at least 10 years working experience and engaged in TB prevention and control and public health management from health committee, CDC, TB designated hospitals and university of Guangxi were consulted in two rounds. The average age of the experts were (43.3 ± 7.549) years old, and the effective recovery rate of the questionnaire was 100.0%. The average value of authority coefficient of experts (Cr) in the two rounds of consultation was above 0.800. The Kendall's harmony coefficient (W) of experts' opinions on the first-level indicators, the second-level indicators and the third-level indicators were 0.786, 0.201 and 0.169, respectively, which were statistically significant (P < 0.05). Finally, an indicators framework was established, which included 2 first-level indicators, 10 second-level indicators and 37 third-level indicators. The results of analytic hierarchy process (AHP) showed that the consistency test of all levels of indicators were CI < 0.10, which indicating that the weight of each indicator was acceptable.

CONCLUSION

The indicators framework established in this study was in line with the reality, had reasonable weights, and could provide a scientific evaluation tool for comprehensively evaluating the performances in primary TB control institutions under the new TB control model of trinity form in Guangxi, China.

Factors associated with high-level endurance performance: An expert consensus derived via the Delphi technique

There is little agreement on the factors influencing endurance performance. Endurance performance often is described by surrogate variables such as maximum oxygen consumption, lactate threshold, and running economy. However, other factors also determine success and progression of high-level endurance athletes. Therefore, the aim was to identify the relevant factors for endurance performance assessed by international experts by adhering to a structured communication method (i.e., Delphi technique). Three anonymous evaluation rounds were conducted initiated by a list of candidate factors (n = 120) serving as baseline input variables. The items that achieved ≥70% of agreement in round 1 were re-evaluated in a second round. Items with a level of agreement of ≥70% in round 2 reached consensus and items with a level of agreement of 40-69% in round 2 were re-rated in a third round followed by a consensus meeting. Round 1 comprised of 27 panellists (n = 24 male) and in round 2 and 3 18 (n = 15 male) of the 27 panellists remained. Thus, the final endurance expert panel comprised of 18 international experts (n = 15 male) with 20 years of experience on average. The consensus report identified the following 26 factors: endurance capacity, running economy, maximal oxygen consumption, recovery speed, carbohydrate metabolism, glycolysis capacity, lactate threshold, fat metabolism, number of erythrocytes, iron deficiency, muscle fibre type, mitochondrial biogenesis, hydrogen ion buffering, testosterone, erythropoietin, cortisol, hydration status, vitamin D deficiency, risk of non-functional overreaching and stress fracture, healing function of skeletal tissue, motivation, stress resistance, confidence, sleep quality, and fatigue. This study provides an expert-derived summary including 26 key factors for endurance performance, the "FENDLE" factors (FENDLE = Factors for ENDurance Level). This consensus report may assist to optimize sophisticated diagnostics, personalized training strategies and technology.

The Place of Immune Reconstitution Therapy in the Management of Relapsing Multiple Sclerosis in France: An Expert Consensus

The treatment strategy in relapsing multiple sclerosis (RMS) is a complex decision requiring individualization of treatment sequences to maximize clinical outcomes. Current local and international guidelines do not provide specific recommendation on the use of immune reconstitution therapy (IRT) as alternative to continuous immunosuppression in the management of RMS. The objective of the program was to provide consensus-based expert opinion on the optimal use of IRT in the management of RMS. A Delphi method was performed from May 2022 to July 2022. Nineteen clinical assertions were developed by a scientific committee and sent to 14 French clinical experts in MS alongside published literature. Two consecutive reproducible anonymous votes were conducted. Consensus on recommendations was achieved when more than 75% of the respondents agreed or disagreed with the clinical assertions. After the second round, consensus was achieved amongst 16 out of 19 propositions: 13 clinical assertions had a 100% consensus, 3 clinical assertions a consensus above 75% and 3 without consensus. Expert-agreed consensus is provided on topics related to the benefit of the early use of IRT from immunological and clinical perspectives, profiles of patients who may benefit most from the IRT strategy (e.g. patients with family planning, patient preference and lifestyle requirements). These French expert consensuses provide up-to-date relevant guidance on the use of IRT in clinical practice. The current program reflects status of knowledge in 2022 and should be updated in timely manner when further clinical data in IRT become available.

PFD-SENTINEL: Development of a screening tool for pelvic floor dysfunction in female athletes through an international Delphi consensus

To develop a screening tool for pelvic floor dysfunction (PFD) in female athletes for use by sports medicine clinicians (eg, musculoskeletal/sports physiotherapists, sports and exercise medicine physicians), which guides referral to a PFD specialist (eg, pelvic floor/women’s health physiotherapist, gynaecologist, urogynaecologist, urologist).

Between February and April 2022, an international two-round modified Delphi study was conducted to assess expert opinion on which symptoms, risk factors and clinical and sports-related characteristics (items) should be included in a screening tool. We defined consensus a priori as >67% response agreement to pass each round.

41 and 34 experts participated in rounds 1 and 2, respectively. Overall, seven general statements were endorsed as relevant by most participants highlighting the importance of screening for PFD in female athletes. Through consensus, the panel developed the Pelvic Floor Dysfunction-ScrEeNing Tool IN fEmale athLetes (PFD-SENTINEL) and agreed to a cluster of PFD symptoms (n=5) and items (risk factors, clinical and sports-related characteristics; n=28) that should prompt specialist care. A clinical algorithm was also created: a direct referral is recommended when at least one symptom or 14 items are reported. If these thresholds are not reached, continuous monitoring of the athlete’s health is indicated.

Despite increasing awareness and clinical relevance, barriers to identify PFD in female athletes are still present. The PFD-SENTINEL is a new resource for sports medicine clinicians who regularly assess female athletes and represents the first step towards early PFD identification and management. Further studies to validate the tool are needed.

Development of a Protocol Using the Delphi Method for the ad interim Supply of Hormonal Contraceptives in Swiss Pharmacies

(1) Background: Pharmacists are often challenged with situations where women are already on hormonal contraceptives (HC) but have no valid prescription. By Swiss law, pharmacists are allowed to supply prescription-only drugs in exceptional situations without a physician's prescription. Because eligibility for HC can change, women at risk for complications, such as serious side effects, need to be identified. We aimed to develop a protocol to assist pharmacists in clarifying and documenting eligibility for HC. (2) Methods: We conducted a survey using the Delphi method to identify relevant clarifications and develop a protocol for pharmacists. Proposed material was created based on the literature and existing toolkits/protocols aimed at verifying eligibility for HC. A multidisciplinary expert panel, consisting of gynecologists and pharmacists, reviewed the proposed material and provided anonymized feedback over two survey cycles. (3) Results: This Delphi survey revealed items essential to the clarification of eligibility for HC in pharmacies for women who are already using it. This resulted in a protocol that maps "best practices" regarding these ad interim supplies of HC given without a prescription in Switzerland. (4) Conclusions: This survey, made using the Delphi method, allowed us to create a protocol for pharmacists that aims to verify and document eligibility for HC in Switzerland, where HC is frequently supplied without a prescription.

Barriers and solutions in adopting public–private partnerships in road transportation infrastructure projects for developing countries: results of a Delphi survey in Iran

Purpose

Sustainable economic growth in both developed and developing countries requires the restructuring and expansion of road transportation infrastructures (RTIs). However, RTIs are always subject to high costs and delays, especially in developing countries with fewer resources than developed ones. Cost overruns and inaccurate forecasts usually lead to project failures. In this regard, some governments in developing countries have adopted public–private partnerships (PPPs) to deliver RTI projects with very positive outcomes. However, academic research has not yet studied the most recurring barriers and associated solutions to adopting PPPs in RTIs particularly for developing countries. This paper aims to fill up this knowledge gap in the existing literature.

Design/methodology/approach

A Delphi survey method involving 103 experts in RTIs based in Iran was implemented. Results indicated that the most perceived barriers to applying PPPs in RTIs in developing countries are linked to political, legal and economic factors. Ten other experts also participated in semistructured interviews, which were thematically analyzed to provide practical effective solutions for overcoming those identified barriers.

Findings

The findings indicated that all the presented barriers achieved above-average scores and could be considered severe obstacles of applying PPPs in RTIs for developing countries. In terms of barriers and solutions reported, these seem to converge on three profound elements: political stability, legal framework and conjoint management.

Originality/value

To the best of the authors’ knowledge, this is the first-ever research study regarding the barriers to adopting PPPs in delivering RTI projects for developing countries. Practical recommendations for overcoming these perceived barriers and achieving better implementation of PPPs in RTIs for developing countries were advocated. This work has contributed to the extant PPP theory as the management of coproduction in delivering RTI projects.

SPINE20 recommendations 2022: spine care-working together to recover stronger

PURPOSE

Globally, spine disorders are the leading cause of disability, affecting more than half a billion individuals. However, less than 50% of G20 countries specifically identify spine health within their public policy priorities. Therefore, it is crucial to raise awareness among policy makers of the disabling effect of spine disorders and their impact on the economic welfare of G20 nations. In 2019, SPINE20 was established as the leading advocacy group to bring global attention to spine disorders.

METHODS

Recommendations were developed through two Delphi methods with international and multi-professional panels.

RESULTS

In 2022, seven recommendations were delivered to the leaders of G20 countries, urging them to: Develop action plans to provide universal access to evidence-based spine care that incorporates the needs of minorities and vulnerable populations. Invest in the development of sustainable human resource capacity, through multisectoral and inter-professional competency-based education and training to promote evidence-based approaches to spine care, and to build an appropriate healthcare working environment that optimizes the delivery of safe health services. Develop policies using the best available evidence to properly manage spine disorders and to prolong functional healthy life expectancy in the era of an aging population. Create a competent workforce and improve the healthcare infrastructure/facilities including equipment to provide evidence-based inter-professional rehabilitation services to patients with spinal cord injury throughout their continuum of care. Build collaborative and innovative translational research capacity within national, regional, and global healthcare systems for state-of-the-art and cost-effective spine care across the healthcare continuum ensuring equality, diversity, and inclusion of all stakeholders. Develop international consensus statements on patient outcomes and how they can be used to define and develop pathways for value-based care. Recognize that intervening on determinants of health including physical activity, nutrition, physical and psychosocial workplace environment, and smoking-free lifestyle can reduce the burden of spine disabilities and improve the health status and wellness of the population. At the third SPINE20 summit 2022 which took place in Bali, Indonesia, in August 2022, 17 associations endorsed its recommendations.

CONCLUSION

SPINE20 advocacy efforts focus on developing public policy recommendations to improve the health, welfare, and wellness of all who suffer from spinal pain and disability. We propose that focusing on facilitating access to systems that prioritize value-based care delivered by a competent healthcare workforce will reduce disability and improve the productivity of the G20 nations.

Identifying indicators of community participation-promoting efforts within coordinated specialty care: A modified e-Delphi study of stakeholder perspectives

AIM

Community participation in occupational, social, recreational, and other domains is critically important during young adulthood. Coordinated Specialty Care (CSC) programs provide developmentally tailored care to young adults experiencing early psychosis within the United States, but little is known about the breadth of efforts to promote community participation. This study aimed to develop and evaluate indicators of these efforts based on the perspectives of a national multi-stakeholder group.

METHODS

Seventeen stakeholders (i.e., young adults with early psychosis, family members, experts by profession) participated in a modified e-Delphi study, conducted in two rounds. The purpose of round one was to generate a comprehensive list of community participation-promoting indicators. During round two, stakeholders rated the importance and feasibility of the implementation of each indicator. Descriptive statistics and percentage of agreement regarding round two ratings were assessed.

RESULTS

During round one, 186 indicators of activities and/or practices designed to promote community participation were identified; this list was reduced to 44 by eliminating redundancies or indicators not related to community participation. In round two, we found broad agreement regarding the importance, but significant variation in perceived feasibility of indicators. The highest-rated indicators in both categories pertained to staff knowledge (regarding barriers and supports to participation and the importance of participation to health) and strategies for addressing participation barriers.

CONCLUSIONS

This study is expected to facilitate the identification and development of promising CSC activities and practices designed to promote community participation among young adults while potentially also enhancing engagement in services and improving clinical outcomes.

Identifying the important social outcomes for childhood cancer survivors: an e-Delphi study protocol

INTRODUCTION

Optimising the health of childhood cancer survivors is important given the high long-term survival rate coupled with a significant late effects burden. Included within the WHO's definition of 'Health' are social outcomes. These are of interest given their impact on adult functioning within society, complex interactions with physical and mental health outcomes and potential for cross generational effects. Categories included within the definition of social outcomes are ill defined leading to potential gaps in research and service provision which could affect the ability of survivors to achieve their maximal potential. An e-Delphi study will be used to achieve expert consensus on the most important social outcomes for childhood cancer survivors to inform future research and ultimately, service provision.

METHODS AND ANALYSIS

A heterogeneous sample of at least 48 panel members will be recruited across four groups chosen to provide different perspectives on the childhood cancer journey: childhood cancer survivors, health professionals, social workers and teachers. Purposive sampling from a UK, regional long-term follow-up clinic will be used to recruit a representative sample of survivors. Other panel members will be recruited through local channels and national professional working groups. Opinions regarding breakdown and relevance of categories of social outcome will be collected through 3-5 rounds of questionnaires using an e-Delphi technique. Open ended, 7-point Likert scale and ranking questions will be used. Each round will be analysed collectively and per group to assess inter-rater agreement. Agreement and strength of agreement will be indicated by a median score of 6 or 7 and mean absolute deviation from the median, respectively.

ETHICS AND DISSEMINATION

Ethical approval for this study has been granted by Regional Ethics Committee 4, West of Scotland (ID 297344). Study findings will be disseminated to involved stakeholders, published in a peer-reviewed journal and presented at conferences.

Consensus on the Best Practice Guidelines for Psychomotor Intervention in Preschool Children with Autism Spectrum Disorder

Psychomotor intervention has been used to promote development by the enhancement of psychomotor and socio-emotional competence. However, studies with high-quality evidence, describing psychomotor-intervention processes and outcomes are scarce. Therefore, we aimed to generate expert consensus regarding psychomotor-intervention guidelines to support psychomotor therapists through the design and implementation of interventions for preschool (3−6 years old) children with autism spectrum disorder (ASD). A formal consensus process was carried out, using modified nominal group (phase I) and Delphi survey (phase II) techniques. We recruited 39 Portuguese experts in psychomotor intervention with preschool children with ASD in phase I. Experts participated in at least one of the five online meetings, discussing themes (e.g., objectives, methods, strategies) concerning psychomotor intervention with preschool children with ASD. A deductive thematic analysis from phase I resulted in 111 statements composing round 1 of the Delphi survey. Thirty-five experts completed round 1, and 23 round 2. The experts reached a consensus (agreement > 75%) on 88 statements, grouped under 16 sections, (e.g., intervention source, general setting, intended facilitation-style), reflecting generic psychomotor-intervention guidelines. Consensus guidelines may be used to support transparent and standard psychomotor interventions, although further studies should be undertaken to determine their efficacy.

Management of Endometrial Cancer: French Society of Onco-Gynecology's Evaluation through a Delphi Survey

Our aim was to assess the opinion of a panel of experts and obtain a consensus on the management of endometrial cancer in France and French Switzerland. A Delphi survey was carried out among a panel of French and French-speaking Swiss experts. The first questionnaire included 65 questions divided into eight categories: characterization of experts, histo-molecular characteristics and radiological data of endometrial cancer, and management of low-risk, intermediate-risk, intermediate-high-risk, high-risk, and metastatic cancers. The experts were asked to reply on a 9-point scale, both on the validity and the clarity of each question. After the answers were analyzed, a second questionnaire was sent to the same experts. The study took place between December 2021 and March 2022. Further, 58 (57.4%) of the 101 experts responded in the first round, and 39 recommendations were obtained (60%). Six questions were voted redundant and 20 discordant. These questions were reformulated, and, at the end of the second round, 17 recommendations were validated (85%). In total, the study presents an analysis of 56 questions and related responses. Expert advice helps to clarify non-consensual issues, standardize the management of endometrial cancer, and optimize clinical practices.

Perceptions and priorities for the development of multiplex rapid diagnostic tests for acute non-malarial fever in rural South and Southeast Asia: An international modified e-Delphi survey

Background

Fever is a common presenting symptom in low- and middle-income countries (LMICs). It was previously assumed that malaria was the cause in such patients, but its incidence has declined rapidly. The urgent need to develop point-of-care tests for the most important causes of non-malarial acute febrile illness is hampered by the lack of robust epidemiological data. We sought to obtain expert consensus on analytes which should be prioritized for inclusion in fingerprick blood-based multiplex lateral flow rapid diagnostic tests (LF-RDTs) targeted towards four categories of patients with acute non-malarial fever in South and Southeast Asian LMICs, stratified by age (paediatric vs. adult) and care setting (primary vs. secondary care).

Methodology/Principal findings

We conducted a two-round modified e-Delphi survey. A total of 84 panellists were invited, consisting of seven each from 12 countries, divided into three regional panels (Mainland Southeast Asia, Maritime Southeast Asia, and South Asia). Panellists were asked to rank their top seven analytes for inclusion in LF-RDTs to be used in each patient category, justify their choices, and indicate whether such LF-RDTs should be incorporated into algorithm-based clinical decision support tools. Thirty-six panellists (43%) participated in the first round and 44 (52%) in the second. There was consensus that such LF-RDTs should be incorporated into clinical decision support tools. At a minimum, these LF-RDTs should be able to diagnose dengue and enteric fever in all patient categories. There was a clear preference to develop LF-RDTs for pathogens not readily detected by existing technologies, and for direct diagnosis through antigen detection. Pathogen biomarkers were prioritized over host inflammatory biomarkers, with CRP being the only one ranked consistently highly.

Conclusions/Significance

Our results provide guidance on prioritizing analytes for inclusion in context-specific multiplex LF-RDTs and similar platforms for non-malarial acute febrile illness, for which there is an urgent unmet need.

Health Equity in Pediatric Drug Development: Translating Aspiration into Operation

The concept of health equity-the attainment of the highest possible level of health for all members of society-requires equitable access to all aspects of healthcare, including pediatric drug development. However, many communities are under-represented in pediatric drug development programs. Barriers to participation include geographic, economic, racial/ethnic bias, legal, cultural, linguistic, and other factors. While there is no "one size fits all" approach to addressing these barriers, community engagement and collaboration is recognized by the Centers for Disease Control, the World Health Organization, and other global health organizations as a cornerstone for building a more equitable healthcare system. In this article, we will present case studies of stakeholder and community engagement in clinical research for rare diseases and other areas of healthcare, as examples of strategies and practices for actively involving under-represented communities and fostering their participation in pediatric drug development programs. These studies may serve as templates for facilitating equity in pediatric drug development from aspiration into operation.

What Do Medical Physicists Do? Leadership and Challenges in Administration and Various Business Functions

The goal of the present study was to investigate the primary role of medical physicists (MPs) in radiation oncology (RO) administration and key business functions, besides various challenges facing today. An experienced MP leader formulates a well-structured department administration and management system in RO. The essential role of MP team leaders in health care is not only limited to supervising routine department clinical works but also being substantially involved in key business functions such as leadership, operations, project management, decision making, and many more. Furthermore, leadership appointments are equally important for the department and the health care organizations to a significant extent; the right competitive leaders with the right education and ample experience are necessary to operate administration and to perform various related business functions. To improve leadership qualities for individuals, a structured formal education with intensive training is necessary because leadership positions are associated with several complex business-related functions. A structured education or training could be received from various premier academies or institutions in the nation. Structured university academic programs (certificate, degree, or doctoral) in health care administration or management are highly beneficial for MPs who aspire to future leadership positions in RO due to high business complexities in health care organizations; however, this element is currently not enforced for MP leadership positions in the United States.

What adults with ADHD want to know: A Delphi consensus study on the psychoeducational needs of experts by experience

INTRODUCTION

A lack of knowledge about attention-deficit/hyperactivity disorder (ADHD) can contribute to feelings of distress and difficulty in seeking and accepting an ADHD diagnosis. The present study uses a Delphi consensus design to investigate the psychoeducational needs of adults with ADHD and the information about ADHD they would like included in digital health interventions for adults with ADHD. Inclusion of perspectives of service users in developing such interventions ensures that they are evidence based and addresses the risks of engagement barriers.

METHODS

The expert panel consisted of 43 adults with ADHD (age range: 23-67 years). Panel members were asked to rate the importance of the proposed topics and provide additional suggestions. Suggested topics and topics that did not achieve consensus were included for ranking in the second round.

RESULTS

Interquartile ratings were used to determine consensus. A high consensus was achieved in both rounds, with an agreement on 94% of topics in the first round and 98% in the second round. Most topics were rated as important or essential.

CONCLUSIONS

The findings highlighted that adults with ADHD want to learn about many different aspects of ADHD and the importance of considering their perspectives when developing psychosocial interventions. Findings can be applied when creating psychoeducational content for adult ADHD.

PATIENT OR PUBLIC CONTRIBUTION

Adults with ADHD were recruited to the Delphi panel to use an experts-by-experience approach. In doing so, we are engaging service users in the development of a psychoeducational smartphone app. The evaluation of the app will involve interviews with app users. Additionally, the present study was developed and conducted with ADHD Ireland, a charity based in Ireland that advocates for people with ADHD.

Reporting guidelines for Delphi techniques in health sciences: A methodological review

BACKGROUND

Delphi techniques are conducted across different subfields in the health sciences. The reporting practices of studies using Delphi techniques vary, and current reporting guidelines for Delphi techniques focus on individual subfields of the health sciences or on different aspects of research and are therefore of limited applicability. The aim of this article was to identify similarities, differences, and possible shortcomings of existing Delphi reporting guidelines and to draft an initial proposal for a comprehensively applicable reporting guideline.

METHODS

A systematic literature search for reporting guidelines on Delphi studies was performed in existing data resources based on databases in the health sciences (Scopus, MEDLINE, CINAHL, Epistemonikos) including publications from 2016 to 2021. In June 2021, we conducted an additional search in PubMed and included further studies by contacting experts of the scientific Delphi expert network (DeWiss). Title and abstract screening of articles was performed, followed by a full-text screening of the articles included. We qualitatively and quantitatively evaluated, compared and contrasted the reporting guidelines identified using content analysis and discussed the results among the members of the Delphi expert network.

RESULTS

We retrieved ten health science articles with reporting guidelines for Delphi studies. In analyzing them, we identified nine main categories (Justification, Expert panel, Questionnaire, Survey design, Process regulation, Analyses, Results, Discussion, Methods reflection & Ethics). The current reporting guidelines vary significantly, with only the aspect of consensus appearing in all of them. Frequency distributions show that most of the subcategories are only addressed in individual articles (e.g., meeting of participants, proceeding with the survey method, transfer of the results, validation, prevention of bias) and that epistemological foundations of the Delphi technique are rarely mentioned or reflected on. We drafted an initial proposal for Delphi reporting guidelines for the health science sector.

DISCUSSION

A well-justified position concerning epistemological foundations of Delphi studies is necessary to make the quality of the process assessable and, along with the reporting of the process, to classify and compare study results. This will increase the acceptance of both the method in the health science sector and the results in medical practice. A Delphi reporting guideline must, above all, take into account the diversity of variants, subfield-related objectives and application areas, and their modifications of the Delphi technique in order to be comprehensively applicable in the health sciences.

CONCLUSION

The results of our methodological review do not provide a final reporting guideline. The newly developed proposal is intended to encourage discussion and agreement in further analyses.

Developing a translational triage research tool: part two-evaluating the tool through a Delphi study among experts

Background

There are different prehospital triage systems, but no consensus on what constitutes the optimal choice. This heterogeneity constitutes a threat in a mass casualty incident in which triage is used during multiagency collaboration to prioritize casualties according to the injuries’ severity. A previous study has confirmed the feasibility of using a Translational Triage Tool consisting of several steps which translate primary prehospital triage systems into one. This study aims to evaluate and verify the proposed algorithm using a panel of experts who in their careers have demonstrated proficiency in triage management through research, experience, education, and practice.

Method

Several statements were obtained from earlier reports and were presented to the expert panel in two rounds of a Delphi study.

Results

There was a consensus in all provided statements, and for the first time, the panel of experts also proposed the manageable number of critical victims per healthcare provider appropriate for proper triage management.

Conclusion

The feasibility of the proposed algorithm was confirmed by experts with some minor modifications. The utility of the translational triage tool needs to be evaluated using authentic patient cards used in simulation exercises before being used in actual triage scenarios.

Prioritization of Vaccines for Inclusion into China’s Expanded Program on Immunization: Evidence from Experts’ Knowledge and Opinions

Background: Vaccine developers in China have made an increasing number of infectious diseases preventable through vaccination. An appropriate decision-making procedure is necessary for making wise decisions on whether to introduce new vaccines into the Expanded Program on Immunization (EPI). When there are several vaccines that could potentially be considered, a scientifically justifiable mechanism is needed for prioritizing and sequencing vaccines for consideration. Methods: We used a modified Delphi technique (MDT) to develop and refine an indicator system to prioritize vaccines and make policy recommendations concerning their introduction into China’s EPI system. From January through May 2021, thirty-nine experts were recruited and participated in a two-round Delphi survey that was based on a set of candidate indicators obtained through a literature review and reference to the WHO vaccine introduction recommendations. Using the resulting indicator system, we conducted a third consultation with a multi-disciplinary group of experts who scored five program-eligible candidate vaccines to determine prioritization and sequencing for consideration of inclusion into the EPI. Results: Response rates of the thirty-nine experts were 100% and 97.4% across the two rounds. Authority coefficients from rounds one to three were over 0.70, reflecting the high accuracy and reliability of the consultation. Coordination coefficients of importance scores for primary, secondary, and tertiary indicators were 0.486, 0.356, 0.275 in round one, and 0.405, 0.340, and 0.236 in round two. According to the scores from 30 experts using our indicator system, the sequence and scores (1–10 scale, 10 highest) of 5 candidate vaccines were varicella (6.91), meningococcal conjugate AC (6.83), Hib (6.74), influenza (6.56), and EV71 (6.17) vaccines. Conclusions: A modified Delphi technique effectively built a scientific, rational, comprehensive, and systematic indicator system for prioritizing vaccine candidates for consideration of inclusion into the EPI. The rank order will be used by the technical working groups of China’s National Immunization Advisory Committee to sequentially develop and present Evidence-to-Recommendation tables for making policy recommendations.

Expert consensus for a national essential antidote list: E-Delphi method

Antidote stocking represents a major challenge to hospitals all over the world, including Kuwait. In order to assist hospitals to reduce costs and improve patient care, an essential antidote list can be used as an initial foundation for securing sufficient antidote availability at healthcare institutions. The aim of our study is to generate a nationally relevant essential antidote list for emergency care hospitals in Kuwait using the e-Delphi method by establishing consensus through a multidisciplinary expert group of healthcare providers. An electronic survey with 47 essential antidotes was developed. The e-Delphi method was used, with three rounds of voting, to determine expert consensus on an essential antidote list for hospitals in Kuwait. A purposive sample of healthcare professionals from governmental and private hospitals were selected for this study (n = 30). Consensus was gained if ≥75% of the expert panel agreed on the inclusion of the antidote, without any strong disagreements. Round 1 of the e-Delphi resulted in 41 antidotes reaching consensus and seven new antidotes suggested by the expert panel. Round 2 had two antidotes (out of seven newly suggested ones) reaching consensus. Round 3 was a confirmatory round, where the expert group agreed on their previous rounds’ opinions. This resulted in the development of an essential antidote list with 43 antidotes. The optimal approach for ensuring adequate availability of antidotes is continuous monitoring of local poisoning incidence and antidote requirements through collaborations between academic researchers and emergency care clinicians. The development of an essential antidote list, with expert consensus, is one of the initial steps in securing a foundation for appropriate provision of antidotes at all healthcare institutions. This is the first study that the authors are aware of that demonstrates that the e-Delphi technique can consolidate recommendations of experts in emergency medicine to provide a list of essential antidotes.

Interventions addressing the adolescent HIV continuum of care in South Africa: a systematic review and modified Delphi analysis

INTRODUCTION

Compared with adults, adolescents in South Africa have larger gaps at each step of the HIV continuum of care resulting in low levels of viral suppression.

METHODS

We conducted a systematic review and modified Delphi analysis of interventions addressing the HIV continuum of care for adolescents in South Africa. We searched PubMed, Science Direct, and Google Scholar and online conference proceedings from the International AIDS Society, the International AIDS Conference, and the Conference on Retrovirology and Opportunistic Infections from 1 January 2010 to 30 September 2020. We then conducted a modified Delphi analysis with 29 researchers involved in the National Institutes of Health's Fogarty International-supported Adolescent HIV Implementation Science Alliance-South Africa to evaluate interventions for efficacy, feasibility and potential for scale-up.

RESULTS

We identified nine initial published articles containing interventions addressing the adolescent HIV continuum of care in South Africa, including five interventions focused on HIV diagnosis, two on antiretroviral therapy adherence and two on retention in care. No studies addressed linkage to care or transition from paediatric to adult care. Two studies discussed intervention costs. In-home and HIV self-testing, community-based adherence support, and provision of adolescent-friendly services were the most impactful and scalable interventions addressing the adolescent HIV continuum of care.

CONCLUSION

Future interventions should work comprehensively across the adolescent HIV continuum of care and be tailored to the specific needs of adolescents.

Needs to Create Healthy Living Environments-A Two-Stage Delphi Survey in Europe to Identify Facilitating Factors and Barriers in Municipal Health Promotion

(1) In the field of health promotion, municipalities offer opportunities to reduce SES-based health inequalities by addressing vulnerable communities. This research project aims to identify facilitating and inhibiting factors for the creation of healthy living environments. (2) After preliminary literature and qualitative research work, an online-based Delphi survey was conducted (December 2020-March 2021). This included the rating and commentating of 22 theses at two times, whereby the results of the first round of rating were visible to the participants the second time. (3) Twelve experts from seven European countries participated in the Delphi survey across both rounds (1st round: n = 37; 12 countries). The consensus was particularly clear with regard to providing resources, which, in turn, are especially necessary for involving target groups in health promotion. (4) The results illustrate the relevance of further cross-national exchange. Certain aspects however, such as the HiAP approach or strategies to reach disadvantaged groups, are still challenging in practice. In order to develop concrete recommendations, the theses need to be further operationalised. The Delphi method offers a suitable possibility to map international expertise in this field and with a focus on health equity.

Development of a professional competency framework for Australian sonographers-perspectives for developing competencies using a Delphi methodology

BACKGROUND

Professional competencies are important for enhancing alignment between the needs of education, industry and health consumers, whilst describing public expectations around health professionals. The development of competency standards for the sonography profession defines the behaviours, skills and knowledge sonographers should demonstrate for each learning and experience level.

OBJECTIVE

The objective of this project was to develop a set of professional competency standards for the sonography profession which described in depth the behaviours, skills and knowledge sonographers should demonstrate across multiple learning and experience levels.

METHODS

Representatives of three Australian ultrasound professional associations and seven tertiary institutions involved in entry-level sonographer education in Australia formed a research team (RT). The RT recruited an expert panel that responded to six survey rounds. Using a Delphi methodology, the results and free-text comments from each previous round were fed back to participants in the subsequent survey rounds to achieve a consensus.

RESULTS

The project developed a professional competency framework for sonographers, which included four major domains: detailed competency standards, sonographer knowledge, sonographer attitudes and a holistic competency matrix [https://doi.org/10.6084/m9.figshare.17148035.v2.].

CONCLUSION

The Delphi methodology is an effective way to develop professional competency standards. This paper describes the methods and challenges in developing such standards for sonographers which could be translated to other health professionals.

Design and validity of an instrument to assess healthcare professionals' perceptions, behaviour, self-efficacy and attitudes towards evidence-based health practice: I-SABE

OBJECTIVES

To develop and validate an instrument to measure Brazilian healthcare professionals' perceptions, behaviour, self-efficacy and attitudes towards evidence-based health practice.

DESIGN

Validation of an instrument using the Delphi method to ensure content validity and data from a cross-sectional survey to evaluate psychometric characteristics (psychometric sensitivity, factorial validity and reliability).

SETTING

National Register of Health Establishments database.

PARTICIPANTS

We included clinical health professionals who were working in the Brazilian public health system.

RESULTS

The Instrument to assess Evidence-Based Health (I-SABE) was constructed with five domains: self-efficacy; behaviour; attitude; results/benefits and knowledge/skills. Content validity was done by 10-12 experts (three rounds). We applied I-SABE to 217 health professionals. Bartlett's sphericity test and the Kaiser-Meyer-Olkin (KMO) index were adequate (χ²=1455.810, p<0.001; KMO=0.847). Considering the factorial loads of the items and the convergence between the Scree Plot and the Kaiser criterion the four domains tested in this analysis, explaining 59.2% of the total variance. The internal consistency varied between the domains: self-efficacy (α=0.76), behaviour (α=0.30), attitudes (α=0.644), results/benefits to the patient (α=0.835).

CONCLUSIONS

The results of the psychometric analysis of the I-SABE confirm the good quality of this tool. The I-SABE can be used both in educational activities as well as an assessment tool among healthcare professionals in the Brazilian public health settings.

Belgian consensus on irritable bowel syndrome

BACKGROUND

Irritable bowel syndrome (IBS) is characterised by recurrent abdominal pain related to defaecation or associated with altered stool frequency or consistency. Despite its prevalence, major uncertainties in the diagnostic and therapeutic management persist in clinical practice.

METHODS

A Delphi consensus was conducted by 20 experts from Belgium, and consisted of literature review and voting process on 78 statements. Grading of recommendations, assessment, development and evaluation criteria were applied to evaluate the quality of evidence. Consensus was defined as > 80 % agreement.

RESULTS

Consensus was reached for 50 statements. The Belgian consensus agreed as to the multifactorial aetiology of IBS. According to the consensus abdominal discomfort also represents a cardinal symptom, while bloating and abdominal distension often coexist. IBS needs subtyping based on stool pattern. The importance of a positive diagnosis, relying on history and clinical examination is underlined, while additional testing should remain limited, except when alarm features are present. Explanation of IBS represents a crucial part of patient management. Lifestyle modification, spasmolytics and water-solube fibres are considered first-line agents. The low FODMAP diet, selected probiotics, cognitive behavioural therapy and specific treatments targeting diarrhoea and constipation are considered appropriate. There is a consensus to restrict faecal microbiota transplantation and gluten-free diet, while other treatments are strongly discouraged.

CONCLUSIONS

A panel of Belgian gastroenterologists summarised the current evidence on the aetiology, symptoms, diagnosis and treatment of IBS with attention for the specificities of the Belgian healthcare system.

In Response to: Corticosteroids in Non-severe COVID-19: Finding Window of Opportunity

Nasa P, Chaudhry D. In Response to: Corticosteroids in Non-severe COVID-19: Finding Window of Opportunity. Indian J Crit Care 2022;26(3):405.

Infection control in the intensive care unit: expert consensus statements for SARS-CoV-2 using a Delphi method

During the current COVID-19 pandemic, health-care workers and uninfected patients in intensive care units (ICUs) are at risk of being infected with SARS-CoV-2 as a result of transmission from infected patients and health-care workers. In the absence of high-quality evidence on the transmission of SARS-CoV-2, clinical practice of infection control and prevention in ICUs varies widely. Using a Delphi process, international experts in intensive care, infectious diseases, and infection control developed consensus statements on infection control for SARS-CoV-2 in an ICU. Consensus was achieved for 31 (94%) of 33 statements, from which 25 clinical practice statements were issued. These statements include guidance on ICU design and engineering, health-care worker safety, visiting policy, personal protective equipment, patients and procedures, disinfection, and sterilisation. Consensus was not reached on optimal return to work criteria for health-care workers who were infected with SARS-CoV-2 or the acceptable disinfection strategy for heat-sensitive instruments used for airway management of patients with SARS-CoV-2 infection. Well designed studies are needed to assess the effects of these practice statements and address the remaining uncertainties.