Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review

THE Key Elements of the Exercise Prescription Process in Musculoskeletal Rehabilitation in a One-On-One Setting. A Delphi Study of Australian Physiotherapy Specialists

BACKGROUND

Clinical decision making to develop an exercise program and then prescribe that program should be based on the best evidence available. However, little evidence exists to guide the development of an exercise program, determining optimal dosage parameters or for effective prescription techniques to achieve best patient outcomes possible.

OBJECTIVE

To gain consensus from expert clinical physiotherapists in the field of musculoskeletal rehabilitation on key recommendations for developing and prescribing effective exercise programs in musculoskeletal rehabilitation in a one-on-one setting.

METHODS

Delphi study method involving three rounds of questionnaires with subsequent rounds developed based upon results of the previous round, aiming to achieve consensus in the final round. The consensus threshold was set at 80% agreement. Participants were physiotherapists considered experts in the field of musculoskeletal rehabilitation as acknowledged by the Australian College of Physiotherapists, being Clinical Fellows of the College in musculoskeletal or sports and exercise physiotherapy.

RESULTS

Thirteen experts completed the three rounds of questionnaires. Most experts reported 'always' prescribing exercises to their patients. The expert clinicians agreed that a clinician should blend evidence-based protocols, clinical experience, and empirical knowledge to develop the exercise program, and then tailor the program further based on individual patient factors. Most experts agreed that it was essential to collaborate with the patient when designing the exercise program.

CONCLUSION

Future research is needed to determine the effectiveness and necessity of each element of the exercise program in musculoskeletal rehabilitation in a one-on-one setting to achieve best patient outcomes possible.

Differential diagnosis of autism, attachment disorders, complex post-traumatic stress disorder and emotionally unstable personality disorder: A Delphi study

Individuals diagnosed with autism, attachment disorders, emotionally unstable personality disorder (EUPD) or complex post-traumatic stress disorder (CPTSD) can present with similar features. This renders differential and accurate diagnosis of these conditions difficult, leading to diagnostic overshadowing and misdiagnosis. The purpose of this study was to explore professionals' perspectives on the differential diagnosis of autism, attachment disorders and CPTSD in young people; and of autism, CPTSD and EUPD in adults. A co-produced three-round Delphi study gathered information through a series of questionnaires from 106 international professionals with expertise in assessing and/or diagnosing at least one of these conditions. To provide specialist guidance and data triangulation, working groups of experts by experience, clinicians and researchers were consulted. Delphi statements were considered to have reached consensus if at least 80% of participants were in agreement. Two hundred and seventy-five Delphi statements reached consensus. Overlapping and differentiating features, methods of assessment, difficulties encountered during differential diagnosis and suggestions for improvements were identified. The findings highlight current practices for differential diagnosis of autism, attachment disorders, CPTSD and EUPD in young people and adults. Areas for future research, clinical and service provision implications, were also identified.

Development and Preliminary Validation of a Central Venous Access Device-Associated Skin Impairment Classification Tool Using Modified Delphi and Clinimetric Methods

BACKGROUND

An evidence and consensus-based instrument is needed to classify central venous access device-associated skin impairments.

AIM

The aim of this study was to design and evaluate the central venous access device-associated skin impairment classification tool.

DESIGN

A two-phase modified Delphi study.

METHODS

This two-phase study consisted of a literature review, followed by the development and validation of a classification instrument, by experts in the fields of central venous access devices and wound management (Phase 1). The instrument was tested (Phase 2) using 38 clinical photographs of a range of relevant skin impairments by the same expert panel. The expert panel consisted of registered nurses who were clinical researchers (n = 4) and clinical experts (n = 3) with an average of 24 years of nursing and research experience and 11 years of experience in wound management. Measures to assess preliminary content validity and inter-rater reliability were used.

RESULTS

The instrument consists of five overarching aetiological classifications, including contact dermatitis, mechanical injury, infection, pressure injury and complex clinical presentation, with 14 associated subcategory diagnoses (e.g., allergic dermatitis, skin tear and local infection), with definitions and signs and symptoms. High agreement was achieved for preliminary scale content validity and item content validity (I-CVI = 1). Inter-rater reliability of aetiologies was high. The overall inter-rater reliability of individual definitions and signs and symptoms had excellent agreement.

CONCLUSION

The development and preliminary validation of this classification tool provide a common language to guide the classification and assessment of central venous access device-associated skin impairment.

IMPACT

The comprehensive and validated classification tool will promote accurate identification of central venous access device-associated skin impairment by establishing a common language for healthcare providers. The availability of this tool can reduce clinical uncertainty, instances of misdiagnosis and the potential for mismanagement. Consequently, it will play a pivotal role in guiding clinical decision-making, ultimately enhancing the quality of treatment and improving patient outcomes.

REPORTING METHOD

The Guidance on Conducting and Reporting Delphi Studies (CREDES) was adhered to.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

Key Aspects of Recovery-Oriented Practice in Caring for People With Mental Ill-Health in General Emergency Departments: A Modified Delphi Study

AIM

To identify key aspects of recovery-oriented practice in caring for people with mental ill-health in general emergency departments.

DESIGN

A modified Delphi study with three rounds.

METHODS

A 24-member expert panel was recruited consisting of people with lived experience of mental ill-health, registered nurses working in emergency care, registered nurses specialised in psychiatric and mental health nursing and mental health recovery researchers. In the initial round, important aspects of recovery-oriented practice were identified through focus group interviews. Thematic analysis generated statements that were then reformulated as a questionnaire for subsequent rounds. The experts rated each statement's perceived importance on a 5-point Likert scale. The consensus level was set at ≥ 80%. Descriptive statistics were used to analyse the data.

RESULTS

Consensus was reached on the importance of 39 of 73 statements, with ≥ 80% deemed 'very important' in recovery-oriented practice in general emergency departments.

CONCLUSION

The study emphasises the delicate balance between the essential elements of recovery-oriented practice, their practical feasibility and the predominant biomedical perspective in general emergency department care. It proposes strategies to empower nursing staff and managers to adopt recovery-oriented practices that enhance the quality of care for people with mental ill-health. Enabling staff by providing the necessary prerequisites and a care environment that supports reflective practices is crucial. The responsibility for facilitating these changes needs to be a shared commitment between nursing staff and managers.

IMPLICATIONS FOR THE PROFESSION AND/OR PATIENT CARE

The identified issues can serve as a framework for interventions, education and training to support the integration of recovery-oriented practice in general emergency care. They can also be used to develop tools for evaluating emergency care environments and promoting alignment with recovery-oriented principles.

IMPACT

Problem addressed: People with mental ill-health are at risk of being neglected, judged and dismissed in general emergency department care, creating obstacles to their mental health recovery.

MAIN RESULTS

The Delphi study identified 39 key aspects of recovery-oriented practice in general emergency departments, emphasising person-centred, strength-based, collaborative and reflective care.

IMPACT

The research seeks to establish a foundation for developing training programmes, education and interventions and for the integration of recovery-oriented practices in general emergency care. It thus has the potential to enhance the quality and equality of care for patients with mental ill-health in emergency care. The impact extends to nursing staff and managers as it seeks to empower them to systematically reflect on and reevaluate established emergency department practices to ensure that every person, irrespective of their health condition, is treated with dignity and respect in emergency department settings.

REPORTING METHOD

The CREDES guidance on conducting and reporting Delphi studies.

PATIENT OR PUBLIC CONTRIBUTION

The authors have nothing to report.

Applicability of Nursing Support for Patients With Terminal Cancer and Their Families: A Delphi Study

BACKGROUND

This report investigates the applicability of nursing support for patients with cancer with a prognosis of months and weeks, and their families.

OBJECTIVES

To evaluate the applicability of nursing support for five symptoms (dyspnea, pain, nausea/vomiting, constipation, and delirium) in patients with cancer during the last weeks of life, and the caregiver burden on their families.

DESIGN SETTING

A Delphi study was used to determine the applicability of nursing support for patients with terminal cancer and their families. Eight experts in symptom palliation in Japan who have direct care or research experience with these populations were included. The Delphi method was used to assess nursing support types for prognoses of months and weeks. Consensus was defined as ≥70% agreement for either "high applicability" or "low applicability" of each support type.

RESULTS

A total of 50 nursing support types for 5 symptoms were evaluated as highly applicable for 92% (n = 46) of patients with cancer with a prognosis of months. For patients with cancer with a prognosis of weeks, 78% (n = 39) of the nursing support was rated as highly applicable. For both prognosis groups, all nursing support (n = 6) for caregiver burden was highly applicable.

CONCLUSION

Applicability ratings of nursing support may be influenced by a high degree of invasiveness, accessibility of knowledge and information, and high expectations of effectiveness. Future studies are needed to verify the effectiveness of nursing support evaluated as highly applicable to patients with cancer during the last few months and weeks of life.

How to Approach a Child About Concerns for Their Mental Health and Seeking Help: A Delphi Expert Consensus Study to Develop Guidelines on Mental Health First Aid for Supporting Children

BACKGROUND

Adults who live or work with children are an important source of support and are gateways to professional help when a child is experiencing a mental health problem. This study aimed to develop consensus-based guidelines on how adults such as parents, educators or health professionals should approach a child aged 5-12 years to discuss concerns about the child's mental health and seek help.

METHODS

A Delphi consensus method with three rounds was used. Experts were recruited from six countries to form three panels: health professionals, educators and people with lived experience (parents and carers, and young people with mental health problems). Statements to be rated were sourced from an online search of websites designed for adults who live or work with children. Further suggestions for statements came from panellists. Statements that reached 80% consensus across all panels were included in the guidelines.

RESULTS

132 participants completed the Round 1 survey, reducing to 54 by Round 3. A total of 248 statements were presented to panel members, with 151 being endorsed and included in the guidelines.

CONCLUSIONS

These guidelines represent the first recommendations developed for members of the public providing mental health first aid to children aged 5-12 years.

PATIENT OR PUBLIC CONTRIBUTION

Lived experience advocates (i.e. those with lived experience of a mental health problem in childhood and/or caregiving experience of raising a child with a mental health problem) were involved at two stages of this research: As part of the Advisory Group for the project and as expert panel members. Advisory Group members provided input into the conduct of the study and the content and design of the research outputs. Panel members provided their expertise to review every item to be included in the guidelines, proposed new items to be included, and reviewed and approved the finalised output documents.

How Delphi studies in the health sciences find consensus: a scoping review

BACKGROUND

Delphi studies are primarily used in the health sciences to find consensus. They inform clinical practice and influence structures, processes, and framework conditions of healthcare. The practical research-how Delphi studies are conducted-has seldom been discussed methodologically or documented systematically. The aim of this scoping review is to fill this research gap and to identify shortcomings in the methodological presentation in the literature. On the basis of the analysis, we derive recommendations for the quality-assured implementation of Delphi studies.

METHODS

Forming the basis of this scoping review are publications on consensus Delphi studies in the health sciences between January 1, 2018, and April 21, 2021, in the databases Scopus, MEDLINE via PubMed, CINAHL, and Epistemonikos. Included were publications in German and English containing the words "Delphi" in the title and "health" and "consensus" in the title or abstract. The practical research was analyzed for the qualitative content of the publications according to three deductive main categories, to which an influence on the result of Delphi studies can be imputed (expert panel, questionnaire design, process and feedback design).

RESULTS

A total of 287 consensus Delphi studies were included in the review, whereby 43% reported having carried out a modified Delphi. In most cases, heterogeneous expert groups from research, clinical practice, health economics, and health policy were surveyed. In about a quarter of the Delphi studies, affected parties, such as patients, were part of the expert panel. In the Delphi questionnaires it was most common for standardized Likert scales to be combined with open-ended questions. Which method was used to analyze the open-ended responses was not reported in 62% of the Delphi studies. Consensus is largely (81%) defined as percentage agreement.

CONCLUSIONS

The results show considerable differences in how Delphi studies are carried out, making assessments and comparisons between them difficult. Sometimes an approach points to unintended effects, or biases in the individual judgments of the respondents and, thus, in the overall results of Delphi studies. For this reason, we extrapolate suggestions for how certain comparability and quality assurance can be achieved for Delphi studies.

Validating quality standards in Palestinian emergency departments: An e-Delphi survey approach

To validate Palestine's previously derived emergency department quality standards (EDQS) using an e-Delphi survey. A two-round e-Delphi survey validated the EDQS, developed in an earlier study through a literature review and consensus-building among Palestinian emergency medicine and healthcare quality experts. The study purposively sampled 53 emergency department and healthcare quality experts with over 5 years of experience. A Likert scale was used to rate the standards on readability, clarity, and comprehensiveness in the initial round to reach consensus on the EDQS, with detailed feedback. An expanded expert group refined the shortlisted standards in the next phase. Lime Survey collected data anonymously. A set of 100 EDQS was validated through a two-round e-Delphi survey. In the initial round, 103 standards were presented, and consensus was achieved, resulting in a refined list of 100 standards. Among these, 39 standards fell under the clinical pathway domain, and 61 under the administrative pathway domain. In the second round, the validity of these standards was affirmed, with 96.4% consensus for clinical standards and 97.3% for administrative standards. Additionally, seven subdomains of EDQS were associated with the clinical pathway domain: triage, treatment, transportation, medication safety, patient flow, and medical diagnostic services, and nine subdomains were linked to the administration pathway domain: documentation, information management systems, access-location, design, leadership, management, workforce staffing, training, equipment, supplies, capacity-resuscitation rooms, resources for a safe working environment, performance indicators, and patient safety-infection prevention and control programs. The study validated context emergency department quality standards in Palestine, with over 97% consensus indicating a commitment to quality care. Experts suggest further research on implementation feasibility. Validated standards can aid healthcare leaders in resource allocation, staff training, and enhancing patient care, potentially leading to significant improvements in emergency healthcare in Palestine.

Charting the path to the implementation of universal health coverage policy in Nigeria through the lens of Delphi methodology

BACKGROUND

Expanding access to equitable health insurance is an important lever towards the overall strategy for achieving universal health coverage. In Nigeria, health insurance coverage is low with a renewed government action on increasing access to and coverage of high-quality healthcare services to citizens, particularly for the vulnerable and poor population. Therefore, our study co-creates the priorities for expanding health insurance in Nigeria, focusing on key policy reforms, public advocacy, and innovative financing strategies to ensure broader and more equitable coverage for the population.

METHODOLOGY

We employed a Delphi approach methodology through strategic health insurance meetings with a diverse multidisciplinary panel of 125 stakeholders including representatives of accredited Health Insurance Maintenance Organizations, Heads of States Social Health Insurance Agencies, Development Partners representatives, academics, government officials, national health insurance authority expanded management team and experts in health insurance across all the states of Nigeria to recommend specific actions towards health insurance expansion and universal health coverage in Nigeria.

RESULTS

The participants/panels were able to come up with a consensus on 66 priorities for health insurance expansion in Nigeria working with stakeholders within the Nigerian health insurance ecosystem across the 36 states and Nigeria's FCT. From these priorities, seven priority areas and 17 themes were derived that should be considered by the government, policymakers, regulators, and practitioners to deepen health insurance penetration in Nigeria. These seven priority areas that have been identified include enrolment, equity, organizational health and structure, data and technology, quality, market efficiency, and citizen engagement.

CONCLUSION

The priorities identified for health insurance expansion in Nigeria will go a long way in shaping health insurance. We hope that government, policymakers, regulators, and practitioners in the health ecosystem will use these social policy actions to set priorities for increasing health insurance coverage and address inadequacies to accelerate the drive towards the attainment of UHC by 2030.

How to monitor and discriminate the causes of lower limb swelling during home-based rehabilitation after total knee arthroplasty? A delphi study

PURPOSE

Swelling in the lower limbs after total knee arthroplasty (TKA) affects surgical outcomes. Prolonged swelling requires monitoring and remote management during home-based rehabilitation. Causes of swelling vary but, so far, no indicators are available to monitor and identify causes of lower limb swelling, making it difficult to implement targeted interventions. This study aimed to find the indicators to monitor and identify the causes of lower limb swelling during home-based rehabilitation after TKA by literature research and consulting experts from various disciplines.

METHODS

The Delphi method was used. Based on literature research and analysis, a set of candidate indicators was developed. Fifteen experts from different disciplines evaluated the validity of the indicators and provided modification suggestions.

RESULTS

After two rounds of Delphi consultations, consensus was reached. Agreement scores ranged from 4.40 to 5.00, with low variability (standard deviation 0.00-0.91) and high consistency (coefficient of variation 0.00-0.20). P was less than 0.05 in Kendall's W with an agreement rate of 80.00-100%. In the final set of indicators, there were five primary indicators (representing four swelling causes and a general category), along with 23 secondary indicators and 40 tertiary indicators.

CONCLUSIONS

This study preliminarily established indicators for at-home identification of post-TKA swelling caused by four distinct reasons. Further research is needed to validate the value of these indicators in distinguishing the causes of swelling.

Expert Consensus on Developing Information and Communication Technology-Based Patient Education Guidelines for Rheumatic Diseases in the Korea

BACKGROUND

This study aimed to identify key priorities for the development of guidelines for information and communication technology (ICT)-based patient education tailored to the needs of patients with rheumatic diseases (RDs) in the Republic of Korea, based on expert consensus.

METHODS

A two-round modified Delphi study was conducted with 20 rheumatology, patient education, and digital health literacy experts. A total of 35 items covering 7 domains and 18 subdomains were evaluated. Each item was evaluated for its level of importance, and the responses were rated on a 4-point Likert scale. Consensus levels were defined as "high" (interquartile range [IQR] ≤ 1, agreement ≥ 80%, content validity ratio [CVR] ≥ 0.7), "Moderate" (IQR ≥ 1, agreement 50-79%, CVR 0.5-0.7), and "Low" (IQR > 1, agreement < 50%, CVR < 0.5).

RESULTS

Strong consensus was reached for key priorities for developing guidelines in areas such as health literacy, digital health literacy, medical terminology, user interface, and user experience design for mobile apps. Chatbot use and video (e.g., YouTube) also achieved high consensus, whereas AI-powered platforms such as ChatGPT showed moderate-to-high agreement. Telemedicine was excluded because of insufficient consensus.

CONCLUSION

The key priorities identified in this study provide a foundation for the development of ICT-based patient education guidelines for RDs in the Republic of Korea. Future efforts should focus on integrating digital tools into clinical practice to enhance patient engagement and improve clinical outcomes.

International Expert Consensus on Relevant Health and Functioning Concepts to Assess in Users of Tobacco and Nicotine Products: Delphi Study

BACKGROUND

A Delphi study was conducted to reach a consensus among international clinical and health care experts on the most important health and functioning self-reported concepts when evaluating a switch from smoking cigarettes to using smoke-free tobacco and/or nicotine products (sf-TNPs).

OBJECTIVE

The aim of this research was to identify concepts considered important to measure when assessing the health and functioning status of users of tobacco and/or nicotine products.

METHODS

Experts (n=105), including health care professionals, researchers, and policy makers, from 26 countries with professional experience and knowledge of sf-TNPs completed a 3-round, adapted Delphi panel. Online surveys combining quantitative (MaxDiff best-worst scaling and latent class analysis) and qualitative assessments were used to rank and achieve alignment on the importance of 69 health and functioning concepts. All experts participating in round I completed round II, and 101 (95%) completed round III.

RESULTS

The round I analysis identified 36 (52%) out of 69 concepts that were refined for the round II assessment. The highest-ranked concepts reflected health-related impacts, while the lowest-ranked ranked concepts were related to aesthetics and social impacts. Round II ranking reinforced the importance of concepts relating to health impacts, and the analysis resulted in 20 concepts retained for round III assessment. In round III, the 4 highest-ranked concepts were cardiovascular symptoms, shortness of breath, chest pain, and worry about smoking-related diseases and impact on general health, and they made up 50% of the total score in the MaxDiff analysis. Experts reported likelihood of seeing measurable levels of change in the final 20 concepts with a switch to an sf-TNP. The majority of experts felt it was "likely" or "extremely likely" to observe changes in concepts such as gum problems (74/101, 73%), phlegm or mucus while coughing or not coughing (72/101, 71%), general perception of well-being (72/101, 71%), and throat irritation or sore throat (72/101, 71%). Latent class analysis revealed subgroups of experts with different perceptions of the relative importance of the concepts, which varied depending on professional specialty and geographic region. For example, 74% (14/19) of oncologists aligned with the subgroup prioritizing physical health symptoms, while 71% (12/17) of experts from Asia aligned with the subgroup considering both physical health and psychosocial aspects.

CONCLUSIONS

This study identified key concepts to be considered in the development of a new measurement instrument to assess the self-reported health and functioning status of individuals using sf-TNPs. The findings contribute to the scientific evidence base for understanding and evaluating both the individual and public health impacts of sf-TNPs.

Type 2 inflammation: a Portuguese consensus using Web-Delphi and decision conferencing (INFLAT2-PT)

OBJECTIVES

Atopic/allergic diseases impose a growing burden on public health, affecting millions of patients worldwide. The main objective of this study was to develop a national expert consensus on relevant clinical questions related to type 2 inflammation.

METHODS

We conducted: a comprehensive literature review with a qualitative analysis to identify the most repeated themes on the overlap of conditions; a modified 3-round Web-Delphi (or e-Delphi); and a final online decision conference.

RESULTS

We included 51 studies. Following three Web-Delphi rounds, we ended up with 30 statements with a 76% overall full agreement rate, 16% agreement, 2% disagreement, and 0% full disagreement. The decision conference enabled adjustments, and the expert panel agreed unanimously on the final set of statements. The consensus used evidence synthesis, Web-Delphi, and decision conference to produce 30 statements on type 2 inflammation as a driver for multimorbidity in asthma, certain rhinitis phenotypes, atopic dermatitis, chronic rhinosinusitis with nasal polyps, and eosinophilic esophagitis grouped under five domains in underlying pathophysiology, multimorbidity, diagnosis and management, multidisciplinary management, and impact on mental health.

CONCLUSION

We expect the first Portuguese expert consensus INFLAT2-PT to promote understanding of type 2 inflammation diseases, multidisciplinary care, integrated care pathways, future research, and inform health authorities.

Generation of Indicators to Assess Quality of Health Care in Hospital at Home Through e-Delphi

BACKGROUND AND OBJECTIVES

The quality of health care in hospital at home (HaH) has been measured in different countries using simple indicators and clinical results that only contribute to some dimensions of the quality of health care. We sought to generate indicators to comprehensively evaluate the quality of health care provided to HaH users through the e-Delphi technique.

METHODS

The e-Delphi technique was performed with the participation of 17 HaH experts. The methodological strategy applied in this study was divided into the following 3 phases: a preparatory phase; consultation phase; and consensus phase. Three rounds of consultations were conducted with experts. In round 1, they were asked to identify which aspects of HaH they believed should be evaluated using an indicator for each of the following 6 dimensions of health care quality: effectiveness; efficiency; timeliness; patient-centered care; equity; and safety. In round 2, they were asked to rate each indicator using a 5-point Likert-type scale with the following values: (1) Totally disagree; (2) Disagree; (3) Moderately agree; (4) Agree; and (5) Totally agree. The criteria for evaluating each indicator were as follows: (1) The indicator is a useful measure for assessing the quality of health care provided to HaH users. (2) The indicator is clearly and specifically written and does not require modification. (3) The indicator is essential and incorporates information that can be extracted from HaH program records. An indicator was considered approved if it received at least 65% approval from the expert panel for each evaluation criterion. In round 3, experts were asked to reassess their ratings, taking into account the opinions of the other experts. The reliability of this technique was ensured through credibility, reliability, and confirmability. We obtained ethical approval of the corresponding institutions and informed consent from the participating experts.

RESULTS

Nine unpublished and reliable indicators were generated. In addition, 13 indicators were incorporated that evaluate aspects previously analyzed by other authors and/or national and international institutions, which were adapted to be used in HaH. The total indicators generated (n = 22) represented all dimensions of the quality of health care: safety; opportunity; effectiveness; efficiency; equity; and patient-centered care.

CONCLUSIONS

The 22 indicators generated through the e-Delphi technique permit a comprehensive evaluation of the quality of health care provided to HaH users.

Recommendations for Psychosocial Support for Long-Distance Caregivers of Terminally Ill Patients

CONTEXT

The provision of appropriate psychosocial support has a significant impact on quality of life for informal caregivers of terminally ill patients. Long-distance caregivers have specific wishes and needs for psychosocial support.

OBJECTIVES

To date, no formal support measures for long-distance caregivers of terminally ill patients have been developed in Germany. The national Delphi study aimed at systematically and empirically generating recommendations for psychosocial support measures, tailored to this population.

METHODS

Recommendations were formulated on the basis of qualitative interviews exploring the support experiences and unmet needs of long-distance caregivers of terminally ill patients. Experts from hospice and palliative care rated the relevance and feasibility of 10 recommendations using two 4-point Likert-type scales. Additionally, suggestions for improvement were captured via free text fields. Recommendations were deemed to have achieved consensus when ≥ 80% of participants indicated "strongly agree" or "somewhat agree" for both relevance and feasibility.

RESULTS

A total of 26 experts completed two Delphi rounds. Following the first round, eight of the 10 recommendations were revised according to participant feedback. After the second round, consensus was achieved for five of these revised recommendations. Three recommendations were rejected, as participants regarded them unfeasible due to a perceived lack of personnel resources.

CONCLUSION

The consensus-based recommendations represent the first empirically grounded guidelines in Germany aimed at addressing the psychosocial needs of long-distance caregivers of terminally ill patients. The recommendations seek to raise awareness among both professional and voluntary workers regarding the specific support requirements of this understudied population.

Use of Essential Medicines for Pain Relief and Palliative Care: A Global Consensus Process

CONTEXT

The WHO Model List of Essential Medicines includes 24 medications under the section Medicines for Pain and Palliative Care (EML). The Lancet Commission on Pain and Palliative Care developed the Lancet Essential Package (LEP), including 35 medications designed to alleviate serious health-related suffering worldwide.

OBJECTIVES

This study aims to provide recommendations on the appropriate use of essential of medicines in palliative care.

METHODS

The global palliative care community was invited to submit guidelines, of which 19/22 were selected. Data was extracted on initial dose, frequency, and maximum daily dose for medications in the LEP and in the WHO EML. For medications where guidance was not available or information differed, a 2-round Delphi process was conducted with 70 experts across regions and income levels. Consensus was set to ≥70% agreement.

RESULTS

Consensus in the guidelines was identified for 24 medications on three parameters. Open questions (mostly on maximum daily dose) were included in the Delphi. 63 experts from 49 countries responded (RR = 90%). No consensus was achieved for the maximum daily dose for nine medications. Significant disparities in medication availability were noted between high-income and low/middle-income countries.

CONCLUSION

We were able to partly achieve our goal, with limited evidence and a wide range of clinical practice described by the experts. This highlights an important gap in critical information which affects mostly the provision of palliative care at the primary care. Both limited availability and lack of training on the adequate use of essential medications may affect how clinicians manage symptoms, possibly relying on personal experience or trial and error, rather than evidence-based information.

Development and validation of an assessment approach for competency-based nursing education in low-income settings: A consensus study

AIM

To report the development and validation of an assessment approach for competency-based nursing education in low-income settings BACKGROUND: Adopting a competency-based curriculum has been linked with the resource-intensive, programmatic assessment approach. However, implementing this approach in low-income contexts has challenges. Nursing education institutions in low-income contexts reported difficulties implementing programmatic assessment. These challenges threaten the outcomes of the assessment innovation, highlighting the need to develop a tailored approach to assessment for these contexts.

DESIGN

A modified e-Delphi study METHODS: The modified e-Delphi was used to refine and validate a proposed assessment approach following the recommendations of Conducting and REporting of DElphi Studies. Nine health professions education experts, with qualifications or publications in educational assessment, or curriculum design and development, were purposively sampled to validate the proposed assessment approach. Consensus was reached at ≥ 70 % after two iterative rounds. Items included in the two rounds were the six domains which described organisational contexts in terms of the people, the culture and technological infrastructure.

RESULTS

Eleven out of 47 items in round one did not reach the set ³ 70 % consensus. The 11 items were refined and sent for round two. A total of 46 items were included in the final approach. The results report the developed assessment approach for competency-based nursing education in low-income settings.

CONCLUSIONS

A contextually relevant assessment approach should be underpinned by empirical evidence and knowledge of the context. Nursing institutions should support faculty development in assessment to enhance the implementation and sustainability of the assessment approach.

Parents' Trigger Tool for Children with Medical Complexity - PAT-CMC: Development of a recognition tool for clinical deterioration at home

AIM

To develop a trigger tool for parents and lay caregivers of children with medical complexity (CMC) at home and to validate its content.

DESIGN

This was a multi-method study, using qualitative data, a Delphi method and a concept mapping approach.

METHODS

A three-round electronic Delphi was performed from December 2021 to April 2022 with a panel of 23 expert parents and 30 healthcare providers, supplemented by a preliminary qualitative exploration of children's signs of deterioration and three consensus meetings to develop the PArents' Trigger Tool for Children with Medical Complexity (PAT-CMC). Cognitive interviews with parents were performed to assess the comprehensiveness and comprehensibility of the tool. The COREQ checklist, the COSMIN guidelines and the CREDES guidelines guided the reporting respectively of the qualitative study, the development and content validity of the trigger tool and the Delphi study.

RESULTS

The PAT-CMC was developed and its content validated to recognize clinical deterioration at home. The tool consists of 7 main clusters of items: Breathing, Heart, Devices, Behaviour, Neuro-Muscular, Nutrition/Hydration and Other Concerns. A total of 23 triggers of deterioration were included and related to two recommendations for escalation of care, using a traffic light coding system.

CONCLUSION

Priority indicators of clinical deterioration of CMC were identified and integrated into a validated trigger tool designed for parents or other lay caregivers at home, to recognize signs of acute severe illness and initiate healthcare interventions.

IMPACT

The PAT-CMC was developed to guide families in recognizing signs of deterioration in CMC and has potential for initiating an early escalation of care. This tool may also be useful to support education provided by healthcare providers to families before hospital discharge.

PATIENT OR PUBLIC CONTRIBUTION

Parents of CMC were directly involved in the selection of relevant indicators of children's clinical deterioration and the development of the trigger tool. They were not involved in the design, conducting, reporting or dissemination plans of this research.

Challenges in Toileting Evaluation and Interventions for Children With Cerebral Palsy: A Delphi Study

IMPORTANCE

Toileting difficulties have a significant impact on the daily lives of children with cerebral palsy (CP), yet research on this issue remains inadequate. There is a critical need to better understand the challenges health care professionals face in addressing toileting difficulties.

OBJECTIVE

To explore challenges faced by health care professionals in toileting evaluation and interventions for children with CP ages 6-18 yr.

DESIGN

A mixed-methods study with a two-phase exploratory sequential design and using a global Delphi consensus technique.

SETTING

Email communication.

PARTICIPANTS

Fifty-two national and international allied health professionals and 16 mothers of children with CP were involved in the preparation of the Delphi questionnaire. Additionally, 162 professionals participated in the Delphi study.

OUTCOMES AND MEASURES

Challenges were identified and refined iteratively through the Delphi questionnaire. Consensus was measured using a Likert scale, considering agreement percentages and median scores.

RESULTS

The study revealed strong consensus (94.4%), emphasizing the need for comprehensive training, particularly in working with pediatric populations. Concerns about limited research on and training in toileting function (88.9%) and challenges such as inadequate assessment environments and sanitation facilities (96.9%) underscore the need for practical and innovative educational methods to illustrate toileting procedures. Additionally, the findings highlight concerns about toileting issues and diverse commitment levels among professionals.

CONCLUSIONS AND RELEVANCE

This study pinpointed critical challenges in toileting management for children with CP. These high-consensus findings stress the urgent need for holistic strategies, comprehensive education, and interdisciplinary collaboration to improve the quality of life and independence of these children. Plain-Language Summary: Toileting difficulties have a significant impact on the daily lives of children with cerebral palsy (CP), yet research on this issue remains inadequate. This study highlights significant gaps faced by health care professionals in understanding and addressing challenges in toileting evaluation and intervention for children with CP. Insights from professionals stress the critical need for global collaboration, standardized assessments, and improved education to effectively tackle CP-related toileting issues for children.

Definition and recommendations of advance care planning: A Delphi study in five Asian sectors

BACKGROUND

In Confucian-influenced Asian societies, explicit end-of-life conversations are uncommon and family involvement in decision-making is crucial, which complicates the adoption of culturally sensitive advance care planning.

AIM

To develop a consensus definition of advance care planning and provide recommendations for patient-centered and family-based initiatives in Asia.

DESIGN

A five-round Delphi study was performed. The rating of a definition and 84 recommendations developed based on systematic reviews was performed by experts with clinical or research expertise using a 7-point Likert scale. A median = 1 and an inter-quartile range = 0-1 were considered very strong agreement and very strong consensus, respectively.

SETTING/PARTICIPANTS

The Delphi study was carried out by multidisciplinary experts on advance care planning in five Asian sectors (Hong Kong/Japan/Korea/Singapore/Taiwan).

RESULTS

Seventy-seven of 115 (67%) experts rated the statements. Advance care planning is defined as "a process that enables individuals to identify their values, to define goals and preferences for future medical treatment and care, to discuss these values, goals, and preferences with family and/or other closely related persons, and health-care providers, and to record and review these preferences if appropriate." Recommendations in the domains of considerations for a person-centered and family-based approach, as well as elements, roles and tasks, timing for initiative, policy and regulation, and evaluations received high levels of agreement and consensus.

CONCLUSIONS

Our definition and recommendations can guide practice, education, research, and policy-making in advance care planning for Asian populations. Our findings will aid future research in crafting culturally sensitive advance care planning interventions, ensuring Asians receive value-aligned care.

Development and validation of a competency evaluation index system for nurse endoscopists with different stages performing endoscopy nursing in China: A modified Delphi study

BACKGROUND

The advancement of endoscopic techniques has resulted in an increasing need for comprehensive competency in endoscopy nursing. However, there is currently no unified competency evaluation index system for nurse endoscopists in China.

AIMS

To develop and validate of a competency evaluation index system for nurse endoscopists with different stages performing endoscopy nursing in China.

DESIGN

A modified Delphi study.

SETTINGS

Data were collected in a medical university affiliated hospital.

PARTICIPANTS

A total of 569 participants in different fields were included at various phases of this research.

METHODS

The preliminary indicators were designed after conducting a literature review, semi-structured interviews and questionnaires. Two rounds of correspondence with 30 experts using the Delphi method were conducted to evaluate the content of the index followed by reliability and validity tests. The competency evaluation index system for nurse endoscopists at different stages was developed through expert meetings based on the Delphi consultation results according to the novice-to-expert model.

RESULTS

After two rounds of Delphi method consultation, we have established 4 first-level indicators ('Cognitive skill', 'Practice professional skills', 'Professional development skills' and 'Personal characteristics and inner qualities') and 21 s-level indicators, which are the detailed description of first-level indicators. According to the index weight analysis, the four first-level indicators are ranked from the largest to the smallest as practical professional skills, cognitive skills, professional development skills, personal characteristics and intrinsic qualities. Three different stages of nurse endoscopists competency evaluation forms and criteria were developed: primary stage (New skilled), intermediate stage (Capable) and advanced stage (Expert).

CONCLUSIONS

The establishment of a competency evaluation index system based on the novice-to-expert model can accurately assess competency levels and help to effectively train the nurse endoscopists at different stages. Future research should focus on imbedding these competencies in nurse education.

Visible fluid motion on manipulation as the new threshold for intraoperatively determined knee arthroplasty component loosening: A Delphi study

PURPOSE

There is a lack of a clear, uniform definition for intraoperatively assessed component loosening of a knee arthroplasty component, complicating the interpretation and interchangeability of results of diagnostic studies using an intraoperative observation as the reference test. The purpose of this study was to establish a consensus among specialised knee revision surgeons regarding the definition of intraoperatively determined loosening of total or unicondylar knee arthroplasty components.

METHODS

Utilising the Delphi consensus method, an international panel of highly specialised knee revision surgeons was invited to participate in a three-round process. The initiation of the first round involved the exploration of possible criteria for intraoperatively determined loosening with open questions. The second round focused on rating these criteria importance on a five-point Likert scale. For the third round, criteria that reached consensus were summarised in consecutive definitions for intraoperatively determined loosening and proposed to the panel. Consensus was established when over 70% of participants agreed with a definition for intraoperatively determined loosening.

RESULTS

The 34 responding panel members described in total 60 different criteria in the first round of which 34 criteria received consensus in the second round. Summarising these criteria resulted in four different definitions as minimal requirements for intraoperatively determined loosening. Eighty-eight percent of the panel members agreed on defining a component as loose if there is visible fluid motion at the interface observed during specific movements or when gently applying direct force.

CONCLUSION

This study successfully established a consensus using a Delphi method among knee revision surgeons on the definition of intraoperatively determined component loosening. By agreeing on the visibility of fluid motion as new definition, this study provides a standardised reference for future diagnostic research. This definition will enhance the interpretability and interchangeability of future diagnostic studies evaluating knee arthroplasty component loosening.

LEVEL OF EVIDENCE

Level V.

Challenges, opportunities, and priorities for tier-1 emergency medical services (EMS) development in low- and middle-income countries: A modified Delphi-based consensus study among the global prehospital consortium

INTRODUCTION

Though the disease burden addressable by prehospital and out-of-hospital emergency care(OHEC) spans communicable diseases, maternal conditions, chronic conditions and injury, the single largest disability-adjusted life year burden contributor is injury, primarily driven by road traffic injuries(RTIs). Establishing OHEC for RTIs and other common emergencies in low- and middle-income countries(LMICs) where the injury burden is disproportionately greatest is a logical first step toward more comprehensive emergency medical services(EMS). However, with limited efforts to formalize and expand existing informal bystander care networks, there is a lack of consensus on how to develop and maintain bystander-driven Tier-1 EMS systems in LMICs. Resultantly, Tier-1 EMS development is fragmented among non-governmental organizations and the public sector globally.

METHODS

A steering committee coordinated a 9-round, modified Delphi-based expert discussion to identify current challenges, opportunities, and priorities in Tier-1 EMS development globally. 11 panelists represented seven Global Prehospital Consortium(GPC) member organizations with a mean 9.57 years of organizational Tier-1 EMS development/implementation experience(median = 9 years). The consortium represents the largest collaboration between organizations directing Tier-1 EMS programs globally across 12 countries on 3 continents(Americas, sub-Saharan Africa, and South Asia) with 22,000 first responders.

RESULTS

The GPC identified seven priority areas for Tier-1 EMS development: infrastructure/operations, communication, education/training, impact evaluation, financing, governance/legal, and transportation/equipment. A high level of consensus exists regarding priorities for investigation, including Tier-1 responder density/distribution, Tier-1 patient data variable standardization for trauma registries/quality improvement, dispatch technologies/protocols, modular curricula, broader cost-effectiveness and impact evaluation indices capturing secondary impacts of EMS, standardizing legal protections for first responders, and transportation/equipment standards.

DISCUSSION

Consensus is necessary to avoid duplicative and disorganized efforts due to the fragmented nature of parallel Tier-1 EMS efforts globally. A Delphi-like multi-round expert discussion among the members of the largest collaboration between organizations directing Tier-1 EMS programs globally generated relevant priorities to direct future efforts.

Developing and applying a training needs analysis tool for healthcare workers managing snakebite envenoming: A cross-sectional study in Eswatini

A considerable number of patients present to hospitals in Eswatini each year following bites by venomous snakes. Effectively diagnosing and treating patients with snakebite envenoming requires healthcare workers to have a variety of generic and snakebite-specific medical skills. In several countries, however, healthcare workers have been found to have limited skills in managing snakebite patients. We used the Delphi method to adapt the Hennessy-Hicks training needs analysis questionnaire to the context of snakebite envenoming and subsequently used the adapted questionnaire to assess the self-perceived training needs of 90 healthcare workers from ten hospitals in Eswatini. Two-thirds (63%) of participants were nursing staff and one third (34%) medical doctors. Overall, 74% of healthcare workers had previously received training on snakebite. Although a training need was reported for all skills included in the survey, the extent of the training need varied between different skills and groups of healthcare workers. The highest average training need was registered in the domains 'research and audit' and 'clinical tasks' with the latter accounting for nine of the ten skills with the highest training need. Nurses reported a higher training need than doctors, especially for clinical tasks. Receiving snakebite training before as well as after obtaining the primary qualification was associated with the lowest average training need, particularly in clinical skills. Ninety-three percent of interviewed healthcare workers would welcome more frequent training opportunities on the clinical management of snakebite patients. This newly developed snakebite training needs analysis tool can aid in adapting training initiatives to a dynamic and evolving healthcare workforce and it is designed to be transferrable to snakebite endemic settings worldwide.

An online pain management program for people with hypermobile Ehlers-Danlos Syndrome or hypermobility spectrum disorder: a three-staged development process

PURPOSE

Hypermobile Ehlers-Danlos Syndrome (hEDS) and hypermobility spectrum disorder (HSD) are painful, chronic and multi-systemic conditions. No online pain management programs for hEDS/HSD currently exist. We aimed to develop one by exploring what people with hEDS/HSD want in such programs.

MATERIALS AND METHODS

A Delphi was conducted via online surveys of stakeholders: participants with hEDS/HSD and healthcare professionals (HCP). In survey 1, participants were asked if a hEDS/HSD-specific online pain management program was important, listing up to 20 topics important to know about pain. In survey 2, participants rated the importance of those topics. Consensus was set as ≥75% rating of at least "important". Using topics that reached consensus, the online program was developed. Usability testing was performed using the Systems Usability Scale (SUS).

RESULTS

396 hEDS/HSD and 29 HCP completed survey 1; 151 hEDS/HSD and 12 HCP completed survey 2. 81% of hEDS/HSD and 69% of HCP rated a hEDS/HSD-specific program as at least "important". Thirty-five topics reached consensus to guide content for the HOPE program (Hypermobile Online Pain managemEnt). SUS score was 82.5, corresponding to "high acceptability".

CONCLUSIONS

A hEDS/HSD-specific online pain management program is important to stakeholders. Utilising a Delphi approach to incorporate stakeholder input, an evidence-informed and user appropriate program was developed.

A Lexicon for First-Trimester US: Society of Radiologists in Ultrasound Consensus Conference Recommendations

The Society of Radiologists in Ultrasound convened a multisociety panel to develop a first-trimester US lexicon based on scientific evidence, societal guidelines, and expert consensus that would be appropriate for imagers, clinicians, and patients. Through a modified Delphi process with consensus of at least 80%, agreement was reached for preferred terms, synonyms, and terms to avoid. An intrauterine pregnancy (IUP) is defined as a pregnancy implanted in a normal location within the uterus. In contrast, an ectopic pregnancy (EP) is any pregnancy implanted in an abnormal location, whether extrauterine or intrauterine, thus categorizing cesarean scar implantations as EPs. The term pregnancy of unknown location is used in the setting of a pregnant patient without evidence of a definite or probable IUP or EP at transvaginal US. Since cardiac development is a gradual process and cardiac chambers are not fully formed in the first trimester, the term cardiac activity is recommended in lieu of 'heart motion' or 'heartbeat.' The terms 'living' and 'viable' should also be avoided in the first trimester. 'Pregnancy failure' is replaced by early pregnancy loss (EPL). When paired with various modifiers, EPL is used to describe a pregnancy in the first trimester that may or will not progress, is in the process of expulsion, or has either incompletely or completely passed.

Development of an investigation form for hemodialysis infection outbreak: Identifying sources in the early stage

BACKGROUND

There are many infectious factors causing the outbreak of hemodialysis infection, which may easily lead to the delay of investigation and treatment. This study aimed to develop an investigation form for hemodialysis infection outbreak (HIO), and to identify sources of outbreak in early stage.

METHODS

After an exhaustive literature review, we used the Delphi method to determine the indicators and relative risk scores of the assessment tools through 2 rounds of specialist consultation and overall consideration of the opinions and suggestions of 18 specialists.

RESULTS

A total of 87 studies of HIOs were eligible for inclusion. The mean authority coefficient (Cr) was 0.89. Kendall's W coefficient of the specialist consultation was 0.359 after 2 rounds of consultation (P < .005), suggesting that the specialists had similar opinions. Based on 4 primary items and 13 secondary items of the source of HIO, and tripartite distribution characteristics of infected patients, we constructed the investigation form.

CONCLUSIONS

The investigation form may be implemented during the initial phase of an outbreak investigation, it is a prerequisite for taking effective control measures, avoiding HIO occurrence. However, the efficacy of the investigation form needs to be further evaluated.

Multi-centre modified Delphi exercise to identify candidate items for classifying early-stage symptomatic knee osteoarthritis

OBJECTIVE

To generate a list of candidate items potentially useful for discriminating individuals with Early-stage Symptomatic Knee Osteoarthritis (EsSKOA) from those with other conditions and from established osteoarthritis (OA), and to reduce this list based on expert consensus.

DESIGN

We conducted a three-round online international modified Delphi exercise with OA clinicians and researchers ("OA experts"). In Round 1, participants reviewed 84 candidate items and nominated additional item(s) potentially useful for EsSKOA classification; those nominated by ≥3 participants were added. In Round 2, participants rated perceived usefulness of 108 items (1 [not at all useful] to 9 [extremely useful]). In Round 3, participants could revise their ratings after reviewing Round 2 group median and quartiles. Following Round 3, we retained items with a median usefulness score >5 and ≥33.3% of participants categorised the item as useful (7 to 9), overall and in subgroup analysis by clinician field.

RESULTS

There were 128 participants in Round 1 and 113 (88%) completed all rounds. We retained 77 items that spanned multiple domains (demographics, symptoms, physical exam, performance-based measures, imaging, laboratory investigations, and gross inspection/arthroscopy). Highly rated items included (median usefulness score): prior knee joint injury (8), diagnosis of OA in a different joint (7), and activity-related knee pain (7). The interquartile range was most often 3.

CONCLUSION

We identified 77 items that OA experts consider potentially useful for EsSKOA classification. The results highlight experts' uncertainty around item usefulness. Next, candidate items will be further assessed and reduced using data-driven and multicriteria decision analysis methods.

Variables for reporting studies on extended - focused assessment with sonography for trauma (E-FAST): An international delphi consensus study

BACKGROUND

The Extended Focused Assessment with Sonography for Trauma (E-FAST) is a diagnostic ultrasound technique used in hospital and pre-hospital settings for patients with torso trauma. While E-FAST is common in emergency departments, its pre-hospital use is less routine. This study aims to establish a set of variables for designing studies on pre-hospital E-FAST through a Delphi consensus process involving international experts.

METHODS

A Delphi consensus process was utilized, involving four rounds of e-mail to the experts. The experts proposed variables for each category, assessed them using a 5-point Likert scale, and voted on whether they should be included in the final template.

RESULTS

Out of 14 invited experts, 9 participated in the study. In total, the experts proposed 247 variables. After four rounds, a final list of 32 variables was approved by all experts. These variables related to the system, patient, process, training, imaging, outcome, and others.

CONCLUSIONS

This Delphi consensus study presents a list of 32 variables for future research studies concerning the use of E-FAST ultrasound in pre-hospital settings. The results of this study are significant as they provide a standardized set of variables that will facilitate the comparison of data obtained from various studies. This will ultimately contribute to the advancement of pre-hospital E-FAST research and practice.

Evaluation of the Development, Implementation, Maintenance, and Impact of 3 Digital Surveillance Tools Deployed in Malawi During the COVID-19 Pandemic: Protocol for a Modified Delphi Expert Consensus Study

BACKGROUND

The COVID-19 pandemic has highlighted the importance of strengthening national monitoring systems to safeguard a globally connected society, especially those in low- and middle-income countries. Africa's rapid adoption of digital technological interventions created a new frontier of digital advancement during crises or pandemics. The use of digital tools for disease surveillance can assist with rapid outbreak identification and response, handling duties such as diagnosis, testing, contact tracing, and risk communication. Malawi was one of the first countries in the region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture.

OBJECTIVE

The aim of this study is to seek expert consensus using the Delphi methodology to examine Malawi's COVID-19 digital surveillance response strategy and to assess the digital tools using the World Health Organization mHealth (mobile health) Assessment and Planning for Scale (MAPS) toolkit.

METHODS

This protocol follows the Guidance on Conducting and REporting DElphi Studies. Participants must have first-hand experience on the design, implementation or maintenance with COVID-19 digital surveillance systems. There will be no restrictions on the level of expertise or years of experience. The panel will consist of approximately 40 participants. We will use a modified Delphi process whereby rounds 1 and 2 will be hosted online by Qualtrics and round 3 will encompass a face-to-face workshop held in Malawi. Consensus will be defined as ≥70% of participants strongly disagree, disagree, or somewhat disagree, or strongly agree, agree, or somewhat agree. During round 3, the face-to-face workshop, participants will be asked to complete, the MAPS toolkit assessment on the digital tool on which they are experts. The MAPS toolkit will enable the panel members to assess the digital tools from a sustainable perspective from six distinct, yet complementary axes: (1) groundwork, (2) partnerships, (3) financial health, (4) technology and architecture, (5) operations, and (6) monitoring and evaluation.

RESULTS

The ability of a country to collate, diagnose, monitor, and analyze data forms the cornerstone of an efficient surveillance system, allowing countries to plan and implement appropriate control actions. Malawi was one of the first countries in the African region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture.

CONCLUSIONS

We anticipate findings from this Delphi study will provide insights into how and why Malawi was successful in deploying digital surveillance systems. In addition, findings should produce recommendations and guidance for the rapid development, implementation, maintenance, and impact of digital surveillance tools during a health crisis.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/58389.

Artificial intelligence in emergency and trauma radiology: ASER AI/ML expert panel Delphi consensus statement on research guidelines, practices, and priorities

BACKGROUND

Emergency/trauma radiology artificial intelligence (AI) is maturing along all stages of technology readiness, with research and development (R&D) ranging from data curation and algorithm development to post-market monitoring and retraining.

PURPOSE

To develop an expert consensus document on best research practices and methodological priorities for emergency/trauma radiology AI.

METHODS

A Delphi consensus exercise was conducted by the ASER AI/ML expert panel between 2022-2024. In phase 1, a steering committee (7 panelists) established key themes- curation; validity; human factors; workflow; barriers; future avenues; and ethics- and generated an edited, collated long-list of statements. In phase 2, two Delphi rounds using anonymous RAND/UCLA Likert grading were conducted with web-based data capture (round 1) and a bespoke excel document with literature hyperlinks (round 2). Between rounds, editing and knowledge synthesis helped maximize consensus. Statements reaching ≥80% agreement were included in the final document.

RESULTS

Delphi rounds 1 and 2 consisted of 81 and 78 items, respectively.18/21 expert panelists (86%) responded to round 1, and 15 to round 2 (17% drop-out). Consensus was reached for 65 statements. Observations were summarized and contextualized. Statements with unanimous consensus centered around transparent methodologic reporting; testing for generalizability and robustness with external data; and benchmarking performance with appropriate metrics and baselines. A manuscript draft was circulated to panelists for editing and final approval.

CONCLUSIONS

The document is meant as a framework to foster best-practices and further discussion among researchers working on various aspects of emergency and trauma radiology AI.

Epidemiology, management and patient needs in myasthenia gravis: an Italian multistakeholder consensus based on Delphi methodology

OBJECTIVES

To provide comprehensive information on the burden of myasthenia gravis (MG) in Italy, including the unmet needs of patients and several other aspects related to the disease, based on skilled viewpoints of MG experts.

DESIGN

Iterative analysis conducted in accordance with the best practices of the Delphi method, including anonymity, controlled feedback, and statistical stability of consensus.

SETTING AND PARTICIPANTS

24 clinicians, 18 public health experts and 4 patient associations experts completed all the Delphi iterations between 18 April and 3 July 2023, for a total of 46 participants from several Italian Regions.

OUTCOME MEASURES

Five areas of investigation related to MG were examined: epidemiology in Italy and characteristics of disease; diagnostic issues and Italian patient journey; unmet needs during the acute and chronic phases of MG; quality of life; public health management of MG. Consensus in the Delphi iterations was defined by both the percentage level of agreement between panellists or the median value of the responses.

RESULTS

We reported a high level of agreement (ie, >66.7% of panellists) on the prevalence and incidence of disease in Italy and on several management issues. A strong impact of MG on the quality of life of patients also emerged. Cross-agreement was achieved among different subgroups of panellists (ie, clinicians, public health experts and patient associations representatives) for most items proposed.

CONCLUSIONS

This study provided guidance for educational and practical aspects of MG in Italy, highlighted disease severity and its role on patients' quality of life. A few gaps related to the handling of MG in Italy also emerged.

Development of a framework to structure decision-making in environmental and occupational health: A systematic review and Delphi study

BACKGROUND

Environmental and occupational health (EOH) assessments increasingly utilize systematic review methods and structured frameworks for evaluating evidence about the human health effects of exposures. However, there is no prevailing approach for how to integrate this evidence into decisions or recommendations. Grading of Recommendations Assessment, Development and Evaluation (GRADE) evidence-to-decision (EtD) frameworks provide a structure to support standardized and transparent consideration of relevant criteria to inform health decisions. This study identifies and synthesizes available EOH decision frameworks and evaluates the applicability and usability of an existing GRADE EtD perspective to advance the development of a tailored EOH EtD framework.

METHODS

We performed a systematic review of MEDLINE, EMBASE, and Cochrane Library, and a manual search of gray literature to identify frameworks that inform decision-making about EOH exposures from the years 2011 to 2021. We abstracted and analyzed decision considerations from each framework through narrative synthesis. Next, we conducted a two-round Delphi process, engaging stakeholders from the following perspectives within environmental and occupational health: risk assessment and management, nutrition and food safety, cancer, and socio-economic analysis. Panelists rated the relevance and wording of each consideration on a 7-point Likert scale and provided free-text comments during both phases. Considerations that did not meet predetermined thresholds were excluded.

RESULTS

Out of 5,196 unique references, we identified 22 published reports of EOH decision frameworks. We identified another 16 frameworks in a search of gray literature, totaling 38 source frameworks. We abstracted 560 individual decision considerations from these frameworks, 104 of which may contribute additional information to the guidance, scope, context, or assessment criteria of the GRADE EtD framework. In round 1 of the Delphi study, 50 decision considerations were aggregated or removed, and 9 were aggregated or removed after round 2, for a final total of 47. No new decision considerations were added in either round. We identified several differences between decision criteria that are applied in EOH and the GRADE EtD framework, including vocabulary that is specific to EOH (e.g., toxicity, the precautionary principle), and granularity of the EOH decision considerations (e.g., detailed signaling questions to assess feasibility and resources required). However, this study did not identify any EOH decision criteria that are completely distinct from the GRADE EtD framework.

CONCLUSIONS

Findings of this mixed-methods study comprise a foundation for a GRADE EtD that is applicable for use in EOH decision-making, with implications for approaches to regulation of environmental and occupational exposures and the formulation of recommendations for interventions to prevent or mitigate undesirable health and other consequences.

Enhanced Recovery After Surgery for patients undergoing radical cystectomy: Surgeons' perspectives and recommendations ten years after its implementation

BACKGROUND AND OBJECTIVES

Enhanced Recovery After Surgery (ERAS) guidelines for Radical Cystectomy (RC) were published over ten years ago. Aim of this systematic review is to update ERAS recommendations for patients undergoing RC and to give an expert opinion on the relevance of each single ERAS item.

METHODS

A systematic review was performed to identify the impact of each single ERAS item on RC outcomes. Embase and Medline (through Pubmed) were searched systematically. Relevant articles were selected and graded. For each ERAS item, a level of evidence was determined. An e-Delphi consensus was then performed amongst an international panel with renowned experience in RC to provide recommendations based on expert opinion.

KEY FINDINGS AND LIMITATIONS

Preoperative medical optimization and avoiding bowel preparation are highly recommended. Robotic-assisted RC with intracorporeal urinary diversion is moderately recommended and can help in applying other ERAS items, such as early mobilization. Medical thromboprophylaxis should be administered and nasogastric tube should be removed at the end of surgery. Perioperative fluid restriction as well as opioid-sparing anesthesia protocols should be implemented. Generally, consensus was reached on most ERAS items, with the exception of epidural anesthesia (no consensus), resection site drainage (consensus against), and type of urinary drainage. Limitations include the lack of a multidisciplinary approach to the present consensus, giving however a highly specialized surgical opinion on ERAS.

CONCLUSIONS

and clinical implications: The current study updates ERAS recommendations for patients undergoing RC and suggests application of ERAS by a panel of experts in the field.

Development of a child and family centred outcome measure for children and young people with life-limiting and life-threatening conditions: progress to date on the Children's Palliative Care Outcome Scale (C-POS:UK)

Background

Development of a paediatric palliative care child and family centred outcome measure is a priority for health care professionals, researchers and advocates. It is methodologically challenging to develop a measure relevant for such a heterogenous population with complex needs. Involving children in measuring development is vital.

Objective

To develop C-POS:UK (Children's Palliative Care Outcome Scale, UK), a person-centred outcome measure (PCOM) for children with life-limiting conditions and their families, and to test its psychometric properties.

Design

Sequential mixed-methods approach to PCOM development, guided by Rothrock's measure development process and COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) methodology.

Methods

(i) Qualitative interviews about priority symptoms and concerns, with embedded exploration of measure design for children with life-limiting conditions; (ii) systematic review of measure design for children; (iii) modified Delphi survey, and consultation with children, on priority items for new measure; (iv) expert item generation meeting to develop C-POS:UK; (v) cognitive testing to refine C-POS:UK; (vi) psychometric validation.

Results

(i) 106 participants described physical, emotional/psychological, spiritual/existential, social and practical concerns. Measure design was discussed by 79 participants comprising preferred response format, recall period and measure administration for children with life-limiting conditions; (ii) systematic review highlighted need for: different versions of measure accounting for child's developmental stage and cognitive ability; parent/carer involvement as proxies for very young children; and testing to clarify recall periods and response formats at different developmental stages; (iii) Delphi survey: 82 participants (in the first round), with a move towards consensus, but with some differing priorities in stakeholder groups: professionals prioritised physical symptoms, parents prioritised psychosocial and practical matters, while consulted children prioritised normality; (iv) 22 experts contributed to item generation meeting, resulting in five versions of C-POS:UK accounting for child's developmental stage and cognitive ability, and proxy involvement; (v) 48 participants cognitively tested initial C-POS:UK, informing comprehension, comprehensiveness and acceptability; (vi) psychometric validation is ongoing.

Conclusion

A sequential approach informed by Rothrock and COSMIN has supported development of the first version of C-POS:UK. Psychometric validation is underway and will be followed by implementation planning.

Identifying essential resource parameters for pandemic preparedness and response: an international Delphi study within the EU PANDEM-2 project

OBJECTIVE

The COVID-19 pandemic highlighted the crucial role of healthcare and public health resource management, where scarcity impairs pandemic response resulting in increased disease transmission, delayed patient care and poorer health outcomes. In the EU PANDEM-2 project, we aimed to identify essential resource parameters for pandemic preparedness and response in the context of an emerging viral respiratory illness.

DESIGN

After performing a systematic literature review, we conducted a Delphi study consisting of a structured questionnaire and consensus round with two separate panels of European public health experts (PHEs) and clinicians, respectively. Resources were categorised as material (n=23), human (n=18) or pharmaceutical (n=12). Data were analysed descriptively for both panels.

RESULTS

Participants were 17 PHEs and 16 clinicians from nine countries. Consensus between the two panels was found on 40 resource parameters (17 material, 14 human, 9 pharmaceutical; 33 accepted and 7 rejected). Notably, clinicians selected three home care resources while PHEs did not, and PHEs selected two pharmaceutical resources which clinicians did not. No consensus was observed on 13 resources. Eleven additional resources were suggested and included (five for PHE and six for clinicians) among which were personal protective equipment for mobile teams, resources for primary care and resources related to mechanical ventilation.

CONCLUSIONS

The high level of consensus between the two expert panels indicates common goals in pandemic resource planning. The disagreement on 13 resource parameters reflects the different priorities between PHEs and clinicians in pandemic planning. This study has demonstrated the core components of resource modelling required for pandemic preparedness planning and shows the importance of consulting experts with both public health and clinical backgrounds. Including our proposed resources in pandemic models allows for more enhanced planning and training activities for future pandemics.

Pediatricians at the forefront of child mental health? A Delphi method exploration

BACKGROUND

Rising mental health challenges among children and adolescents are a global concern. However, a shortage of professionals, inadequate competence and lack of resources hamper necessary care, presenting a major challenge to health service provision. Community pediatricians, frequently the initial contact for mental health issues, are in a key position to improve access to care. The Delphi method was employed as an initial step toward redefining the role of pediatricians and the re-design of pediatric responses within Israeli primary mental health care.

METHOD

Ninety-two experts, including pediatricians, psychiatrists, mental health and child-development professionals, and parents of children with emotional-behavioral challenges participated in a three-round Delphi study. A survey including 6 topics (37 items, 9 demographic questions) was distributed, probing the envisioned role of pediatricians in children's mental health care.

RESULTS

There was strong endorsement between experts regarding pediatricians' potential roles in risk identification, parental guidance, psycho-education, and health policy isuues such as referrals to mental health professionals, and the need for training in this domain. However, discord arose concerning changes in the service framework and pediatricians' role in psychiatric drug prescription. The majority agreed on the necessity of close support from mental health experts, despite differing in the form it should take.

CONCLUSIONS

This study underscores the critical need for mental health training among pediatricians and advocates for a structured, consensus-driven model to bolster early detection and initial treatment of mental health issues in children. The findings highlight the potential for leveraging this model to drive health policy changes and improve service delivery in pediatric mental health care, and might inform other health systems considering extending pediatricians' roles. By equipping pediatricians with essential competencies, this approach can broaden mental health service delivery and reduce stigma. Aligning the model with expert consensus paves the way for impactful policy reform, enhancing pediatricians' roles in mental health risk identification and intervention, and advancing child health services.

Treatment of High-Risk Patients with Stage I Non-Small Cell Lung Cancer. Semin Thorac Cardiovasc Surg 2024:S1043-0679(24)00101-1. [PMID: 39672521 DOI: 10.1053/j.semtcvs.2024.10.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

OBJECTIVE

A significant proportion of patients with stage I non-small cell lung cancer (NSCLC) are considered at high risk for complications or mortality after lobectomy. The American Association for Thoracic Surgery (AATS) previously published important considerations in determining which patients are considered high risk. The current objective was to evaluate treatment options and important factors to consider during treatment selection for these high-risk patients.

METHODS

The AATS Clinical Practice Standards Committee assembled an expert panel to review treatment options for high-risk patients with stage I NSCLC. After a systematic search of the literature identification of lung-nodule-related factors to consider in treatment selection, the panel developed expert consensus statements and vignettes using a modified Delphi method. A 75% consensus was required for approval.

RESULTS

The expert panel identified sublobar resection, image-guided thermal ablation (IGTA), and stereotactic ablative radiotherapy (SABR), which is also known as stereotactic body radiation therapy (SBRT) or stereotactic radiosurgery (SRS), as modalities applicable in the treatment of high-risk patients with stage I NSCLC. Fourteen statements and 5 vignettes illustrating clinical scenarios were formulated, revised, and ultimately approved.

CONCLUSIONS

The choice of which modality (sublobar resection, SABR, or IGTA) is optimal in high-risk patients with stage I NSCLC is complex, but a surgical approach is generally favored when deemed safe. SABR and IGTA are reasonable options in select patients, with SABR being the likely next choice in nonsurgical patients. If possible, obtaining a biopsy is very important prior non-surgical treatment. A multi-disciplinary review of patient and tumor characteristics is essential for achieving an optimal decision. The clinical treatment decision should also take patient perspectives, preferences, and quality of life into consideration.

Implementation science research priorities for Universal Health Coverage:Methodological lessons from the design and implementation of a multi-country modified Delphi study

Delphi studies are rapidly gaining prominence in global health research. However, researchers' modifications to the Delphi method are often not well-described or justified, limiting opportunities to systematically learn from these studies when the methods are applied to other topics and settings. This paper aims to describe an approach to implementing a modified Delphi study and reflect on the research process in the context of a multi-country study of implementation science research priorities to advance Universal Health Coverage (UHC). We review trends in the use of the modified Delphi method in global health research, outline our three-phased modified Delphi approach, and share reflections on five decision points for implementing the study: 1) identifying and recruiting participants for the expert panel, 2) addressing participant attrition between rounds, 3) justifying the most appropriate cutoff points, 4) incorporating new items raised by participants in open-ended survey sections, and 5) ensuring maximum variation in perspective in the panel of experts. Insights from this work foster greater understanding of the underlying assumptions for, and interpretation of, 'modified' in modified Delphi studies. This study will encourage critical dialogue about points of methodological contention in Delphi methodology and thus, are relevant for scaling the use of modified Delphi studies in public health, including global health research.

Defining core competencies for telehealth in healthcare higher education: A Delphi study

BACKGROUND

While technology brings many opportunities for optimizing and improving health services, the lack of professionals trained in telehealth poses an important obstacle. Despite the existance of core competency frameworks for some healthcare professions, there is currently no consensus or guidelines on the core competencies that telehealth professionals should possess within the context of a higher education curriculum. This can hinder the potential benefits of healthcare service delivery.

OBJECTIVE

To establish a consensus on the core competencies in telehealth that should be integrated into higher education curricula for healthcare professionals.

METHODS

A three-round international eDelphi study was conducted. The panel comprised of a diverse group of experts in telehealth, clinicians, lectures and professors, administrators, and teaching coordinators. In the first round, an international steering committee developed a list of competencies that were presented to the panel members and they were asked to rate their level of agreement and suggest additional competencies. The consensus was established based on the competencies that achieved a high level of agreement (>75%) by the end of the third round.

RESULTS

We included 100 panellists from 18 different countries. By the end of the third round, we reached a consensus for 47 core competencies in a telehealth curriculum organized into 12 domains: principles of telehealth; care planning and management; assessment, diagnosis, and treatment; adequacy of the environment; professionalism; legal aspects; patient privacy; patient safety; access and equity; patient preference; technology; applicability of telehealth.

CONCLUSION

We identified the core competencies in a telehealth curriculum organized into 12 domains to be used as a foundation for training future health professionals.

The Importance of Pulmonary Nodule Features in the Selection of Treatment for the High-risk Patient with Stage I Non-Small Cell Lung Cancer. Semin Thorac Cardiovasc Surg 2024:S1043-0679(24)00103-5. [PMID: 39662535 DOI: 10.1053/j.semtcvs.2024.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

OBJECTIVE

The American Association for Thoracic Surgery (AATS) Clinical Practice Standards Committee (CPSC) previously published important considerations in determining who is at high risk for complications or mortality after lobectomy. Sublobar resection, stereotactic ablative radiotherapy, or image-guided thermal ablation is typically considered when the risks associated with lobectomy are high. The current objective was to evaluate important lung-nodule-related factors to consider during treatment selection for high-risk patients with stage I non-small cell lung cancer (NSCLC).

METHODS

The AATS CPSC assembled an expert panel. The expert panel generated an a priori list of lung-nodule-related factors to consider in treatment selection and graded the relative importance of each factor on a scale of 1-10 in an anonymous survey after systematic review of the literature.

RESULTS

The expert panel survey identified several lung-nodule-related factors to consider in treatment selection. The panel ranked tumor location (peripheral vs central, mean score 8.4), tumor size (mean score 8.1), proximity to bronchovascular and critical structures (mean score 7.8), and the presence of interstitial lung disease/idiopathic pulmonary fibrosis (mean score 7.8) as the most important factors to consider.

CONCLUSIONS

This article summarizes the lung-nodule-related factors to consider when deciding between sublobar resection, stereotactic ablative radiotherapy, and image-guided thermal ablation during treatment selection for high-risk patients with stage I NSCLC. When possible, obtaining a biopsy is very important prior to non-surgical treatments. The choice of which modality is optimal in high-risk patients with stage I NSCLC is complex. A multi-disciplinary review of patient and tumor characteristics is essential for achieving an optimal decision.

A Systematic Scoping Review of Essential Methodological Elements for Developing a Tool to Improve the Reporting of Consensus Studies in Classification, Diagnostic Criteria, and Guidelines Development

Introduction

A consensus is a general agreement among group members that is pivotal in gathering expert input for classification, diagnostic criteria, and guideline development. However, the absence of established methodological standards presents challenges in conducting and analyzing these studies.

Objective

This scoping review explored the evidence on essential elements in consensus studies to create a list of candidate items for a standardized reporting tool. This tool is intended to improve the critical appraisal and methodological rigor of consensus studies.

Methods

A systematic scoping review was conducted using predetermined criteria for study selecting studies and extracting data. A comprehensive literature search was performed without imposing date restrictions, covering multiple databases, including Medline, Embase, LILACS, SciELO, and up to March 2022. We included only English-language publications and excluded incomplete articles and conference reports. The risk of bias was assessed using the CASP checklist, and the study selection and data extraction were performed independently by two researchers in duplicate.

Results

We identified 8360 references; 20 publications were included for data extraction. The majority (70%) used the Delphi method, and the remainder (30%) employed the modified Delphi method. Inconsistencies in reporting conflicts of interest and consensus timing were observed. Other methodologies, such as RAND/UCLA and Nominal Group Technique were excluded due to methodological limitations. Most studies exhibited a low risk of bias.

Discussion

Our findings underscored the need for more standardization in definitions, methodology, and reporting within consensus studies. To address these gaps, we developed a checklist of key reporting items aimed at improving the planning, execution, and reporting consensus studies. Although the developed checklist requires validation, it offers a practical framework to enhance methodological transparency and reliability.

Conclusion

Deficiencies and variability in consensus methodologies reporting underscore the need for a standardized approach. We propose the adoption of a checklist to strengthen the robustness of consensus studies, supporting advances in classification, diagnostic criteria, and guideline development.

Development of Patient-Centered End-of-Life Care Quality Measures in China: A Modified Delphi Process

Objective: Patient-centered care is widely recognized as a crucial component of high-quality end-of-life care. As this approach remains limited in China, this study sought to develop quality measures specifically tailored to end-of-life care within the country. Methods: Initial indicators were established through a comprehensive review of existing measures. Using the modified Delphi Method, a two-round survey with experts (n = 14) was applied to evaluate the importance of each item. Results: The authoritative coefficient of two rounds of expert consultation was 0.86 and 0.87, and the Kendall coefficient of concordance for the two rounds was 0.232 and 0.270 (P < 0.001), respectively, demonstrating an acceptable consensus among the experts. As a result, 31 key quality indicators were identified and deemed important. Conclusions: This study developed a scale for patient-centered end-of-life care quality measurement in China, consisting of six dimensions and 31 indicators. This scale lays a solid foundation for quality improvement initiatives and future development of patient-centered end-of-life care.

A novel prenatal alcohol use risk perception model: feedback from a Delphi process

Understanding prenatal alcohol exposure (PAE) risk perception is important for the communication and prevention of alcohol use during pregnancy. A previous systematic review has explored the dimensions and influencing factors of women's PAE risk perceptions, leading to the construction of Pregnancy Alcohol Use Risk Perception (PARP) conceptual model. This study aims to refine the PARP model using a Delphi process. A total of 37 international experts participated, 17 completed all three online surveys between May 2022 and December 2022. The online survey consisted of Likert-scale and free-text responses on the usefulness and clarity of the components and the design of the PARP model. Likert-scale responses were analysed using descriptive statistics. Free-text responses were analysed using a reflexive thematic analysis approach. The model was amended following participants' responses. Four characteristics underpinned the revised model-relevance-to-self and the negotiations of risks, inter-relatedness of affect with the cognitive processing of risk, contextual influences of individual, sociocultural and institutional/political/organizational rendering a socioecological perspective to PAE risks perception and the dynamic characteristics of PAE risk perception. The acknowledgement of PAE risk perceptions and the contextual influences can support development of targeted and tailored messages and health education materials.

Development of an indicator framework for assessing nursing quality in interventional therapy for intracranial aneurysms in China

Objective

The objective of this study is to devise an indicator system to assess the quality of nursing care in the context of interventional therapy for intracranial aneurysms (IA) in China. This will furnish a standardized and quantitative framework for the monitoring and assessment of nursing quality within the IA interventional therapeutic field.

Methods

The indicators and their associated weights within the evaluation system for nursing quality in interventional therapy for IA were determined based on the theoretical framework of the three-dimensional quality model, specifically the "structure-process-outcome" paradigm. This was achieved by using several methodological approaches, such as literature analysis, semi-structured interviews, expert consultations, the Delphi method, and the analytic hierarchy process.

Results

Expert consultations were conducted over two rounds, with questionnaires distributed via email and WeChat. Both rounds yielded a questionnaire return rate of 100%. Across these consultations, pertinent statistical measures were obtained, such as the expert authority coefficient (Cr), the coefficient of variation (CV), and Kendall's harmony coefficient, which exhibited values of 0.886 and 0.952, 0-0.193 and 0-0.185, and 0.138 and 0.149, respectively. These findings indicated statistically significant differences (p < 0.01). Notably, the indicators within the final iteration of the evaluation system for nursing quality in interventional therapy for IA are categorized into 3 tiers: primary indicators, encompassing 3 metrics; secondary indicators, comprising 10 metrics; and tertiary indicators, consisting of 36 indicators.

Conclusion

The indicator system devised for assessing nursing quality in interventional therapy for IA, as outlined in this study, possesses a high level of scientific rigor and reliability in China. It aptly captures the unique nuances inherent in IA management during interventional therapy nursing, thereby serving as a valuable reference point for the assessment of nursing quality within the context of IA interventional therapy.

Creating a food environment scoring index for online food delivery outlets: Delphi study with Australian nutrition and public health professionals

AIMS

This study aimed to develop a scoring index for the healthfulness of food outlet menu offerings available through Australian delivery platforms.

METHODS

The Delphi method was employed to achieve consensus among a panel of Australian nutrition and public health experts regarding the food environment scores assigned to online food outlets, classified by type. From previous studies and scoping of delivery platforms, 36 food outlet types were identified. Australian nutrition and public health experts were recruited to complete an online Delphi survey to score the healthfulness of these outlets using a scale from -10 (least healthful) to +10 (most healthful), based on typical menu offerings. The first round of the survey was opened for approximately 5 weeks in July to August 2023, and the second round was opened for 2 weeks in September 2023. The mean food environment score, minimum and maximum awarded food environment score, and SD for each outlet type, and coefficient of variation was calculated after each survey round to provide a measure of the spread of the data around the mean and the degree of consistency in the distribution of responses. Following the second survey round, results were assessed for consensus among the participants.

RESULTS

Fifty-four participants completed the round one survey, and n=14 completed round two. The majority of online food delivery outlet types received a food environment score of less than +5, and were considered 'less healthful.' Participants scored greengrocers as the most healthful outlet type (mean food environment score of 8.83 ± 0.37) and liquor selling stores as the least healthful (score of -8.10 ± 1.14). The group reached consensus after two survey rounds due to decreases in the standard deviations of mean food environment scores.

CONCLUSIONS

This study provides an expert-informed tool, the DIGIASSESS tool, that can be easily applied by researchers, policy makers, health workers and public health professionals to understand the rapidly evolving online food delivery environment, including changes over time and areas for potential intervention.

Engaging Australian healthcare consumers to determine priorities and consensus for precision medicine approaches to detect non-communicable disease in early life: a modified Delphi study

OBJECTIVES

Research to develop early screening tools to determine an individual's risk of developing adult-onset disease is a growing field. Expectant parents may find themselves with an option in the future to undergo screening to determine not only genetic abnormalities in their child but also their risk of developing adult-onset non-communicable diseases (NCD) such as hypertension, obesity or hypercholesterolaemia. To ensure acceptability and feasibility of new screening tools researchers must work in partnership with healthcare consumers to discern consumers' current understanding and acceptance of these technologies in research and the potential for clinical applications. We sought to engage with healthcare consumers to develop a consensus, using a modified Delphi study design, for the acceptability of (1) screening tools for use within pregnancy that would indicate a child's risk for developing NCD, and (2) targeted early interventions for those identified at a higher risk of developing NCD using precision medicine approaches. The acceptability of future research design and conduct as well as the implications for implementation into routine healthcare were discussed. In addition, participants were asked to rank the non-communicable diseases they believed were of most importance for precision medicine research focus, in line with recent calls for better involvement of healthcare consumers in setting research questions and defining priority areas.

DESIGN

A modified two-stage Delphi study design including an in-person consumer workshop (stage 1) and online follow-up survey (stage 2), was used to evaluate consumer consensus for research to develop precision medicine tools for early detection and potential intervention to reduce onset of NCDs. The acceptability of research design and conduct and future implications for the implementation of newly developed tools into routine healthcare was also addressed.

SETTING AND PARTICIPANTS

We engaged 76 healthcare consumers in 2020, in the Hunter New England Region, New South Wales, Australia. Participants were recruited from existing healthcare consumer organisations, research programmes and healthcare networks through purposeful selection, with a focus on participants having a broad range of experiences and backgrounds to ensure adequate representativeness.

RESULTS AND CONCLUSIONS

Our findings indicate the majority (98%) of participants in our study believe early screening for risk of NCD in their children was acceptable, provided it was equitable and clear pathways for referral and support were available.

Processes and approaches to perioperative pain management in patients undergoing major lower extremity amputations secondary to vascular disease: a multi-specialty modified Delphi consensus study protocol

INTRODUCTION

Pain surrounding major lower extremity amputations (MLEAs) in the vascular surgical patient can be severe, conferring significant debilitation from the preoperative stage through to the chronic rehabilitation phase. Although there is an evolving understanding of the array of existing analgesic medications and modalities, pain management in this context continues to be challenging. A previous report in the UK revealed that MLEA pain management practices may not be optimal from the perspective of patients. There are also limitations in the comprehensiveness and quality of existing evidence, and existing practices can be heterogeneous. Identifying effective pain management approaches in MLEA has thus been recognised as a key practice and research priority. Therefore, the aim of this study protocol will be to elucidate a multi-specialty view on the perceptions, processes and approaches to perioperative pain management in patients undergoing MLEAs secondary to vascular disease in the UK.

METHODS AND ANALYSIS

A modified Delphi methodology will be used to gain consensus among a UK-wide multi-specialty panel of clinical experts. At least three iterative rounds of structured anonymous electronic surveys will be circulated to a minimum cohort of 40 participants across relevant specialties. Expert agreement on pre-developed consensus statements pertaining to the approaches and techniques in MLEA pain management will be sought from the first round and quantified by a 5-point Likert scale. Quantitative and qualitative analyses will be performed to evaluate the level of agreement and participant feedback, respectively. A consensus criterion of ≥75% panellist agreement with a ≤10% between-round stability will be used for each statement. The process will be repeated with the results and implementation of feedback highlighted to panellists in each subsequent round.

ETHICS AND DISSEMINATION

Ethical approval was not required for this study as the participants and methodology fall outwith the requirements for a National Health Service Research Ethics Committee review. The results will be disseminated in a peer-reviewed publication and presented at relevant conferences.

Identification of core indicators for the integration of a palliative care approach in hospitals: An international Delphi study

BACKGROUND

Healthcare providers working in hospitals have significant exposure to patients with palliative care needs. For many patients, these needs often reflect non-specialist rather than specialist palliative care needs. Embedding a palliative care approach in acute hospital-based care however is challenging.

AIM

To identify core indicators for the integration of a palliative care approach in hospitals.

DESIGN

A Delphi technique used three sequential online survey rounds. Preliminary indicators were identified in a concept analysis of a palliative care approach, and a systematic review of hospital-based healthcare providers' views of a palliative care approach.

PARTICIPANTS

An international expert panel of three key stakeholder groups (clinicians, researchers, patients/family members) participated in each Delphi round.

RESULTS

The Delphi participants were recruited from 12 countries; 97 individuals responded to round 1, 78 to round 2 and 72 to round 3 (74% overall response rate). Consensus was achieved (defined a priori as >70%) on 32 core indicators of a hospital-based palliative care approach, with five structural indicators (relating to infrastructure and governance), 21 organisational indicators (relating to clinical care processes) and six staff indicators (relating to training and support for healthcare providers).

CONCLUSIONS

This study offers multi-level guidance for clinical practice, policy and research related to integration of a palliative care approach in hospitals, based on evidence and international consensus from major stakeholder groups. These core indicators provide a means to assess, review and communicate the core elements of a palliative care approach in hospitals.