Delphi methodology in healthcare research: How to decide its appropriateness

Assessment and treatment of nonsurgical thumb carpometacarpal joint osteoarthritis: A modified Delphi-based consensus paper of the American Society of Hand Therapists

BACKGROUND

While the literature is abundant on hand therapy assessment and treatment of nonsurgical thumb carpometacarpal (CMC) osteoarthritis (OA), clarity and uniformity are meager, making it a desirable diagnosis to establish expert consensus.

PURPOSE

This study aimed to ascertain if consensus exists for the assessment and treatment of nonsurgical management of thumb CMC OA in the hand therapy clinical setting.

STUDY DESIGN

This was a consensus paper via the modified Delphi approach.

METHODS

A modified Delphi method was used to determine consensus among an expert panel, including hand therapists and hand surgeons, via two online surveys. A consensus paper steering committee (from the American Society of Hand Therapist's research division) designed the surveys and analyzed responses. Consensus was established as 75% agreement among the expert panel. Demographic information was collected from the expert panel.

RESULTS

The expert panel included 34 hand therapists and seven hand surgeons. The survey response rates were 93.6% for the first survey and 90.2% for the second survey. Consensus recommendations were classified according to the World Health Organization categorization. These included evaluating the body structures for clinical signs/clinical testing and body functions for pain, range of motion for palmar abduction, radial abduction, opposition, and thumb metacarpal phalangeal flexion/extension, and grip and tripod pinch strength. Further consensus recommendations were for the assessment of function using a region-specific, upper extremity patient-reported outcome measure (activity and participation), environmental factors, outcome expectation, and illness perception within the patient's unique environmental and social contexts. Treatment recommendations included the use of an orthosis during painful activities, a dynamic stability program (stable C posture, release of tight adductors, and strengthening of stabilizers), patient education, joint protection techniques, adaptive equipment, and functional-based intervention.

CONCLUSIONS

The findings describe the consensus of a group of experts and provide a clinical reference tool on the hand therapy assessment and treatment of nonsurgical thumb CMC joint OA.

Rethinking the utility of the Five Domains model

The Five Domains model is influential in contemporary studies of animal welfare. It was originally presented as a conceptual model to understand the types of impact that procedures may impose on experimental animals. Its application has since broadened to cover a wide range of animal species and forms of animal use. However, it has also increasingly been applied as an animal welfare assessment tool, which is the focus of this paper. Several critical limitations associated with this approach have not been widely acknowledged, including that: (1) it relies upon expert or stakeholder opinion, with little transparency around the selection of these individuals; (2) quantitative scoring is typically attempted despite the absence of clear principles for aggregation of welfare measures and few attempts to account for uncertainty; (3) there have been few efforts to measure the repeatability of findings; and (4) it does not consider indirect and unintentional impacts such as those imposed on non-target animals. These deficiencies lead to concerns surrounding testability, repeatability and the potential for manipulation. We provide suggestions for refinement of how the Five Domains model is applied to partially address these limitations. We argue that the Five Domains model is useful for systematic consideration of all sources of possible welfare compromise and enhancement, but is not, in its current state, fit-for-purpose as an assessment tool. We argue for wider acknowledgment of the operational limits of using the model as an assessment tool, prioritisation of the studies needed for its validation, and encourage improvements to this approach.

Global Surgeon Opinion on the Impact of Surgical Access When Using Endocutters Across Specialties

Background: Despite design enhancements in endocutters, key challenges related to limited surgical access and space can impact stapling and, potentially, surgical outcomes. Objectives: This study aimed to develop consensus statements outlining the clinical value of precise articulation and greater anatomical access in minimally invasive surgery performed by bariatric, colorectal, and thoracic surgeons. Methods: Colorectal, bariatric, and thoracic surgeons from Japan, the United States, United Kingdom, and France participated in a 2-round modified Delphi panel. Round 1 included binary, Likert scale-type, multiple-response, and open-ended questions. These were converted to affirmative statements for round 2 if sufficient agreement was reached. Consensus was set at a predefined threshold of at least 90% of panelists across all surgical specialties and regions selecting the same option ("agree" or "disagree") for the affirmative statements. Results: Of the 49 statements in the round 2 questionnaire, panelists (n=135) reached consensus that (1) tissue slippage outside stapler jaws can occur due to limited access and space; (2) greater jaw aperture could help to manipulate thick or fragile tissue more easily; (3) articulation of an endocutter is clinically important in laparoscopic surgeries; (4) improved access to hard-to-reach targets and in limited space would improve safety; and (5) an endocutter with improved access through greater articulation would become common use. Discussion: By understanding user-specific challenges and needs from both specialty- and region-wide perspectives, endoscopic stapling devices can continue to be refined. In this study, improved articulation and greater jaw aperture were the key design features examined. Improved articulation and greater jaw aperture were key stapler design features identified in this study that may mitigate the risk of instrument clashes and intraoperative complications such as anastomotic leaks. Conclusions: This study gained insights into surgeons' perspective across a variety of specialties and from 3 distinct geographies. Participating surgeons reached consensus that an endocutter with greater jaw aperture and articulation may improve surgical access and has potential to improve surgical outcomes.

E-AHPBA-ESSO-ESSR Innsbruck consensus guidelines for preoperative liver function assessment before hepatectomy

BACKGROUND

Posthepatectomy liver failure (PHLF) contributes significantly to morbidity and mortality after liver surgery. Standardized assessment of preoperative liver function is crucial to identify patients at risk. These European consensus guidelines provide guidance for preoperative patient assessment.

METHODS

A modified Delphi approach was used to achieve consensus. The expert panel consisted of hepatobiliary surgeons, radiologists, nuclear medicine specialists, and hepatologists. The guideline process was supervised by a methodologist and reviewed by a patient representative. A systematic literature search was performed in PubMed/MEDLINE, the Cochrane library, and the WHO International Clinical Trials Registry. Evidence assessment and statement development followed Scottish Intercollegiate Guidelines Network methodology.

RESULTS

Based on 271 publications covering 4 key areas, 21 statements (at least 85 per cent agreement) were produced (median level of evidence 2- to 2+). Only a few systematic reviews (2++) and one RCT (1+) were identified. Preoperative liver function assessment should be considered before complex resections, and in patients with suspected or known underlying liver disease, or chemotherapy-associated or drug-induced liver injury. Clinical assessment and blood-based scores reflecting liver function or portal hypertension (for example albumin/bilirubin, platelet count) aid in identifying risk of PHLF. Volumetry of the future liver remnant represents the foundation for assessment, and can be combined with indocyanine green clearance or LiMAx® according to local expertise and availability. Functional MRI and liver scintigraphy are alternatives, combining FLR volume and function in one examination.

CONCLUSION

These guidelines reflect established methods to assess preoperative liver function and PHLF risk, and have uncovered evidence gaps of interest for future research.

Long COVID and Wavering Incidence of Pulmonary Embolism: A Systematic Review

Pulmonary embolism (PE) is a serious medical condition that can occur as a result of venous thromboembolism (VTE). COVID-19, also known as Post-Acute Sequelae of SARS-CoV-2 infection (PASC), can potentially lead to PE due to the formation of blood clots in the lungs. This study aims to collate and report trends of PE in patients with long COVID (4-12 weeks since infection) and post-COVID-19 syndrome (>12 weeks since infection). The study adhered to PRISMA Statement 2020 guidelines, and a systematic search was conducted in four databases. In total, nine observational studies were included with a total patient count of 45,825,187. The incidence of PE with long COVID/post-COVID-19 syndrome was seen among 31,885 individuals out of 44,967,887 participants. The incidence rate of PE was observed as 0.07%, given that the studies included matched controls. While we cannot state with certainty that COVID-19 infection in itself leads to higher risks of PE at a later time, this study emphasizes the need for optimized care and longitudinal studies during the COVID-19 era to account for deviations from the norm.

Challenges, Complexity, and Developments in Transition Services for Young People with Disabilities, Mental Health, and Long-Term Conditions: An Integrative Review

Transition to adulthood for young people is complex and multi-faceted, with additional hurdles for young people who have disabilities, long-term, or life-limiting conditions or mental health problems. The challenges in providing effective transition support are not new; researchers, policymakers, commissioners, and service providers have been grappling with the problem for several decades, with varying degrees of success. The aims of this integrative review were firstly to build on previous research to synthesize and evaluate recently published evidence. Secondly to provide an overview of the effectiveness of interventions (in one or a combination of health, social care, and education transitions) designed to support transition to adulthood in these groups of young people. A search of a range of databases retrieved published literature from January 2015 to January 2021 demonstrating global interest in the topic. Fifty-one articles were included following an appraisal of quality and eligibility. Qualitative, quantitative, mixed methods studies, and evidence synthesis were included. Some studies were clinically orientated whilst others examined the impact of the transition process, or utilized participatory approaches which give young service-users and families a voice. Transition between children's and adult health or care services as well as other life-course trajectories, such as life-skills development, education transitions, social inclusion and employability were evaluated. Thematic analysis and synthesis of articles retrieved in this review highlighted themes identified in previous reviews: timing of, and preparation for transition; perceptions and experience of transition; barriers and facilitators; transition outcomes. Additional themes included special considerations; dealing with complexity; advocacy, participation, autonomy, aspirations, and young people's rights; future work, research, and evaluation. Novel perspectives and diverse data sources contributed to holistic understanding of an ongoing priority for international policy, service development, and research: the complexity of providing effective transition support and achieving positive outcomes for young people with long-term and life-limiting health conditions, disabilities, and mental health difficulties.

Working with private hospital midwives in Victoria, Australia to identify practice change priorities: Outcomes of a Delphi study

OBJECTIVE/AIM

In this study, we invited midwives working at one metropolitan private hospital in Victoria, Australia to identify their workplace change needs and priorities for research.

METHODS

In this two-round Delphi study, all midwifery staff within the maternity unit of a private hospital in Melbourne, Australia were invited to participate. In round one, participants joined face-to-face focus groups to put forward their ideas for workplace change and research ideas, and these data were developed into themes. In round two, participants ranked the themes in priority order.

FINDINGS

The top four themes identified by this cohort of midwives were: 'Ways of working - investigating alternate ways of working to enable greater flexibility and opportunities'; 'Understanding midwifery - working with the executive team to highlight the nuances of maternity care'; 'Education - increase in staff in the education team to provide a greater presence and opportunity for education'; and 'Postnatal specific - review ways of working in postnatal areas'.

KEY CONCLUSIONS

A number of priority research and change areas were identified which, if implemented, would strengthen both midwifery practice and midwife retention in this workplace. The findings will be of interest to midwife managers. Further research to evaluate the process and success of implementing the actions identified in this study would be valuable.

Real-world experience of hereditary angioedema (HAE) in Mexico: A mixed-methods approach to describe epidemiology, diagnosis, and treatment patterns

Introduction and objectives

Due to the lack of structured and systematic information available, the aim of this study was to describe the epidemiology, diagnosis, healthcare processes, and treatment patterns of hereditary angioedema (HAE) in Mexico. To achieve this, different data sources were consulted regarding medical literature, structured health system databases, and angioedema-specialized physicians (AEP) opinion regarding HAE.

Material and methods

A mixed methods approach was conducted in 4 phases: I) systematic literature review (SLR) and meta-analysis according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines; II) review of national health system (NHS) databases and systematic reports; III) physician survey; and IV) an epidemiologic model. ICD 10 D84.1 encoded records from the NHS were used to estimate the number of patients with HAE attended and treated during 2019. A survey was implemented to increase understanding of the clinical profile and treatments used.

Results

A prevalence rate of 0.9/50 000 inhabitants was estimated for 2019. In the same year, an estimated 317 HAE type 1 patients were recorded in the NHS, aged ≥11 years old. The most frequent clinical symptoms were cutaneous edema (67.5%) and abdominal pain (47.9%). A severe episode with laryngeal edema appeared in 27.5% of cases. Acute episodes were mainly moderate to severe (77.0%), with an annual per capita frequency of emergency visits of 7.6 patient-year (range 1-12/patient-year). The main reasons for hospitalization corresponded to laryngeal facial, tongue, and abdominal edemas, representing 73.3% of annual ICD 10 D84.1 reported hospitalizations. The main treatments that patients with HAE received were fresh frozen plasma for acute attacks and danazol for short-term prophylaxis (STP).

Conclusions

Despite efforts to make HAE visible, according to this study, cases recognized and treated in the NHS represent only 16.6% of the estimated prevalence.

Prioritizing the Psychosocial Support Needs of Mothers with Gestational Diabetes: A Delphi Study

Background

Gestational diabetes is the most common medical complication in pregnancy, and the psychosocial health of women suffering from this condition affects their adherence to treatment and self-efficacy. However, since it is not possible to design interventions dealing with all of these needs, the aim of this study was to prioritize the psychosocial supportive needs of women with gestational diabetes.

Materials and Methods

This was a modified Delphi design study involving 22 experts who were selected using purposive and snowball sampling methods. The study was conducted between April 2021 and June 2021. First, the psychosocial needs of diabetic pregnant women were extracted through a qualitative study involving interviews with multidisciplinary specialists and diabetic pregnant mothers (22 participants) and a systematic review of reputable scientific databases. Throughout the two Delphi stages, the questionnaire was classified, quantified, and analyzed.

Results

Based on the results of this study, the following are the top priorities when addressing the psychosocial needs of mothers with gestational diabetes: paying attention to and identifying the mother's worries and anxiety, husband and family support for diabetic pregnant women, the inclusion of specialized nutrition counseling services in mothers' treatment plan, timely education of mothers about diabetes and its complications, and proper nutrition for diabetic mothers.

Conclusions

The priorities of the supportive needs obtained in this study can be used to design interventions aimed at promoting psychosocial health, reducing stress and anxiety, and improving medication adherence in women with gestational diabetes.

Spanish consensus of occupational therapists on upper limb assessment tools in stroke

Introduction

There is a lack of explicit tool recommendations for upper limb (UL) assessment in stroke, occupational therapists are frequently underrepresented in consensus studies, and the frequency of use of tools is highly variable between countries. The objective was to generate national occupational therapy consensus recommendations on UL assessment tools in stroke, and to classify the tools that achieve consensus according to the International Classification of Functioning, Disability and Health (ICF) components.

Methods

Three-round e-Delphi study of national scope. Occupational therapists working in Spain with training and experience in neurorehabilitation were recruited. Rounds were based on the completion of questionnaires on UL stroke assessment tools. Consensus was reached when ⩾75% of experts gave a ⩾7 rating on a nine-point Likert scale.

Results

A total of 29 occupational therapists comprised the expert panel. Twenty-three (17.8%) assessment tools achieved consensus and were classified according to the ICF components of body functions and structures (7), activities (11), participation (3) and other (2).

Conclusion

The expert panel recommended 23 outcome measures for UL recovery in stroke, representing all ICF components. The consensus recommendations are intended to assist occupational therapists in their clinical decision-making process, and to reduce the heterogeneity of research tools.

Consensus on an assessment protocol for children with speech sound disorders in Sri Lanka

BACKGROUND

Speech sound disorders (SSDs) are the most common form of communication disorders in children. SSD have an impact on children's abilities to make themselves understood to their listeners and can influence a child's social and emotional well-being as well as their academic achievements. Therefore, it is important to identify children with an SSD early, in order to provide appropriate intervention. A wealth of information on best practice in the assessment of children with SSD is available in countries where the speech and language therapy profession is well established. In Sri Lanka, there is a paucity of research evidence supporting assessment practices that are culturally and linguistically appropriate in SSDs. Therefore, clinicians rely on informal assessment methods. There is a need to understand more about how clinicians in Sri Lanka assess this caseload in order to get general agreement regarding comprehensive and consistent procedures for assessment of paediatric SSD in Sri Lanka. This would support speech and language therapists' (SLTs') clinical decision-making in relation to choice of appropriate goals and intervention for this caseload.

AIM

To develop and gain consensus on an assessment protocol for Sri Lankan children with SSD that is culturally appropriate and based on existing research.

METHOD

A modified Delphi method was utilised to gather data from clinicians currently working in Sri Lanka. The research involved three rounds of data collection, exploring current assessment practices in Sri Lanka, ranking these in order of priority and establishing consensus on a proposed assessment protocol. The proposed assessment protocol was based on the results of the first and second rounds as well as previously published best practice guidelines.

OUTCOME AND RESULTS

The proposed assessment protocol achieved consensus in relation to content, format and cultural appropriateness. SLTs affirmed the usefulness of the protocol within the Sri Lankan context. Further research is required to assess the feasibility and effectiveness of this protocol in practice.

CONCLUSIONS & IMPLICATIONS

The assessment protocol supports practicing SLTs with a general guide to assessing children with suspected SSDs in Sri Lanka. The application of this protocol built upon consensus enables clinicians to improve their individual practice patterns based on best practice recommendations in the literature and the evidence on culturally and linguistically appropriate practices. This study has identified the need for further research in this area, including the development of culturally and linguistically specific assessment tools that would complement the use of this protocol.

WHAT THIS PAPER ADDS

What is already known on the subject The assessment of children with speech sound disorders (SSDs) requires a comprehensive and holistic approach due to their heterogeneous nature. Although there is evidence to support the assessment of paediatric SSDs in many countries where the profession of speech and language therapy is established, there is limited evidence to support the assessment of children with SSDs in Sri Lanka. What this study adds This study provides information about current assessment practices in Sri Lanka and consensus on a proposed culturally appropriate protocol for the assessment of children with SSDs in this country. What are the clinical implications of this work? The proposed assessment protocol provides speech and language therapists in Sri Lanka with a guide for assessment of paediatric SSDs to support more consistent practice in this area. Future evaluation of this preliminary protocol is required; however, the methodology used in this research could be applied to the development of assessment protocols for other range of practice areas in this country.

The development of the People with Aphasia and Other Layperson Involvement (PAOLI) framework for guiding patient and public involvement (PPI) in aphasia research

BACKGROUND

Patient and Public Involvement (PPI) in aphasia research requires researchers to include people with aphasia as research partners from the beginning of the study. Yet the quality of reporting on the level and type of involvement is poorly documented in the absence of a framework to guide PPI in aphasia research. This study aimed to extract the items and statements relevant for the development of the People with Aphasia and Other Layperson Involvement (PAOLI) framework for designing and implementing PPI in aphasia research, in collaboration with people with aphasia.

METHOD

The method recommended by the EQUATOR network was followed. This involved: (1) evidence from a scoping review, (2) a thematic analysis of the in-depth interviews, of people with stroke and aphasia, on the topics to be included in the pilot draft, (3) a two round Delphi survey for item/statement selection and (4) an experts' consensus meeting. The research team involved two PPI partners with chronic stroke-induced aphasia. The research process involved co-design and was informed by the Dialogue model.

RESULTS

Twenty-three panellists, from 13 countries, voted in round one with 87% (20/23) responding in round two. The final PAOLI framework includes the following 17 items (with 66 descriptive statements): establish collaborations, recruit patients, gain informed consent, organize induction meetings, train patient partners, create communication links, engage communication partners, conceptualize topics, establish research priorities, reach consensus, work with co-design methods, develop proposals, assist with dissemination of results, promote implementation of the outcomes, support patient partners and promote self-evaluation, monitor progress and assess impact of the patient involvement. These items were considered by the panellists as the most relevant for the involvement of people with aphasia as research partners.

CONCLUSION

The PAOLI is the first international consensus framework for guiding patient involvement in aphasia research. Researchers are encouraged to adopt the framework to improve the quality of their research by promoting the meaningful involvement of people with aphasia within the research team from the start.

Applying the Delphi Approach to Prioritize Social Factors Affecting the Development of Children Under Six Years

BACKGROUND

Social determinants of health have a key role in the growth and development of children, particularly in early childhood which is mentioned from infancy to the age of six years old. These factors might cause disparities in living conditions and consequently bring about inequities regarding different aspects of development such as emotional, psychological, social, psychological, and intellectual. This research aimed to provide a model for prioritizing social factors affecting the development of children under six years.

METHODS

We used quantitative-qualitative (mixed) method to perform data analysis. The statistical population included 12 medical experts and professionals in the field of children's development and social determinants of health that were selected using the snowball method. In the quantitative section, a Delphi technique was applied to screen the extracted indicators. Then through applying a decision-making trial and evaluation laboratory (DEMATEL) method, the cause-and-effect interactions among main social determinants were identified. To analyze data, super decision software was used.

RESULTS

According to literature review and the results obtained from focus group discussions, five dimensions including individual factors, family factors, environmental factors, governance, and global factors were identified. Based on the study findings, the criterion of "family factors" was mentioned as the most important priority affecting childhood development. Furthermore, the sub-criterion of "International Programs and Policies" received the greatest priority among other sub-criteria with a profound impact on children's healthy growth and development.

CONCLUSION

Despite the current knowledge about social determinants of health, it is required to identify the most influential socioeconomic factors on childhood development. In such a manner, political strategies for improving the health condition of children can be implemented based on scientific evidence. Due to the crucial role of family factors, environmental factors and other socio-economic conditions, health policy makers and public health practitioners should be informed of the importance of these factors in shaping the health condition of children.

Child self-care autonomy in health (scale for parents): development, internal structure, and sex/age correlates

Autonomy in self-care practices in the health sphere is a critical characteristic for the survival of humans throughout the life span. Notably, however, the current literature lacks psychometrically sound instruments that measure this phenomenon among children without diagnosed chronic health conditions. The purpose of the present exploratory study was to develop, test, and provide data regarding the reliability and validity of the Child Self-Care Autonomy in Health (CSAH) scale. The piloted version of the CSAH yielded an 11-item instrument designed to reflect the parent's perspective in measuring the extent of autonomy in self-care actions related to health for a child, whether diagnosed with a chronic illness or not. Data were collected through an online survey of a non-random sample of Russian-speaking parents currently residing in Russia (N = 349). The analysis focused on scale structure via principal component analysis and age/sex associations. The proposed CSAH may be of interest to social workers, health professionals, and parents seeking to ascertain schoolers' autonomy in self-care practices in the health sphere and support building a stronger self-care mindset.

Development of expert consensus to guide physical rehabilitation in children and adolescents with acquired brain injury during the subacute phase

OBJECTIVE

To develop consensus among experts to guide physical rehabilitation in children and adolescents with acquired brain injury during the subacute phase.

DESIGN

International Delphi study.

METHODS

A 3-round online Delphi study was conducted with 11 international experts in rehabilitation for children and adolescents with acquired brain injury. The first round consisted of open-ended questions; the second and third round consisted of ranking 139 statements on a 5-point Likert scale.

RESULTS

The panel reached consensus on 116/139 statements. Consensus was reached on the importance of age, pre-injury developmental stage and the clinical presentation of the child when determining content and focus of physical rehabilitation. In addition, consensus was reached on the importance of participation-focused interventions, and involvement of family members in goal-setting and therapeutic activities. Although dosage was deemed very important, no consensus was reached for determination of dose-response variables to suit and influence the child's needs.

CONCLUSION

This study provides a framework for clinicians to design physical rehabilitation interventions in children with acquired brain injury in the sub-acute recovery phase. The promotion of physical activity in meaningful contexts and involvement of family members are considered as important components to optimize recovery.

Consensus evidence-based recommendations for transition of care for adolescents with juvenile idiopathic arthritis: meeting patients’, parents’, and rheumatologists’ perspectives

Background

Transition of care means the process of educating and empowering adolescents and young adults to take an active role in their own healthcare, develop decision-making skills, and eventually transition from paediatric to adult healthcare providers. Most people do not switch doctors until they are young adults, but it can be beneficial to start preparing children earlier. We aimed to develop a specific toolkit tailored to paediatric and adult rheumatologists to assist them in transitioning of care of young people with juvenile onset rheumatic musculoskeletal diseases from the paediatric to adult rheumatology care.

Results

The expert panel was confined to an online survey (n = 18), all the experts completed the two rounds. At the conclusion of round 2, a total of 10 points were gathered. The range of respondents (ranks 7–9) who agreed with the recommendations was 88.9 to 100%. All 10 clinical standards identified by the scientific committee were written in the same way. Based on the answers to the structured key questions and the literature review, a structured template was developed presenting transition of care integrated pathway.

Conclusion

The developed rheumatology-specific guideline offers adolescents and young adults a focussed, multidisciplinary transition of care approach with equity of access, quality of care and flexibility and set up standards for transitional care for young adults with juvenile rheumatological diseases.

Review of diversity, equity, and inclusion by ethics committees: A Delphi consensus statement

The appropriate representation of diverse populations in interventional trials remains problematic. A Delphi process was used to affirm the central role that ethics committees and institutions play in this process and to establish consensus upon 25 consolidated recommendations across four themes to promote diversity and inclusion in interventional clinical research.

A short list of high-priority indicators of health system responsiveness for aging: an eDelphi consensus study

The objective of this article was to provide a consensus-based short list of effective indicators to measure health system responsiveness to the needs of older adults which would be relevant to informing public policy. An e-Delphi study was done with no direct interaction between respondents. Virtual surveys were sent to 141 participants with experience in analysis and monitoring of health indicators, management of health systems, and health care of older adults. A baseline list of 24 previously published indicators was used. The criteria for selection as high priority indicators were: usefulness as a tracer of health system responsiveness and usefulness to inform policy. Consensus was defined as: ≥70% agreement among the participants that the indicator was very high or high priority; plus being benchmarked by ≥50% of respondents as having a higher relative weight than other indicators; plus being in the top 10 in the ranking list. The first round of the process included 38 participants with varied professional backgrounds. Consensus was reached for seven indicators after two rounds. Five indicators were related to distal outcomes (mortality, disability, or healthy life expectancy), one to monitoring functional assessments, and one to poverty levels. Health systems professionals should consider these comprehensive priority indicators in their efforts to provide a better health system for older people.

Forming a consensus opinion to inform long COVID support mechanisms and interventions: a modified Delphi approach

Background

Current approaches to support patients living with post-COVID condition, also known as Long COVID, are highly disparate with limited success in managing or resolving a well-documented and long-standing symptom burden. With approximately 2.1 million people living with the condition in the UK alone and millions more worldwide, there is a desperate need to devise support strategies and interventions for patients.

Methods

A three-round Delphi consensus methodology was distributed internationally using an online survey and was completed by healthcare professionals (including clinicians, physiotherapists, and general practitioners), people with long COVID, and long COVID academic researchers (round 1 n = 273, round 2 n = 186, round 3 n = 138). Across the three rounds, respondents were located predominantly in the United Kingdom (UK), with 17.3-15.2% (round 1, n = 47; round 2 n = 32, round 2 n = 21) of respondents located elsewhere (United States of America (USA), Austria, Malta, United Arab Emirates (UAE), Finland, Norway, Malta, Netherlands, Iceland, Canada, Tunisie, Brazil, Hungary, Greece, France, Austrailia, South Africa, Serbia, and India). Respondents were given ∼5 weeks to complete the survey following enrolment, with round one taking place from 02/15/2022 to 03/28/22, round two; 05/09/2022 to 06/26/2022, and round 3; 07/14/2022 to 08/09/2022. A 5-point Likert scale of agreement was used and the opportunity to include free text responses was provided in the first round.

Findings

Fifty-five statements reached consensus (defined as >80% agree and strongly agree), across the domains of i) long COVID as a condition, ii) current support and care available for long COVID, iii) clinical assessments for long COVID, and iv) support mechanisms and rehabilitation interventions for long COVID, further sub-categorised by consideration, inclusion, and focus. Consensus reached proposes that long COVID requires specialised, comprehensive support mechanisms and that interventions should form a personalised care plan guided by the needs of the patients. Supportive approaches should focus on individual symptoms, including but not limited to fatigue, cognitive dysfunction, and dyspnoea, utilising pacing, fatigue management, and support returning to daily activities. The mental impact of living with long COVID, tolerance to physical activity, emotional distress and well-being, and research of pre-existing conditions with similar symptoms, such as myalgic encephalomyelitis, should also be considered when supporting people with long COVID.

Interpretation

We provide an outline that achieved consensus with stakeholders that could be used to inform the design and implementation of bespoke long COVID support mechanisms.

Funding

None.

Strategies to enhance the approach to prostate cancer screening of South African black men in the Free State: a Delphi study

Background

The incidence and mortality rates of prostate cancer (PCa) are disproportionately on the increase among South African black men. Recent studies show a greater net benefit of prostate-specific antigen screening of black men compared with the general population. There are, however, knowledge, attitude, and practice (KAP) gaps among primary healthcare providers (HCPs) and users (black men) on PCa screening. Likewise, there is a scarcity of research on strategies to address these gaps.

Objective

This study sought to determine complementing strategies to enhance the approach to PCa screening of African men in the Free State, South Africa, from the perspectives of primary HCPs and users.

Methods

This study utilized a three-round modified Delphi survey to achieve its aim. Consensus was determined by an a priori threshold of ≥70% of agreement.

Results

The survey involved a multidisciplinary panel of 19 experts. The consensus was reached on 34 items (strategies) to enhance the approach to PCa screening in the study setting. Community health education strategies were proffered, relating to relevant topics, methods, venues of delivery, and persons to deliver the education. Continuing education topics and methods of instruction were suggested for primary HCPs.

Conclusions

In view of the existing KAP gaps in PCa screening among primary HCPs and users (black men), an expert consensus was determined, on complementing strategies to enhance the approach to PCa screening of South African black men in the study setting.

International e-Delphi Consensus Recommendations for the Assessment and Diagnosis of Circadian rest-Activity Rhythm Disorders (CARDs) in Patients with Cancer

PURPOSE

Circadian rest-Activity Rhythm Disorders (CARDs) are common in patients with cancer, particularly in advanced disease. CARDs are associated with increased symptom burden, poorer quality of life, and shorter survival. Research and reporting practices lack standardization, and formal diagnostic criteria do not exist. This electronic Delphi (e-Delphi) study aimed to formulate international recommendations for the assessment and diagnosis of CARDs in patients with cancer.

METHODS

An international e-Delphi was performed using an online platform (Welphi). Round 1 developed statements regarding circadian rest-activity rhythms, diagnostic criteria, and assessment techniques. Rounds 2 and 3 involved participants rating their level of agreement with the statements and providing comments until consensus (defined internally as 67%) and stability between rounds were achieved. Recommendations were then created and distributed to participants for comments before being finalized.

RESULTS

Sixteen participants from nine different clinical specialties and seven different countries, with 5-35 years of relevant research experience, were recruited, and thirteen participants completed all three rounds. Of the 164 generated statements, 66% achieved consensus, and responses were stable between the final two rounds.

CONCLUSIONS

The e-Delphi resulted in international recommendations for assessing and diagnosing CARDs in patients with cancer. These recommendations should ensure standardized research and reporting practices in future studies.

Using the Behaviour Change Wheel and modified Delphi method to identify behavioural change techniques for improving adherence to smoking cessation medications

BACKGROUND

Medication adherence is a crucial component of the pharmacological treatment of smoking. Previous interventions targeted to improve adherence to smoking cessation medications (SCMs) were designed using pragmatic approaches. This study aims to develop a comprehensive intervention strategy to improve adherence to SCMs using the Behaviour Change Wheel (BCW) and a modified Delphi method.

METHODS

Recommendations for the design of intervention strategies were based on the BCW guide and six studies conducted by the research team. Factors related to healthcare providers and consumers (person making a quit attempt) that showed associations with adherence were mapped into the Capability, Opportunity, Motivation, Behaviour (COM-B) model, and corresponding intervention functions and policy categories. Interventions were then represented using the Behaviour Change Technique Taxonomy. Finally, a modified Delphi study using 17 experts was conducted to evaluate the nominated strategies using the Acceptability, Practicability, Effectiveness, Affordability, Side-effects, and Equity (APEASE) criteria.

RESULTS

Following a stepped approach, an adherence support wheel was designed to guide implementation strategies and programmes. Thirteen intervention strategies were selected. The selected interventions include providing detailed instructions on how to use SCMs; establishing realistic expectations from SCMs; and providing training for healthcare providers regarding comprehensive smoking cessation care with specifics on the provision of adherence support.

CONCLUSION

The BCW guide and a modified Delphi were applied successfully to design interventions tailored to improve adherence to SCMs. Improving adherence to SCMs requires a comprehensive intervention approach involving various stakeholders. Future research is needed to assess the effectiveness of the nominated intervention strategies.

Implementation strategy for introducing a clinical skills examination to the Korean Oriental Medicine Licensing Examination: a mixed-method modified Delphi study

PURPOSE

This study investigated the validity of introducing a clinical skills examination (CSE) to the Korean Oriental Medicine Licensing Examination through a mixed-method modified Delphi study

METHODS

A 3-round Delphi study was conducted between September and November 2022. The expert panel comprised 21 oriental medicine education experts who were officially recommended by relevant institutions and organizations. The questionnaires included potential content for the CSE and a detailed implementation strategy. Subcommittees were formed to discuss concerns around the introduction of the CSE, which were collected as open-ended questions. In this study, a 66.7% or greater agreement rate was defined as achieving a consensus.

RESULTS

The expert panel’s evaluation of the proposed clinical presentations and basic clinical skills suggested their priorities. Of the 10 items investigated for building a detailed implementation strategy for the introduction of the CSE to the Korean Oriental Medicine Licensing Examination, a consensus was achieved on 9. However, the agreement rate on the timing of the introduction of the CSE was low. Concerns around 4 clinical topics were discussed in the subcommittees, and potential solutions were proposed.

CONCLUSION

This study offers preliminary data and raises some concerns that can be used as a reference while discussing the introduction of the CSE to the Korean Oriental Medicine Licensing Examination.

Quality Indicators for Adolescents and Young Adults With Advanced Cancer: A Modified Delphi Process With Patients, Family Members, and Clinicians

CONTEXT

Quality measures have been devised for end-of-life care of older adults with cancer, but are lacking for adolescents and young adults (AYAs).

OBJECTIVE

We previously conducted interviews with AYAs, family caregivers, and clinicians to identify priority domains for high quality care of AYAs with advanced cancer. The goal of this study was to use a modified Delphi process to form consensus around the highest priority quality indicators.

METHODS

A modified Delphi process was conducted with 10 AYAs with recurrent or metastatic cancer, 11 family caregivers, and 29 multidisciplinary clinicians, using small group web conferences. Participants were asked to rate the importance of each of 41 potential quality indicators, rank the 10 most important, and engage in discussion to reconcile differences.

RESULTS

Of 41 initial indicators, 34 were rated as highly important (rating seven, eight, or nine on a nine-point scale) by >70% of participants. The panel was unable to reach consensus around the 10 most important indicators. Instead, participants recommended retaining a larger set of indicators to reflect potential for different priorities across the population, resulting in a final set of 32 indicators. Recommended indicators broadly encompassed attention to physical symptoms; quality of life; psychosocial, and spiritual care; communication and decision-making; relationships with clinicians; care and treatment; and independence.

CONCLUSION

A patient- and family-centered process for quality indicator development led to strong endorsement of multiple potential indicators by Delphi participants. Further validation and refinement will be performed using a survey of bereaved family members.

Development of a discrete choice experiment questionnaire to elicit preferences by pregnant women and policymakers for the expansion of non-invasive prenatal screening

OBJECTIVE

An instrument for measuring intervention preferences applicable to both patients and policymakers would make it possible to better confront the needs of the supply and demand sides of the health care system. This study aimed to develop a discrete choice experiments (DCE) questionnaire to elicit the preferences of patients and policymakers. The instrument was specifically developed to estimate preferences for new conditions to be added to a screening program for fetal chromosomal anomalies.

METHODS

A DCE development study was conducted. The methods employed included a literature review, a qualitative study (based on individual semi-structured interviews, consultations, and a focus group discussion) with pregnant women and policymakers, and a pilot project with 33 pregnant women to validate the first version of the instrument and test the feasibility of its administration.

RESULTS

An initial list of 10 attributes was built based on a literature review and the qualitative research components of the study. Five attributes were built based on the responses provided by the participants from both groups. Eight attributes were consensually retained. A pilot project performed on 33 pregnant women led to a final instrument containing seven attributes: 'conditions to be screened', 'test performance', 'moment at gestational age to obtain the test result', 'degree of test result certainty to the severity of the disability', 'test sufficiency', 'information provided from test result', and 'cost related to the test'.

CONCLUSION

It is possible to reach a consensus on the construction of a DCE instrument intended to be administered to pregnant women and policymakers. However, complete validation of the consensual instrument is limited because there are too few voting members of health technology assessment agencies committees to statistically ascertain the relevance of the attributes and their levels.

Nutrition management of PKU with pegvaliase therapy: update of the web-based PKU nutrition management guideline recommendations

BACKGROUND

The web-based GMDI/SERN PKU Nutrition Management Guideline, published before approval of pegvaliase pharmacotherapy, offers guidance for nutrition management of individuals with phenylketonuria (PKU) treated with dietary therapy and/or sapropterin. An update of this guideline aims to provide recommendations that improve clinical outcomes and promote consistency and best practice in the nutrition management of individuals with PKU receiving pegvaliase therapy. Methodology includes: formulation of a research question; review, critical appraisal, and abstraction of peer-reviewed studies and unpublished practice literature; expert input through Delphi surveys and a Nominal Group process; and external review by metabolic experts.

RESULTS

Recommendations, summary statements, and strength of evidence are included for each of the following topics: (1) initiating a pegvaliase response trial, (2) monitoring therapy response and nutritional status, (3) managing pegvaliase treatment after response to therapy, (4) education and support for optimal nutrition with pegvaliase therapy, and (5) pegvaliase therapy during pregnancy, lactation, and adolescence. Findings, supported by evidence and consensus, provide guidance for nutrition management of individuals receiving pegvaliase therapy for PKU. Recommendations focus on nutrition management by clinicians, as well as the challenges for individuals with PKU as a result of therapy changes.

CONCLUSIONS

Successful pegvaliase therapy allows the possibility for individuals with PKU to consume an unrestricted diet while still maintaining the benefits of blood phenylalanine control. This necessitates a perspective change in education and support provided to individuals in order to achieve healthy nutrient intake that supports optimal nutritional status. The updated guideline, and companion Toolkit for practical implementation of recommendations, is web-based, allowing for utilization by health care providers, researchers, and collaborators who advocate and care for individuals with PKU. These guidelines are meant to be followed always taking into account the provider's clinical judgement and considering the individual's specific circumstances. Open access is available at the Genetic Metabolic Dietitians International ( https://GMDI.org ) and Southeast Regional Genetics Network ( https://managementguidelines.net ) websites.

Development of the WHO eye care competency framework

BACKGROUND

The eye care workforce, particularly in lower resource settings, face challenges of limited integration into the health system, limited workforce capacity, mismatch of workforce to population need and poor quality of care. In recognition of these challenges, coupled with a gap in existing tools, provides a strong rationale for the development of the Eye care competency framework (ECCF).

METHODS

A mixed methods approach was utilised to develop and validate the ECCF. Content was developed by extracting relevant components of existing frameworks used both within and outside of eye care. A diverse technical working group provided feedback and guidance on the structure, design, and content to create a preliminary draft. Competencies and activities were validated using a modified-Delphi study, and the framework was then piloted at four sites to understand how the tool can be implemented in different settings.

RESULTS

The final version of the ECCF included eight outcomes, nine guiding principles, and content of each of the key elements, including the six domains, 22 competencies, 21 activities, 193 behaviours and 234 tasks, and the knowledge and skills that underpin them. 95/112 participants from the six WHO regions completed the modified-Delphi study, yielding an average of 96% agreement across the competencies and activities in the ECCF. The pilot showcased the versatility and flexibility of the ECCF, where each of the four sites had a different experience in implementing the ECCF. All sites found that the ECCF enabled them to identify gaps within their current workforce documentation.

CONCLUSIONS

The ECCF was developed using a collaborative approach, reflecting the opinions of participants and stakeholders from all around the world. The comprehensive competencies and activities developed in the ECCF encompass the diverse roles of eye care workers, and thus encourage multi-disciplinary care and better integration into the health system. It is recommended that eye care workforce planners and developers use the ECCF, and adapt it to their context, to support workforce development and focus on the quality and scope of eye care service provision.

Construction of a Form for Users of the Child Welfare System Based on the Delphi Method

Professionals in charge of designing individualized plans for children and adolescents in the child welfare system often lack the necessary information, either because it has not been systematically collected or because there are doubts about the reliability of the data obtained. The lack of consensual and validated instruments that gather the necessary information has led to the development of a rigorous and effective form, based on the Delphi methodology, aimed at obtaining an exhaustive knowledge of the characteristics of children and adolescents under the child welfare system. Once a consensus of different specialists approved the hetero-informed form, it was completed by 41 professionals working in residential care facilities for 307 children and adolescents. It consists of 66 items grouped into six dimensions: general information, school/work situation, child welfare system history, family visitation history, biological family information, and experiences of sexual abuse. During its construction and validation, a panel of experts analyzed its format and content during the different phases. Most of the items showed good performance, and professionals highlighted their ease of use and relevance. The method used ensured the content validity of this form. This instrument has proven to be a useful and effective tool for collecting sociodemographic information on children and adolescents in the child welfare system, which may improve their conditions.

Practice of neuromonitoring in open and endovascular thoracoabdominal aortic repair-an international expert-based modified Delphi consensus study

OBJECTIVES

Spinal cord injury is detrimental for patients undergoing open or endovascular thoracoabdominal aortic aneurysm (TAAA) repair. The aim of this survey and of the modified Delphi consensus was to gather information on current practices and standards in neuroprotection in patients undergoing open and endovascular TAAA.

METHODS

The Aortic Association conducted an international online survey on neuromonitoring in open and endovascular TAAA repair. In a first round an expert panel put together a survey on different aspects of neuromonitoring. Based on the answers from the first round of the survey, 18 Delphi consensus questions were formulated.

RESULTS

A total of 56 physicians completed the survey. Of these, 45 perform open and endovascular TAAA repair, 3 do open TAAA repair and 8 do endovascular TAAA repair. At least 1 neuromonitoring or protection modality is utilized during open TAAA surgery. Cerebrospinal fluid (CSF) drainage was used in 97.9%, near infrared spectroscopy in 70.8% and motor evoked potentials or somatosensory evoked potentials in 60.4%. Three of 53 centres do not utilize any form of neuromonitoring or protection during endovascular TAAA repair: 92.5% use CSF drainage; 35.8%, cerebral or paravertebral near infrared spectroscopy; and 24.5% motor evoked potentials or somatosensory evoked potentials. The utilization of CSF drainage and neuromonitoring varies depending on the extent of the TAAA repair.

CONCLUSIONS

The results of this survey and of the Delphi consensus show that there is broad consensus on the importance of protecting the spinal cord to avoid spinal cord injury in patients undergoing open TAAA repair. Those measures are less frequently utilized in patients undergoing endovascular TAAA repair but should be considered, especially in patients who require extensive coverage of the thoracoabdominal aorta.

Delphi-Based Expert Consensus Statements for the Management of Percutaneous Radiofrequency Neurotomy in the Treatment of Lumbar Facet Joint Syndrome

INTRODUCTION

A modified Delphi strategy was implemented for obtaining recommendations that could be useful in the management of percutaneous radiofrequency treatment of lumbar facet joint syndrome, as the literature on the argument was poor in quality.

METHODS

An Italian research team conducted a comprehensive literature search, defined the investigation topics (diagnosis, treatment, and outcome evaluation), and developed an explorative semi-structured questionnaire. They also selected the members of the panel. After an online meeting with the participants, the board developed a structured questionnaire of 15 closed statements (round 1). A five-point Likert scale was used and the cut-off for consensus was established at a minimum of 70% of the number of respondents (level of agreement ≥ 4, agree or strongly agree). The statements without consensus were rephrased (round 2).

RESULTS

Forty-one clinicians were included in the panel and responded in both rounds. After the first round, consensus (≥ 70%) was obtained in 9 out of 15 statements. In the second round, only one out of six statements reached the threshold. The lack of consensus was observed for statements concerning the use of imaging for a diagnosis [54%, median 4, interquartile range (IQR) 3-5], number of diagnostic blocks (37%, median 4, IQR 2-4), bilateral denervation (59%, median 4, IQR 2-4), technique and number of lesions (66%, median 4, IQR 3-5), and strategy after denervation failure (68%, median 4, IQR 3-4).

CONCLUSION

Results of the Delphi investigations suggest that there is a need to define standardized protocols to address this clinical problem. This step is essential for designing high-quality studies and filling current gaps in scientific evidence.

Explicit potentially inappropriate medications criteria for older population in Asian countries: A systematic review

BACKGROUND

Explicit potentially inappropriate medications (PIM) criteria are commonly used to identify and deprescribe potentially inappropriate prescriptions among older patients. Most of these criteria were developed specifically for the Western population, which might not be applicable in an Asian setting. The current study summarizes the methods and drug lists to identify PIM in older Asian people.

METHODS

A systematic review of published and unpublished studies were carried out. Included studies described the development of explicit criteria for PIM use in older adults and provided a list of medications that should be considered inappropriate. PubMed, Medline, EMBASE, Cochrane CENTRAL, CINAHL, PsycINFO, and Scopus searches were conducted. The PIMs were analyzed according to the general conditions, disease-specific conditions, and drug-drug interaction classes. The qualities of the included studies were assessed using a nine-point evaluation tool. The kappa agreement index was used to evaluate the level of agreement between the identified explicit PIM tools.

RESULTS

The search yielded 1206 articles, and 15 studies were included in our analysis. Thirteen criteria were identified in East Asia and two in South Asia. Twelve out of the 15 criteria were developed using the Delphi method. We identified 283 PIMs independent of medical conditions and 465 disease-specific PIMs. Antipsychotics were included in most of the criteria (14/15), followed by tricyclic antidepressants (TCAs) (13/15), antihistamines (13/15), sulfonylureas (12/15), benzodiazepines (11/15), and nonsteroidal anti-inflammatory drug (NSAIDs) (11/15). Only one study fulfilled all the quality components. There was a low kappa agreement (k = 0.230) between the included studies.

CONCLUSION

This review included 15 explicit PIM criteria, which most listed antipsychotics, antidepressants, and antihistamines as potentially inappropriate. Healthcare professionals should exercise more caution when dealing with these medications among older patients. These results may help healthcare professionals in Asian nations to create regional standards for the discontinuation of potentially harmful drugs for elderly patients.

The Gender-Diversity and Autism Questionnaire: A Community-Developed Clinical, Research, and Self-Advocacy Tool for Autistic Transgender and Gender-Diverse Young Adults

Background

Autistic transgender people face unique risks in society, including inequities in accessing needed care and related mental health disparities. Given the need for specific and culturally responsive accommodations/supports, the characterization of key experiences, challenges, needs, and resilience factors within this population is imperative. This study developed a structured self-report tool for autistic transgender young adults to communicate their experiences and needs in a report format attuned to common autistic thinking and communication styles.

Methods

This cross-nation project developed and refined the Gender-Diversity and Autism Questionnaire through an iterative community-based approach using Delphi panel methodology. This proof-of-principle project defined "expertise" broadly, employing a multi-input expert search approach to balance academic-, community-, and lived experience-based expertise.

Results

The expert collaborators (N = 24 respondents) completed a two-round Delphi study, which developed 85 mostly closed-ended items based on 90% consensus. Final item content falls within six topic areas: the experience of identities; the impact of experienced or anticipated discrimination, bias, and violence toward autistic people and transgender people; tasks and experiences of everyday life; gender diversity- or autism-related care needs and history; the experience of others doubting an individual's gender identity and/or autism; and the experience of community and connectedness. The majority of retained items relate to tasks and experiences of everyday life or the impact of experienced or anticipated discrimination, bias, and violence.

Conclusions

This study employed a multipronged multimodal search approach to maximize equity in representation of the expert measure development team. The resulting instrument, designed for clinical, research, and self-advocacy applications, has parallel Dutch and English versions and is available for immediate use. Future cross-cultural research with this instrument could help identify contextual risk and resilience factors to better understand and address inequities faced by this large intersectional population.

The Development of Recommendations for Healthcare Providers to Support Patients Experiencing Medication Self-Management Problems

Medication self-management problems such as the inability to correctly obtain, understand, organize, administer or monitor medication can result in negative patient outcomes. However, supportive tools for healthcare providers to assist patients with medication self-management problems are lacking. This study aimed to develop recommendations for healthcare providers to support patients with polypharmacy who experience medication self-management problems. A three-phase study was conducted starting with (1) the mapping of medication self-management problems, followed by (2) a scoping review providing a list of relevant interventions and actions for each respective problem and (3) a three-round modified e-Delphi study with experts to reach consensus on the relevance and clarity of the recommended interventions and actions. The cut-off for consensus on the relevance and clarity of the recommendations was set at 80% expert agreement. Experts could propose additional recommendations based on their professional experience and expertise. The experts (n = 23) involved were healthcare professionals (i.e., nurses, pharmacists, and physicians) with specific expertise in medication management of patients with polypharmacy. Simultaneous with the second e-Delphi round, a panel of patients with polypharmacy (n = 8) evaluated the usefulness of recommendations. Results obtained from the patient panel were fed back to the panel of healthcare providers in the third e-Delphi round. Descriptive statistics were used for data analysis. Twenty medication self-management problems were identified. Based on the scoping review, a list of 66 recommendations for healthcare providers to support patients with the identified medication self-management problems was composed. At the end of the three-round e-Delphi study, the expert panel reached consensus on the relevance and clarity of 67 recommendations, clustered according to the six phases of the medication self-management model by Bailey et al. In conclusion, this study resulted in a guidance document including recommendations that can serve as a resource for healthcare providers to support patients with polypharmacy in case of medication self-management problems. Future research should focus on the evaluation of the feasibility and user-friendliness of the guide with recommendations in clinical practice.

Modernizing patient-centered manual therapy: Findings from a Delphi study on orthopaedic manual therapy application

BACKGROUND

Recent literature challenges the process by which orthopaedic manual therapy (OMT) has traditionally been applied. Progressive understanding of the complexities surrounding OMT analgesia and the decreased reliance on technique specific characteristics in determining treatment effectiveness promotes an update to training paradigms related to OMT.

OBJECTIVES

The purpose of this Delphi study was to establish consensus on what trainees should be focusing on when demonstrating OMT techniques and how candidates for OMT should be identified.

DESIGN

An international three-round Delphi study following recommended guidelines for conducting and reporting of Delphi studies (CREDES) was performed.

METHODS

One-hundred sixty-four expert manual therapy educators were identified for participation across four countries. Participants were asked to provide what concepts trainees should be focusing on when demonstrating OMT techniques and how candidates for OMT should be identified. Twenty-one themes were identified for each question.

RESULTS

Twenty-eight participants completed all three rounds of the Delphi. Consensus was reached on nineteen themes and eighteen themes respectively. Results from this Delphi stress patient-centered care within a biopsychosocial pain management model. Representation across all pillars of evidence-based practice were represented. Themes reaching consensus within this study favored the importance of neurophysiological, psychological, and biomechanical principles.

CONCLUSION

This Delphi presents consensus-based recommendations for what manual therapy trainees should focus on when demonstrating OMT techniques and on how candidates for OMT should be identified. These findings in collaboration with previous consensus recommendations on concepts to focus on within OMT education promote restructuring of OMT curriculum to evidence-based patient-centered care models.

A contextual definition of longitudinal integrated clerkships within the UK and Ireland: A bi-national modified Delphi study

Disagreement exists within the UK and Ireland regarding how Longitudinal Integrated Clerkships should be defined, and the relevance of international definitions. In this modified, online Delphi study, we presented the UK and Ireland experts in Longitudinal Integrated Clerkships with statements drawn from international definitions, published LIC literature, and the research team's experience in this area and asked them to rate their level of agreement with these statements for inclusion in a bi-national consensus definition. We undertook three rounds of the study to try and elicit consensus, making adaptations to statement wording following rounds 1 and 2 to capture participants' qualitative free text-comments, following the third and final round, nine statements were accepted by our panel, and constitute our proposed definition of Longitudinal Integrated Clerkships within the UK and Ireland. This definitional statement corresponds with some international literature but offers important distinctions, which account for the unique context of healthcare (particularly primary care) within the UK and Ireland (for example, the lack of time-based criteria within the definition). This definition should allow UK and Irish researchers to communicate more clearly with one another regarding the benefits of LICs and longitudinal learning and offers cross-national collaborative opportunities in LIC design, delivery and evaluation.

Defining ruxolitinib failure and transition to next-line therapy for patients with myelofibrosis: a modified Delphi panel consensus study

Aim: To define ruxolitinib failure and develop parameters to guide transition to next-line therapy for patients with myelofibrosis. Methods: A modified Delphi panel with 14 hematologists-oncologists. Survey concepts included defining primary refractory status, loss of response, disease progression, intolerance and transition to next-line therapy. Results: Ruxolitinib failure may be defined as no improvement in symptoms or spleen size, progressive disease or ruxolitinib intolerance, following a maximally tolerated dose for ≥3 months. Loss of spleen response 1 month after initial response may prompt discontinuation. Lack of evidence to inform transition to next-line therapy was noted; tapering ruxolitinib should be considered according to ruxolitinib dose and patient characteristics. Conclusion: Expert consensus was provided on defining ruxolitinib failure and transition to next-line therapy as summarized in this position paper, which may support considerations in the development of future clinical practice guidelines.

Measurement of Humanity Among Health Professionals: Development and Validation of the Medical Humanity Scale Using the Delphi Method

BACKGROUND

Despite the importance of humanism in providing health care, there is a lack of valid and reliable tool for assessing humanity among health professionals.

OBJECTIVE

The aim of this study was to design a new humanism scale and to assess the validity of this scale in measuring humanism among Syrian health professional students.

METHODS

The Medical Humanity Scale (MHS) was designed. It consists of 27 items categorized into 7 human values including patient-oriented care, respect, empathy, ethics, altruism, and compassion. The scale was tested for internal consistency and reliability using Cronbach α and test-retest methods. The construct validity of the scale was also tested to assess the ability of the scale in differentiating between groups of health professional students with different levels of medical humanity. A 7-point Likert scale was adopted. The study included 300 participants including 97 medical, 78 dental, 82 pharmacy, and 43 preparatory-year students from Syrian universities. The Delphi method was used and factors analysis was performed. Bartlett test of sphericity and the Kaiser-Meyer-Olkin measure of sample adequacy were used. The number of components was extracted using principal component analysis.

RESULTS

The mean score of the MHS was 158.7 (SD 11.4). The MHS mean score of female participants was significantly higher than the mean score of male participants (159.59, SD 10.21 vs 155.48, SD 14.35; P=.008). The MHS mean score was significantly lower in dental students (154.12, SD 1.45; P=.005) than the mean scores of medical students (159.77, SD 1.02), pharmacy students (161.40, SD 1.05), and preparatory-year students (159.05, SD 1.94). However, no significant relationship was found between humanism and academic year (P=.32), university type (P=.34), marital status (P=.64), or financial situation (P=.16). The Kaiser-Meyer-Olkin test (0.730) and Bartlett test of sphericity (1201.611, df=351; P=.01) were performed. Factor analysis indicated that the proportion of variables between the first and second factors was greater than 10%, confirming that the scale was a single group. The Cronbach α for the overall scale was 0.735, indicating that the scale had acceptable reliability and validity.

CONCLUSIONS

The results of this study suggest that the MHS is a reliable and valid tool for measuring humanity among health professional students and the development of patient-centered care.

A Socioecological Model of Transition to Nursing Practice

A newly licensed nurse's (NLN) transition to practice (TTP) is affected by interactions inside and outside the hospital. The aim of this Delphi study was to create a socioecological model of TTP. Included in the socioecological model are personal characteristics and interactions at the relationship, community, and societal levels that the NLNs feel affects their TTP. This socioecological model can be used to plan TTP programs that address the holistic needs of the NLNs.

Development and validation of the global assessment of the evidence implementation environment [GENIE] tool

BACKGROUND

Overcoming the various barriers to evidence implementation is critical to delivering evidence-based health care. Identifying and managing these obstacles is somewhat challenging however, due to interprofessional and interjurisdictional variations in reported barriers. An efficient, systematic, comprehensive and innovative approach to isolating the barriers to evidence implementation is therefore needed.

MATERIALS AND METHODS

Using a mixed methods design, the study aimed to develop, refine and validate a tool to assess the evidence implementation environment for complementary medicine (CM) professions. The tool was developed using a five-stage process, and refined and validated using a two-round e-Delphi technique.

RESULTS

Informed by reviews examining the barriers and enablers to evidence implementation in CM, and shaped by the Behaviour Change Wheel Framework, a preliminary 33-item tool was created (i.e. the Global Assessment of the Evidence Implementation Environment [GENIE] tool). A two-round Delphi technique was used to refine the criteria, with a panel of 23 experts agreeing to the removal of two criteria, and the addition of two items. In the end, the Delphi panel reached consensus on 33 criteria, which were sorted into nine stakeholder groups.

CONCLUSION

This study has for the first time, created an innovative tool to assess the capacity and capability of CM professions to engage in evidence-based practice at an optimal level. By assessing the evidence implementation environment of CM professions, the GENIE tool is able to determine where resources, infrastructure and personnel should be directed in order to optimise the uptake of evidence-based practices within CM professions.

Drop, Cover, and Hold On versus Fetal Position in the Triangle of Life to Survive in an Earthquake: A Delphi Study

OBJECTIVE

This study aims to determine and compare the effectiveness of Drop, Cover, and Hold On versus Fetal Position in the Triangle of Life regarding reducing casualties during earthquakes and establishing a consensus among medical search and rescue experts.

METHODS

In this study, the data collected from ten experienced medical search and rescue professionals were analyzed using a three-stage Delphi technique to compare Drop, Cover, and Hold On versus Fetal Position in the Triangle of Life.

RESULTS

At the end of the first round of Delphi, all of the experts mentioned the following factors: age, position, and surface area of the injured person. A victim's time under rubble and the experience of search and rescue teams are two prominent factors related to search and rescue. After the earthquake simulation in the second round, mannequin damage rates were examined by opening rubble pavement and tunnels. Following the second round of ratings, a third round of questionnaires was administered. As part of this questionnaire, participants were asked to give a score from one to ten based on their level of agreement. Whether they agreed or disagreed with Fetal Position in the Triangle of Life and Drop, Cover, and Hold On using a ten-point Likert scale, and the agreement rates were measured and compared. Experts completed a comparison of the two positions in the third round.

CONCLUSION

According to this expert consensus, the Fetal Position in the Triangle of Life has the following advantages over Drop, Cover, and Hold On: reduced surface area, less crush injuries, protection of a larger body part from injury, better protection from hypothermia, and better maintenance of basal metabolism.

Unmet needs on the current medical management of Cushing's syndrome: results from a Delphi panel of Italian endocrinologists

BACKGROUND

Cushing's syndrome (CS) is a rare clinical condition caused by excessive cortisol secretion from adrenal glands. CS is associated with increased mortality and morbidity; therefore, a prompt diagnosis and an effective therapeutic approach are strongly necessary to improve the patient's clinical management. The first-line treatment for CS is surgery, while medical treatment has historically played a minor role. However, thanks to the availability of novel compounds, the possibility of improving hypercortisolism control using different drug combinations emerged.

PURPOSE

No absolute recommendations are available to guide the therapeutic choice for patients with CS and, consequently, the awareness of unmet needs in CS management is growing. Although new data from clinical trials are needed to better define the most appropriate management of CS, an expert consensus approach can help define unmet needs and optimize the current CS management and treatment.

METHODS

Twenty-seven endocrinologists from 12 Italian regions, working among the main Italian referral centers for hospital endocrinology where they take care of CS patients, were involved in a consensus process and used the Delphi method to reach an agreement on 24 statements about managing CS patients.

RESULTS

In total, 18 statements reached a consensus. Some relevant unmet needs in the management of CS were reported, mainly related to the lack of a pharmacological treatment successful for the majority of patients.

CONCLUSION

While acknowledging the difficulty in achieving complete disease control, a significant change in CS management requires the availability of medical treatment with improved efficacy and safety over available therapeutic options at the time of the current study.

Component Costs of CAR-T Therapy in Addition to Treatment Acquisition Costs in Patients with Multiple Myeloma

INTRODUCTION

Ciltacabtagene autoleucel (cilta-cel), is a B-cell maturation antigen-directed, genetically modified autologous chimeric antigen receptor T-cell (CAR-T) immunotherapy. It is indicated for treatment for adult patients with relapsed or refractory multiple myeloma (RRMM) after four or more prior lines of therapy, including a proteasome inhibitor, an immunomodulatory agent, and an anti-CD38 monoclonal antibody. The objective of this study was to estimate the per-patient US commercial healthcare costs related to cilta-cel (CARVYKTI^®) CAR-T therapy (i.e., costs separate from cilta-cel therapy acquisition) for patients with RRMM.

METHODS

US prescribing information for cilta-cel, publicly available data, and published literature were used with clinician input to identify the cost components and unit costs associated with administration of cilta-cel. Cost components included apheresis, bridging therapy, conditioning therapy, administration, and postinfusion monitoring for 1 year of follow-up. Adverse event (AE) management costs for all grades of cytokine release syndrome and neurologic toxicities, and additional AEs grade ≥ 3 occurring in > 5% of patients were included in the analysis.

RESULTS

The estimated per-patient average costs of cilta-cel CAR-T therapy administered exclusively in an inpatient setting, excluding cilta-cel therapy acquisition costs, totaled US$160,933 over a 12 month period. Costs assuming different proportions of inpatient/outpatient administration (85%/15% and 70%/30%) were US$158,095 and US$155,257, respectively.

CONCLUSION

Cost estimates from this analysis, which disaggregates CAR-T therapy costs, provide a comprehensive view of the cost components of CAR-T therapy that can help healthcare decision-makers make informed choices regarding the use of cilta-cel. Real-world costs may differ with improved AE prevention and mitigation strategies.

Prerequisites, barriers and opportunities in care for Q-fever patients: a Delphi study among healthcare workers

BACKGROUND

Q-fever is a zoonotic disease that can lead to illness, disability and death. This study aimed to provide insight into the perspectives of healthcare workers (HCWs) on prerequisites, barriers and opportunities in care for Q-fever patients.

METHODS

A two-round online Delphi study was conducted among 94 Dutch HCWs involved in care for Q-fever patients. The questionnaires contained questions on prerequisites for high quality, barriers and facilitators in care, knowledge of Q-fever, and optimization of care. For multiple choice, ranking and Likert scale questions, frequencies were reported, while for rating and numerical questions, the median and interquartile range (IQR) were reported.

RESULTS

The panel rated the care for Q-fever patients at a median score of 6/10 (IQR = 2). Sufficient knowledge of Q-fever among HCWs (36%), financial compensation of care (30%) and recognition of the disease by HCWs (26%) were considered the most important prerequisites for high quality care. A lack of knowledge was identified as the most important barrier (76%) and continuing medical education as the primary method for improving HCWs' knowledge (76%). HCWs rated their own knowledge at a median score of 8/10 (IQR = 1) and the general knowledge of other HCWs at a 5/10 (IQR = 2). According to HCWs, a median of eight healthcare providers (IQR = 4) should be involved in the care for Q-fever fatigue syndrome (QFS) and a median of seven (IQR = 5) in chronic Q-fever care.

CONCLUSIONS

Ten years after the Dutch Q-fever epidemic, HCWs indicate that the long-term care for Q-fever patients leaves much room for improvement. Facilitation of reported prerequisites for high quality care, improved knowledge among HCWs, clearly defined roles and responsibilities, and guidance on how to support patients could possibly improve quality of care. These prerequisites may also improve care for patients with persisting symptoms due to other infectious diseases, such as COVID-19.

Standards for evaluating the quality of undergraduate nursing e-learning programme in low- and middle-income countries: a modified Delphi study

BACKGROUND

The lack of standards for evaluating the quality of undergraduate nursing programmes hampers the evaluation of e-learning programmes in low- and middle-income countries. Fragmented approaches to evaluation coupled with a lack of uniform criteria have been a major deterrent to the growth of e-learning. Adopting standards from high-income countries has contextual challenges in low- and middle-income countries (LMICs). Holistic approaches coupled with uniform standards provide information to stakeholders hence the quality of the programmes is measurable. The e-learning situation in low-and middle-income countries provided an impetus to develop and validate these standards.

DESIGN

A modified Delphi technique.

REVIEW METHODS

Fourteen experts with experience and expertise in e-learning and regulation of undergraduate nursing from fourteen countries from LMICs participated in three rounds of the modified Delphi process. A pre-described set of standards was shared electronically for independent and blinded ratings. An 80% threshold was set for consensus decisions. The standards were modified based on experts' comments, and two subsequent rounds were used to refine the standards and criteria.

RESULTS

At the end of round one, the expert consensus was to keep 67, modify 39 and remove three criteria. At the end of the second round, the consensus was to modify 38 and remove one criteria. In the third round, experts agreed that the standards were feasible, usable, and practical in LMICs. A total of six broad standards with 104 criteria were developed.

CONCLUSION

The Technological bloom permeating all spheres of society, including education is an essential component in the development of e-learning programmes. E-learning in nursing education requires critical evaluation to ensure quality in undergraduate nursing programmes. The intricacies of the Low and middle-income context were taken into consideration in developing the standards to offer sustainable evaluation of the quality of e-learning in LMICs, and local solutions to local problems.

Brazilian society of rheumatology methodological guide for the development of evidence-based clinical guidelines in rheumatology

Clinical practice guidelines (CPG) are developed to align standards of health care around the world, aiming to reduce the incidence of misconducts and enabling more effective use of health resources. Considering the complexity, cost, and time involved in formulating CPG, strategies should be used to facilitate and guide authors through each step of this process. The main objective of this document is to present a methodological guide prepared by the Epidemiology Committee of the Brazilian Society of Rheumatology for the elaboration of CPG in rheumatology. Through an extensive review of the literature, this study compiles the main practical recommendations regarding the following steps of CPG drafting: distribution of working groups, development of the research question, search, identification and selection of relevant studies, evidence synthesis and quality assessment of the body of evidence, the Delphi methodology for consensus achievement, presentation and dissemination of the recommendations, CPG quality assessment and updating. This methodological guide serves as an important tool for rheumatologists to develop reliable and high-quality CPG, standardizing clinical practices worldwide.

Prioritising Climate Change Mitigation Behaviours and Exploring Public Health Co-Benefits: A Delphi Study

Climate change requires urgent action; however, it can be challenging to identify individual-level behaviours that should be prioritised for maximum impact. The study aimed to prioritise climate change mitigation behaviours according to their impacts on climate change and public health, and to identify associated barriers and facilitators-exploring the impact of observed behaviour shifts associated with COVID-19 in the UK. A three-round Delphi study and expert workshop were conducted: An expert panel rated mitigation behaviours impacted by COVID-19 in relation to their importance regarding health impacts and climate change mitigation using a five-point Likert scale. Consensus on the importance of target behaviours was determined by interquartile ranges. In total, seven target behaviours were prioritised: installing double/triple glazing; installing cavity wall insulation; installing solid wall insulation; moving away from meat/emission heavy diets; reducing the number of cars per household; walking shorter journeys; and reducing day/weekend leisure car journeys. Barriers related to the costs associated with performing behaviours and a lack of complementary policy-regulated subsidies. The target behaviours are consistent with recommendations from previous research. To ensure public uptake, interventions should address behavioural facilitators and barriers, dovetail climate change mitigation with health co-benefits and account for the long-term impacts of COVID-19 on these behaviours.

Acid sphingomyelinase deficiency (ASMD): addressing knowledge gaps in unmet needs and patient journey in Italy-a Delphi consensus

Acid sphingomyelinase deficiency (ASMD) is an ultra-rare disease, and several gaps of knowledge on various issues remain, particularly at a regional/national level. Expert opinions collected through well-defined consensus methodologies are increasingly used to make available reliable information in the context of rare/ultra-rare diseases. With the aim to provide indications on infantile neurovisceral ASMD (also formerly known as Niemann-Pick disease type A), chronic neurovisceral ASMD (formerly known as Niemann-Pick disease type A/B) and chronic visceral ASMD (formerly known as Niemann-Pick disease type B) in Italy, we conducted a Delphi consensus of experts focused on five main areas: (i) patients and disease characteristics; (ii) unmet needs and quality of life; (iii) diagnostic issues; (iv) treatment-related aspects; and (v) patient journey. Pre-specified, objective criteria were used to outline the multidisciplinary panel, based on 19 Italian experts in ASMD in paediatric and adult patients from different Italian Regions, including both clinicians (n = 16) and ASMD patients' advocacy or payors with expertise in rare diseases (n = 3). During two Delphi rounds, a high ratio of agreement was found on several topics related to ASMD characteristics, diagnosis, management and disease burden. Our findings may provide valuable indications for management of ASMD at a public health level in Italy.

Argument-based QUalitative Analysis strategy (AQUA) for analyzing free-text responses in health sciences Delphi studies

Delphi methods are mostly used in the health sciences to reach agreement among experts on unclear issues. Generally, consensus is reached after several rounds of Delphi using standardized items. Additional open-ended questions offer respondents the opportunity to provide reasons for judgments. Although these free-text responses contribute substantially to the steering and result generation of the Delphi process, so far no analytical strategy has been established which takes into account the context and methodological principles of the Delphi procedure. Moreover, in already published Delphi studies the analysis of qualitative data is often not sufficiently disclosed.•We provide an overview of analytical strategies for free-text responses. We critically reflect on them with regard to their use and suitability in the context of Delphi procedures.•Following established qualitative methods of qualitative content analysis according to Mayring and thematic analysis according to Braun & Clarke, we developed the Argument-based QUalitative Analysis strategy (AQUA) for Delphi studies in the health sciences and presented it using a concrete project example.•This newly developed strategy can significantly support the rule-governed and intersubjective evaluation of free-text responses in Delphi processes, the integration of the results into the feedback design, and thereby also the quality of the results.

Risk Management Activities in a Lung Cancer Multidisciplinary Team at a Comprehensive Cancer Center: Results of a Prospective Analysis

PURPOSE

The objective of the study was to highlight sources of harm that could negatively affect the lung cancer multidisciplinary team (MDT) activities to reduce the level of risk of each factor.

METHODS

A modified Delphi approach was used by a board of multi-health care professionals of the lung cancer MDT to identify the main processes, subprocesses, and risk factors of the multidisciplinary pathway of patients with lung cancer. A semiquantitative matrix was built with a five-point scale for probability of harm (likelihood) and severity of harm (consequences) according to the international risk management standards (ISO 31000-2018). The risk level was calculated by multiplying likelihood × consequences. Mitigation strategies have been identified and applied by the MDT to reduce risks to acceptable levels.

RESULTS

Three main processes (outpatient specialist visit, MDT discussion, and MDT program implementation), eight related subprocesses, and 16 risk factors were identified. Four risk factors (25%) were related to outpatient specialist visit, seven (43.75%) to case discussion, and five (31.25%) to program implementation. Overall, two risk factors were assigned a low-risk level (12.5%), 11 a moderate-risk level (68.75%), one (6.25%) a high-risk level, and two (12.5%) a very high-risk level. After the implementation of mitigation measures, the new semiquantitative risk analysis showed a reduction in almost all hazardous situations: two risk factors (12.5%) were given a very low level, six (37.5%) a low level, seven (43.75%) a moderate level, and one (6.25%) a very high level.

CONCLUSION

An interdisciplinary risk assessment analysis is applicable to MDT activities by using an ad hoc risk matrix: if the hazard is identified and monitored, the risk could be reduced and managed in a short time.