Experience of Delphi technique in the process of establishing consensus on core competencies

Defining the tasks of clinical reasoning in forensic psychiatric evaluation: Psychomedicolegal analysis competency

Objective

Inconsistency in the quality of forensic psychiatry report has been criticized for several years. Yet, there are limited guidelines to provide minimally satisfactory forensic psychiatry evaluation conducted by psychiatrists. In addition to the impact towards the forensic psychiatry service, this lack of standardized guidelines may impact the relevant competency development and its various teaching methods of forensic psychiatry among general psychiatrists. Therefore, this study aims to identify components of psychomedicolegal analysis competency as a form of clinical reasoning in forensic psychiatry.

Methods

A comprehensive literature review and expert panel discussions were conducted simultaneously to formulate an initial list of psychomedicolegal analysis competency. A total of fourteen experts were chosen based on their expertise in different disciplines that have intersections with forensic psychiatry and the general psychiatry curriculum (e.g. general psychiatrist, forensic psychiatrists and psychologist, law practitioner, and medical education director). The expert panel were instructed to score and provide feedbacks on the items of the initial list. Four-point Likert scale were used in order for the experts to express the relevancy of the core competence to forensic psychiatry practice until it reached the consensus.

Results

The final 60 items of psychomedicolegal analysis competency were developed after three rounds of Delphi technique and reached a consensus (>70% and medians score of at least 3,25). These competency then categorized into four steps 1) preparing the case (Item 1-11), 2) conducting the evaluation (Item 12-41), 3) writing the report (42-51), and 4) giving expert opinion in court (Item 52-60).

Conclusion

We developed 60 items of psychomedicolegal analysis competency that can be used as a standardized guide for psychiatrists to conduct forensic psychiatry evaluation, write the report and provide expert opinion in court. Implementation of this guideline can be used to shape further forensic psychiatry education for general psychiatrist and psychiatry residency.

An overview of public health education in South Asia: Challenges and opportunities

Over the past two decades, there has been an increased demand for Public Health Education (PHE) in South Asia. While this region has a large number of Public Health (PH) institutions, the quality of PHE has not been aligned with the core PH competencies. In this article, we present an overview of Master of Public Health (MPH) programs across South Asian countries. An extensive systematic search on various web search engines regarding PH course offerings was conducted, including specific institute and educational websites. By 2021, more than 180 institutions in South Asia provided an MPH degree. Most of these institutions/universities were found in India, Pakistan, and Bangladesh, and a few among these institutions were established as independent Schools of Public Health (SPH), separate from medical colleges, and had a multidisciplinary faculty. But, dedicated training facilities in the specialized field of public health were not found in most of these institutions. Generally, a well-defined MPH curriculum is not currently available except in India where the University Grants Commission (UGC) guideline for a model MPH curriculum has been proposed by the Ministry of Health and Family Welfare. The entry criteria for an MPH degree in India is accepting students in multidisciplinary fields, while in other South Asian countries this is primarily restricted to medical/paramedical students with a basic understanding of preventive medicine. The aim of this review was to document the current and future PHE opportunities and challenges in South Asia.

From clinical expert nurse to part-time clinical nursing instructor: design and evaluation of a competency-based curriculum with structured mentoring: a mixed methods study

BACKGROUND

Transition from a clinical expert nurse to a  part time clinical nursing instructor (PTCNI) poses several challenges. Designing a professional development curriculum to facilitate the transition from a clinical expert nurse to a  PTCNI is critical to effective education. A comprehensive competency-based curriculum was developed and implemented with structured mentoring to prepare clinical expert nurses as PTCNIs.

METHODS

A mixed-methods study with a sequential-exploratory approach was conducted in Iran in 2019. In the qualitative phase, Saylor et al.'s (1981) seven-step model was used, consisting of (1) collecting evidence from a systematic review, (2) conducting interviews with learners, (3) setting goals and objectives, (4) design, (5) implementation, (6) evaluation, and (7) feedback. In the quantitative phase, curriculum domains were evaluated. Additionally, the effective professional communication skills module was implemented using a quasi-experimental study with a pre-test post-test single-group design for 5 PTCNIs in a pilot study.

RESULTS

After integrating the findings of the literature review and field interviews in the analysis stage, a curriculum was developed with a total of 150 h, six modules, and 24 topics. Results of the pilot study showed a significant improvement in the confidence of PTCNIs as a result of the implementation of the effective communication skills module using the mentoring method (t = - 16.554, p = 0.0005).

CONCLUSIONS

This competency-based curriculum was based on the evidence and needs of PTCNIs and provides a complete coverage of their clinical education competencies. It is suggested that managers of educational institutes that offer nursing programs use this curriculum to prepare them in continuing education programs. Further studies are needed to thoroughly evaluate the learning outcomes for students.

Expert perspectives on the active role of patients in their safety: Toward a framework using Delphi methodology

AIMS

To develop a framework for Patient Engagement in Patient Safety (PEPS) in hospital.

METHODS

The Delphi technique was embraced to involve a group of knowledgeable healthcare experts in the discussion and rating of the components of the PEPS framework. On a 5-point Likert scale, every item was separately rated based on the three aspects, which include applicability, clarity and validity. The PEPS framework included items with 75% or more of participants scoring 4-5 on all three aspects. Items not attaining 75% agreement on the aspects were either changed or discarded, after the group discussion and underwent another round of rerating.

RESULTS

A total of 17 members participated in the consensus-building process. Following two rounds of rating, the consensus was reached on the final framework which consisted of 28 items in four dimensions, relating to healthcare professionals, patients, community, and helth system, and three components substituted with patient empowerment, effective communication and patient-centeredness.

CONCLUSION

The development of PEPS framework is a stimulus to strengthen human resources for health capabilities, sustain a high level of quality patient outcomes, and improve the health system. Further studies to identify strategies are needed for the successful implementation of this framework.

Identifying core competencies for practicing public health professionals: results from a Delphi exercise in Uttar Pradesh, India

BACKGROUND

Ensuring the current public health workforce has appropriate competencies to fulfill essential public health functions is challenging in many low- and middle-income countries. The absence of an agreed set of core competencies to provide a basis for developing and assessing knowledge, skills, abilities, and attitudes contributes to this challenge. This study aims to identify the requisite core competencies for practicing health professionals in mid-level supervisory and program management roles to effectively perform their public health responsibilities in the resource-poor setting of Uttar Pradesh (UP), India.

METHODS

We used a multi-step, interactive Delphi technique to develop an agreed set of public health competencies. A narrative review of core competency frameworks and key informant interviews with human resources for health experts in India were conducted to prepare an initial list of 40 competency statements in eight domains. We then organized a day-long workshop with 22 Indian public health experts and government officials, who added to and modified the initial list. A revised list of 54 competency statements was rated on a 5-point Likert scale. Aggregate statement scores were shared with the participants, who discussed the findings. Finally, the revised list was returned to participants for an additional round of ratings. The Wilcoxon matched-pairs signed-rank test was used to identify stability between steps, and consensus was defined using the percent agreement criterion.

RESULTS

Stability between the first and second Delphi scoring steps was reached in 46 of the 54 statements. By the end of the second Delphi scoring step, consensus was reached on 48 competency statements across eight domains: public health sciences, assessment and analysis, policy and program management, financial management and budgeting, partnerships and collaboration, social and cultural determinants, communication, and leadership.

CONCLUSIONS

This study produced a consensus set of core competencies and domains in public health that can be used to assess competencies of public health professionals and revise or develop new training programs to address desired competencies. Findings can also be used to support workforce development by informing competency-based job descriptions for recruitment and performance management in the Indian context, and potentially can be adapted for use in resource-poor settings globally.

Development of a national medical leadership competency framework: the Dutch approach

BACKGROUND

The concept of medical leadership (ML) can enhance physicians' inclusion in efforts for higher quality healthcare. Despite ML's spiking popularity, only a few countries have built a national taxonomy to facilitate ML competency education and training. In this paper we discuss the development of the Dutch ML competency framework with two objectives: to account for the framework's making and to complement to known approaches of developing such frameworks.

METHODS

We designed a research approach and analyzed data from multiple sources based on Grounded Theory. Facilitated by the Royal Dutch Medical Association, a group of 14 volunteer researchers met over a period of 2.5 years to perform: 1) literature review; 2) individual interviews; 3) focus groups; 4) online surveys; 5) international framework comparison; and 6) comprehensive data synthesis.

RESULTS

The developmental processes that led to the framework provided a taxonomic depiction of ML in Dutch perspective. It can be seen as a canonical 'knowledge artefact' created by a community of practice and comprises of a contemporary definition of ML and 12 domains, each entailing four distinct ML competencies.

CONCLUSIONS

This paper demonstrates how a new language for ML can be created in a healthcare system. The success of our approach to capture insights, expectations and demands relating leadership by Dutch physicians depended on close involvement of the Dutch national medical associations and a nationally active community of practice; voluntary work of diverse researchers and medical practitioners and an appropriate research design that used multiple methods and strategies to circumvent reverberation of established opinions and conventionalisms.

IMPLICATIONS

The experiences reported here may provide inspiration and guidance for those anticipating similar work in other countries to develop a tailored approach to create a ML framework.

Competency framework for specialist critical care nurses: A modified Delphi study

BACKGROUND

The specialist critical care nurse plays a vital role in the delivery of evidence-based practice, and specific competency guidance has been established to facilitate critical care nursing practice and education development in many developed countries. However, no research has been conducted to develop a competency framework for specialist critical care nurses in China.

AIMS AND OBJECTIVES

To construct a competency framework specific to specialist critical care nurses in China.

DESIGN AND METHODS

A two-phased procedure was implemented. In phase 1, a literature review and four focus groups were used to develop the initial competency framework, which consisted of 101 statements. During phase 2, three rounds of a modified Delphi process were conducted and involved a national panel of 30 experts, including physicians, specialist critical care nurses, managers, and educators, who responded to the survey using a 5-point Likert-type scale to indicate their level of agreement with the competency framework. A 75% threshold for each competency was used to achieve panel consensus.

RESULTS

Experts in the field of critical care responded to rounds 1 (n = 29), 2 (n = 28), and 3 (n = 28). Seventy-eight competencies were agreed upon after round 1, increasing to 88 after round 2 and 92 after round 3. The final competency framework was classified into six domains: evidence-based practice, complex decisions, professionalism, communication and co-operation, education and development, and leadership.

CONCLUSION

The output of this study is an expert consensus competency framework that provides a sound foundation for the assessment and training of specialist critical care nurses.

RELEVANCE TO CLINICAL PRACTICE

The proposed competency framework should be used to assess nursing performance, promote continuing professional development, and further improve the delivery of quality health care and optimal patient outcomes.

Developing a clinical trial governance framework for pharmaceutical industry-funded clinical trials

Rising concerns relating to pharmaceutical sponsor bias in the conduct of clinical trials have compelled the need to develop a clinical trial governance framework. This article describes the development of the Conflict of Interest in Research (COIR), a clinical trial governance framework. The COIR, consisting of three process phases (initiation, concurrent, and ongoing), developed following a needs assessment, using a four-stage methodology, and evaluated against the International Conference on Harmonization--Good Clinical Practice (ICH-GCP) guidelines. The Conflict of Interest Resolution algorithm, the backbone of COIR, enables constant surveillance to detect/resolve conflicts at all stages of the clinical trial life-cycle. COIR promotes interaction between the regulatory system and the sponsors, independent of individuals. COIR enables rapid detection of scientific and financial conflicts, to prevent subject harm and, to assure optimal funds utilization, the latter feature helped to reduce a significant burden for the ethics committee, as it lacks financial expertise. COIR is a semi-automated Oracle system, requires manpower, and is affected by human expertise and subjectivity. Complete automation to overcome this limitation will still need human expertise to scale changing trial regulations. Nevertheless, the COIR has won the distinction of the "most favored site" from pharmaceutical sponsors and is anticipated to be adopted by other clinical trial sites.

Establishment of a Quantitative Medical Technology Evaluation System and Indicators within Medical Institutions

Background:

The development and application of medical technologies reflect the medical quality and clinical capacity of a hospital. It is also an effective approach in upgrading medical service and core competitiveness among medical institutions. This study aimed to build a quantitative medical technology evaluation system through questionnaire survey within medical institutions to perform an assessment to medical technologies more objectively and accurately, and promote the management of medical quality technologies and ensure the medical safety of various operations among the hospitals.

Methods:

A two-leveled quantitative medical technology evaluation system was built through a two-round questionnaire survey of chosen experts. The Delphi method was applied in identifying the structure of evaluation system and indicators. The judgment of the experts on the indicators was adopted in building the matrix so that the weight coefficient and maximum eigenvalue (λ max), consistency index (CI), and random consistency ratio (CR) could be obtained and collected. The results were verified through consistency tests, and the index weight coefficient of each indicator was conducted and calculated through analytical hierarchy process.

Results:

Twenty-six experts of different medical fields were involved in the questionnaire survey, 25 of whom successfully responded to the two-round research. Altogether, 4 primary indicators (safety, effectiveness, innovativeness, and benefits), as well as 13 secondary indicators, were included in the evaluation system. The matrix is built to conduct the λ max, CI, and CR of each expert in the survey, and the index weight coefficients of primary indicators were 0.33, 0.28, 0.27, and 0.12, respectively, and the index weight coefficients of secondary indicators were conducted and calculated accordingly.

Conclusions:

As the two-round questionnaire survey of experts and statistical analysis were performed and credibility of the results was verified through consistency evaluation test, the study established a quantitative medical technology evaluation system model and assessment indicators within medical institutions based on the Delphi method and analytical hierarchy process. Moreover, further verifications, adjustments, and optimizations of the system and indicators will be performed in follow-up studies.

Entry-to-practice public health nursing competencies: A Delphi method and knowledge translation strategy

BACKGROUND

Sustaining and strengthening nurses 'contributions to public and population health in the 21st century depends in part on nursing education. Clearly articulated entry-to-practice competencies will contribute to the capacity of undergraduate nursing education programs to prepare graduates to promote local, national and global population health.

OBJECTIVES

The Canadian Association of Schools of Nursing created the Public Health Task Force to develop consensus on core, national entry-to-practice competencies in public health nursing for undergraduate nursing students and to support these competencies with corresponding online teaching strategies.

DESIGN

Delphi approach.

PARTICIPANTS

Nurses with public health experience in education and practice, and representatives from other public health professional organizations across Canada.

METHOD

The three-phased competency development included: 1) an environmental scan; 2) an iterative process to draft competencies; and 3) a modified Delphi process to confirm the final competency framework using face to face consultations and a survey. The knowledge translation strategy involved soliciting submissions of teaching strategies for peer-review and subsequent inclusion in an interactive online resource.

RESULTS

242 public health educators and practitioners participated in the consensus consultation. The final document outlined five competency statements with 19 accompanying indicators. A total of 123 teaching strategies were submitted for the online resource, of which 50 were accepted as exemplary teaching strategies.

CONCLUSION

This competency development process can provide guidance for the development of competencies in other countries, thus strengthening public health nursing education globally. The decision to intentionally level the competencies to entry-to-practice, as opposed to an advanced level, enhanced their application to undergraduate nursing education. The development of the additional inventory of teaching strategies created a sustainable innovative resource for public health nursing educators and practitioners world-wide to support the adoption of entry-to-practice public health nursing competencies.