A Delphi Technology Foresight Study: Mapping Social Construction of Scientific Evidence on Metagenomics Tests for Water Safety

A Modified Delphi Study to Establish Essential Clinical Pharmacology Competencies

INTRODUCTION

Competency-based education has been commonly used to enhance the healthcare workforce for some time. A translational discipline that is integral to drug development and impactful on healthcare and public health is clinical pharmacology. With such contribution, it is essential that the clinical pharmacology workforce is adequately equipped to address the demands of emerging trends of drug development.

OBJECTIVES

The primary objective of this study was to determine the most significant competencies needed for a clinical pharmacologist in the regulatory environment.

METHODS

A two round modified Delphi technique was administered to 29 clinical pharmacologists within the Office of Clinical Pharmacology (OCP) between November 2021-January 2022. A questionnaire consisting of core and technical competencies was administered electronically using SurveyMonkey ® to gain consensus about essential clinical pharmacology competencies. Participants used a Likert scale to rank importance of competencies from strongly agree (1), agree (2), neutral (3), disagree (4), strongly disagree (5). Participants also suggested topics to be included in the next round. Consensus was set at 60%. The competencies receiving the most consensus at 60% in round one and the new topics proceeded to the second round. In the second and final round, participants ranked the suggested competencies. Descriptive statistics and a McNemar change test were utilized to analyze data. Only data from the participants who completed both rounds was used in the study.

RESULTS

In round one participants ranked all fifty-six core and technical competencies as essential with consensus of at least 60%. In round two, participants ranked sixty-two competencies as essential with consensus of at least 60%. A McNemar change test demonstrated stability of ranking between rounds.

CONCLUSION

Essential core and technical competencies can build education programs to sustain the emerging clinical pharmacology workforce in the Office of Clinical Pharmacology. The Delphi technique is a suitable approach to determine essential competencies because it cultivates consensus and gains insight from experts in the forefront of drug development.

A literature review on digital content management: trends and future challenges

Purpose

The purpose of this study is to review the literature on digital content management (DCM) published between 2001 and 2021, as well as to provide insights and research directions for the future.

Design/methodology/approach

This study followed the systematic literature review framework PRISMA for reviewing existing literature on DCM. The PRISMA checklist helps the researcher in refining the reporting of the review paper. Data was collected from Scopus and Web of Science (WoS) databases. A total of 136 documents were selected for analysis from Scopus and WoS.

Findings

Based on current papers, this study attempted to discuss some key DCM trends and themes. Seven themes have been identified in the literature: virtual reality and its implications on DCM; personal DCM; microservices based DCM; model for DCM; DCM using Bluetooth Low Emergency technology; DCM software; and DCM codification. This study identifies influential authors, top contributing countries, top contributing institutions, most cited papers, most common title words and contributions by fields.

Originality/value

The findings of this study, as well as future research projects, open the path for more research and contributions to the field.

Strategic Priorities for Implementation of Father-Inclusive Practice in Mental Health Services for Children and Families: A Delphi Expert Consensus Study

The aim of this study was to investigate expert consensus on barriers and facilitators to the organizational implementation of Father-Inclusive Practice (FIP) in child and family services to establish strategic priorities for implementation. An international panel of 56 experts in child and family service provision and father inclusion were surveyed using the Delphi technique. Three online questionnaires were used to gather opinions and measure experts’ levels of agreement in regard to factors that enable or hinder the organizational implementation of FIP. Survey design, analysis and interpretation was guided by the Consolidated Framework for Implementation Research (CFIR). Consensus was achieved for 46.4% (n = 13) statements. Eight barriers and five facilitators were identified as strategic priorities to organizational implementation of FIP. The key factors were related to the following CFIR themes: leadership engagement, access to information and knowledge, implementation climate, structural characteristics, networks and communication, client needs and resources, external policies and incentives, and reflecting and evaluating. The study findings suggest that issues related to central prioritization, top-down organizational processes and external policy context should represent priority areas for implementation. Our results prioritise methods for improving FIP by highlighting the key areas of organizational practice to be addressed by tailored implementation strategies.

Next generation sequencing approaches to evaluate water and wastewater quality

The emergence of next generation sequencing (NGS) is revolutionizing the potential to address complex microbiological challenges in the water industry. NGS technologies can provide holistic insight into microbial communities and their functional capacities in water and wastewater systems, thus eliminating the need to develop a new assay for each target organism or gene. However, several barriers have hampered wide-scale adoption of NGS by the water industry, including cost, need for specialized expertise and equipment, challenges with data analysis and interpretation, lack of standardized methods, and the rapid pace of development of new technologies. In this critical review, we provide an overview of the current state of the science of NGS technologies as they apply to water, wastewater, and recycled water. In addition, a systematic literature review was conducted in which we identified over 600 peer-reviewed journal articles on this topic and summarized their contributions to six key areas relevant to the water and wastewater fields: taxonomic classification and pathogen detection, functional and catabolic gene characterization, antimicrobial resistance (AMR) profiling, bacterial toxicity characterization, Cyanobacteria and harmful algal bloom identification, and virus characterization. For each application, we have presented key trends, noteworthy advancements, and proposed future directions. Finally, key needs to advance NGS technologies for broader application in water and wastewater fields are assessed.

Co-production and Managing Uncertainty in Health Research Regulation: A Delphi Study

European and international regulation of human health research is typified by a morass of interconnecting laws, diverse and divergent ethical frameworks, and national and transnational standards. There is also a tendency for legislators to regulate in silos—that is, in discrete fields of scientific activity without due regard to the need to make new knowledge as generalisable as possible. There are myriad challenges for the stakeholders—researchers and regulators alike—who attempt to navigate these landscapes. This Delphi study was undertaken in order to provide the first interdisciplinary and crosscutting analysis of health research regulation, as it is experienced by such stakeholders in the UK context. As well as reinforcing existing understandings of the regulatory environment, Delphi participants called for greater collaboration, and even co-production, of processes involved in health research regulation. On the basis of this research, we offer insights about how health research regulation can become a matter with which a wider range of stakeholders—including researchers, regulators, publics and research sponsors—can engage. The evidence supports the normative claim that health research regulation should continue to move away from strict, prescriptive rules-based approaches, and towards flexible principle-based regimes that allow researchers, regulators and publics to co-produce regulatory systems serving core principles. By unpacking thorny concepts and practices at the heart of health research regulation—including the public interest and public engagement—our results have the potential to situate and breathe life into them. The results also demonstrate that while proportionality is well-recognised as a crucial element of flexible regulatory systems, more must be done to operationalise this as an ethical assessment of the values and risks at stake at multiple junctures in the research trajectory. This is required if we are to move beyond proportionality as a mere risk-management tool. Compliance culture no longer accurately reflects the needs and expectations of researchers or regulators, nor does it necessarily produce the best research. Embracing uncertainty—both as a human practice and a regulatory objective—may represent the brighter future for health research.

Scanning the horizon: a systematic literature review of methodologies

OBJECTIVES

Society is confronted with the rapid emergence of innovation in science and technology. To manage this, horizon scanning is being adopted globally to identify, assess and prioritise innovations and trends at an early stage of their development. This enables decision-makers to be better informed and to prepare for change. The aim of this paper is to systematically identify and evaluate horizon scanning methodologies employed in the healthcare and biomedical fields.

METHODS

A systematic literature review was performed using PubMed and Embase and was supplemented with grey literature searches (2008-2018). The principal methodologies used in horizon scanning were extracted.

RESULTS

Approximately 100 articles were summarised in a literature map. The search revealed many examples of horizon scanning across disciplines. Challenges, such as the need to refine prioritisation criteria, manage uncertainty inherent in the findings and improve the dissemination of identified issues, have been highlighted.

CONCLUSION

Horizon scanning, when performed appropriately, is a flexible and potentially reliable tool, with a wide variety of methods. Horizon scanning can inform and influence decision-making, through identifying opportunities and challenges, from an organisational to an international level. Further research to identify the most effective methodologies available would add depth to this landscape and enable the evolution of best practice to most efficiently anticipate novel developments and innovations.

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

OBJECTIVE

This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea.

METHOD

A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted.

RESULTS

The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care.

CONCLUSIONS

The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events.

Towards a genomics-informed, real-time, global pathogen surveillance system

The recent Ebola and Zika epidemics demonstrate the need for the continuous surveillance, rapid diagnosis and real-time tracking of emerging infectious diseases. Fast, affordable sequencing of pathogen genomes - now a staple of the public health microbiology laboratory in well-resourced settings - can affect each of these areas. Coupling genomic diagnostics and epidemiology to innovative digital disease detection platforms raises the possibility of an open, global, digital pathogen surveillance system. When informed by a One Health approach, in which human, animal and environmental health are considered together, such a genomics-based system has profound potential to improve public health in settings lacking robust laboratory capacity.

Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.

An Appeal to the Global Health Community for a Tripartite Innovation: An "Essential Diagnostics List," "Health in All Policies," and "See-Through 21(st) Century Science and Ethics"

Diagnostics spanning a wide range of new biotechnologies, including proteomics, metabolomics, and nanotechnology, are emerging as companion tests to innovative medicines. In this Opinion, we present the rationale for promulgating an "Essential Diagnostics List." Additionally, we explain the ways in which adopting a vision for "Health in All Policies" could link essential diagnostics with robust and timely societal outcomes such as sustainable development, human rights, gender parity, and alleviation of poverty. We do so in three ways. First, we propose the need for a new, "see through" taxonomy for knowledge-based innovation as we transition from the material industries (e.g., textiles, plastic, cement, glass) dominant in the 20(th) century to the anticipated knowledge industry of the 21st century. If knowledge is the currency of the present century, then it is sensible to adopt an approach that thoroughly examines scientific knowledge, starting with the production aims, methods, quality, distribution, access, and the ends it purports to serve. Second, we explain that this knowledge trajectory focus on innovation is crucial and applicable across all sectors, including public, private, or public-private partnerships, as it underscores the fact that scientific knowledge is a co-product of technology, human values, and social systems. By making the value systems embedded in scientific design and knowledge co-production transparent, we all stand to benefit from sustainable and transparent science. Third, we appeal to the global health community to consider the necessary qualities of good governance for 21st century organizations that will embark on developing essential diagnostics. These have importance not only for science and knowledge-based innovation, but also for the ways in which we can build open, healthy, and peaceful civil societies today and for future generations.