Responsible Epidemiologic Research Practice: a guideline developed by a working group of the Netherlands Epidemiological Society

Exploring the dimensions of responsible research systems and cultures: a scoping review

The responsible conduct of research is foundational to the production of valid and trustworthy research. Despite this, our grasp of what dimensions responsible conduct of research (RCR) might contain-and how it differs across disciplines (i.e. how it is conceptualized and operationalized)-is tenuous. Moreover, many initiatives related to developing and maintaining RCR are developed within disciplinary and institutional silos which naturally limits the benefits that RCR practice can have. To this end, we are working to develop a better understanding of how RCR is conceived and realized, both across disciplines and across institutions in Europe. The first step in doing this is to scope existing knowledge on the topic, of which this scoping review is a part. We searched several electronic databases for relevant published and grey literature. An initial sample of 715 articles was identified, with 75 articles included in the final sample for qualitative analysis. We find several dimensions of RCR that are underemphasized or are excluded from the well-established World Conferences on Research Integrity (WCRI) Singapore Statement on Research Integrity and explore facets of these dimensions that find special relevance in a range of research disciplines.

A step towards harmonising human biomonitoring study setup on European level: Materials provided and lessons learnt in HBM4EU

Internal exposure of the human body to potentially harmful chemical substances can be assessed by Human Biomonitoring (HBM). HBM can be used to generate conclusive data that may provide an overview of exposure levels in entire or specific population groups. This knowledge can promote the understanding of potential risks of the substances of interest or help monitoring the success of regulatory measures taken on the political level. Study planning and design are key elements of any epidemiologic study to generate reliable data. In the field of HBM, this has been done using differing approaches on various levels of population coverage so far. Comparison and combined usage of the resulting data would contribute to understanding exposure and its factors on a larger scale, however, the differences between studies make this a challenging and somewhat limited endeavour. This article presents templates for documents that are required to set up an HBM study, thus facilitating the generation of harmonised HBM data as a step towards standardisation of HBM in Europe. They are designed to be modular and adaptable to the specific needs of a single study while emphasising minimum requirements to ensure comparability. It further elaborates on the challenges encountered during the process of creating these documents during the runtime of the European Joint Programme HBM4EU in a multi-national expert team and draws up lessons learnt in the context of knowledge management.

A scoping review finds that guides to authors of protocols for observational epidemiological studies varied highly in format and content

OBJECTIVE

To identify, characterize, and explore author guides on the role, format, and content of protocols for observational epidemiological studies, particularly cohort and case-control studies.

STUDY DESIGN AND SETTING

Scoping review. We searched for guides in Medline, Embase, Google Scholar, 10 general medical and epidemiological/public health journals, and 10 major funders' websites. Two review authors extracted data. We classified guides as "main" based on word count and number of protocol items, described such guides more comprehensively and analyzed number of citations as an indicator of uptake.

RESULTS

Thirty-nine protocol guides were included intended for cohort studies (n = 3), case-control studies (n = 1), or epidemiological studies in general (n = 35). Content and format were highly variable. Several guides had a broader focus than protocol development, e.g., also including study conduct and reporting. The guideline developmental process was often reported sparsely. One guide, intended for interventional studies, combined a systematic preparatory process with a primary focus on protocol development. We categorized seven guides as 'main'. In general the guides were cited infrequently, indicating limited uptake.

CONCLUSION

Guides for authors of protocols for observational epidemiological studies varied highly in format and content. We suggest that such guides should routinely be based on a systematic preparatory process.

Knowledge, Perceptions and Reporting Practices of Theoretical Design in Causal Observational Epidemiological Studies on the Role of Antibiotic Use in the Occurrence of Asthma in Children

Good research is driven by study design encompassing theoretical design, design of data collection and design of data processing. In epidemiological research, theoretical design is based on a functional relationship between the occurrence and determinants studied (occurrence function) and should also define that part of the theoretical population and the context to which the results pertain (domain). Both are essential for the design of data collection, the design of data processing and the interpretation of the study results and should be explicitly reported. In order to gain insight into the role of theoretical design in the entire research process before publication, it was decided to informally question the corresponding authors of a selection of 30 articles (20 most recent and 10 less recent) reporting on causal observational epidemiological studies on asthma and early life exposure to antibiotics. The objective was to appraise the perceived knowledgeability of theoretical design among the authors of the selected articles. Fifteen authors responded. Authors were asked to indicate their knowledgeability with the concepts of theoretical design, causal theory, confounding and effect modification on a 5-level Likert scale. Other questions were related to the theoretical design of their study. The vast majority of the authors perceived themselves to be moderately to extremely knowledgeable with confounding and effect modification. Perceived knowledgeability of theoretical design and causal theory was more diverse. When provided with options for an occurrence function, almost all authors indicated "current occurrence as a function of past exposure" for their study. Nevertheless, half of these authors conducted their study based on "future occurrence as a function of current exposure". Even though the authors perceive themselves to be knowledgeable with theoretical design, this is not reflected in their articles. Theoretical design should be well known, implemented and explicitly reported.

Considerations towards the better integration of epidemiology into quantitative risk assessment

Environmental epidemiology has proven critical to study various associations between environmental exposures and adverse human health effects. However, there is a perception that it often does not sufficiently inform quantitative risk assessment. To help address this concern, in 2017, the Health and Environmental Sciences Institute initiated a project engaging the epidemiology, exposure science, and risk assessment communities with tripartite representation from government agencies, industry, and academia, in a dialogue on the use of environmental epidemiology for quantitative risk assessment and public health decision making. As part of this project, four meetings attended by experts in epidemiology, exposure science, toxicology, statistics, and risk assessment, as well as one additional meeting engaging funding agencies, were organized to explore incentives and barriers to realizing the full potential of epidemiological data in quantitative risk assessment. A set of questions was shared with workshop participants prior to the meetings, and two case studies were used to support the discussion. Five key ideas emerged from these meetings as areas of desired improvement to ensure that human data can more consistently become an integral part of quantitative risk assessment: 1) reducing confirmation and publication bias, 2) increasing communication with funding agencies to raise awareness of research needs, 3) developing alternative funding channels targeted to support quantitative risk assessment, 4) making data available for reuse and analysis, and 5) developing cross-disciplinary and cross-sectoral interactions, collaborations, and training. We explored and integrated these themes into a roadmap illustrating the need for a multi-stakeholder effort to ensure that epidemiological data can fully contribute to the quantitative evaluation of human health risks, and to build confidence in a reliable decision-making process that leverages the totality of scientific evidence.

Geoprivacy in Neighbourhoods and Health Research: A Mini-Review of the Challenges and Best Practices in Epidemiological Studies

Neighbourhood and health research often relies on personal location data (e.g., home address, daily itineraries), despite the risks of geoprivacy breaches. Thus, geoprivacy is an important emerging topic, contemplated in international regulations such as the General Data Protection Regulation. In this mini-review, we briefly assess the potential risks associated with the usage of personal location data and provide geoprivacy-preserving recommendations to be considered in epidemiological research. Risks include inference of personal information that the individual does not wish to disclose, reverse-identification and security breaches. Various measures should be implemented at different stages of a project (pre-data collection, data processing, data analysis/publication and data sharing) such as informed consent, pseudo-anonymization and geographical methods.

Parents' Willingness to Invest in Primary Oral Health Prevention for Their Preschool Children

There is growing evidence for the beneficial effects of starting oral health prevention early in life. Preventing dental caries in very young children requires considerable investment from parents. Therefore, this cross-sectional study aimed to explore parents' willingness to pay (WTP) and willingness to invest in time (WTIT) for primary oral health prevention in preschool children and describe whether these are related to the parents' demographic, socio-economic and behavioural characteristics. In a convenience sample of parents of preschool children aged six months to four years (n = 142), data were collected with questionnaires. On average, parents were willing to pay EUR15.84 per month, invest time for 1.9 dental visits per year, and spend 2.4 min per day brushing their child's teeth. A higher education level of the mother and having a child older than two were associated with a higher WTIT in brushing minutes per day (p = 0.03). In addition, parents who brushed their child's teeth more frequently were also more willing to invest in brushing minutes (p < 0.01) and money (p < 0.01). Findings emphasise the importance of early oral health interventions and the need to increase awareness of primary prevention's importance in maintaining healthy teeth and reducing possibly oral health inequalities.

Reporting of "Theoretical Design" in Explanatory Research: A Critical Appraisal of Research on Early Life Exposure to Antibiotics and the Occurrence of Asthma

“Theoretical design” comprises the development of an occurrence relation and the specification of the study domain. In explanatory research, the occurrence relation causally relates one determinant to the occurrence (of an event or a state) taking into account other relevant characteristics (confounders and modifiers). Conflicting results in explanatory research might be (partially) explained by differences in the “theoretical design” or by a mismatch between the “theoretical design” and the “design of data collection”. In this critical review, the reporting of “theoretical design” is assessed in articles on the association between early life antibiotic use and the occurrence of asthma. Articles investigating a relationship between early life antibiotic use and the occurrence of asthma were searched in PubMed and systematically selected for critical review. The full text was read and important elements of study design were extracted (the research question/hypothesis, seven key elements of “theoretical design” (measure of occurrence, case (event or state) definition, conceptualization (and operationalization) of the exposure, temporal relation between outcome and exposure, confounders and effect modifiers taken into account and the domain of the study), the method of data collection and the method of data processing). A comparison was made between articles published before and after the publication of the “Strengthening the Reporting of Observational Studies in Epidemiology” (STROBE) statement (2007). Sixty-three articles were included for review. Thirteen articles reported the seven key elements of “theoretical design” that were questioned. No marked differences in reporting were observed pre- and post-STROBE. All articles reported some key elements of “theoretical design”; however, the reporting is not structured and not linked to the concept of “theoretical design”. Conceptualizing, delineating and explicit reporting of “theoretical design” is quintessential for the quality and transparency of explanatory research.

Whatever can go wrong, need not go wrong: Open Quality approach for epidemiology

Quality assurance is one of the most important aspects of an epidemiological study, as its validity is largely determined by data quality. The mounting success of quality management in the industrial sector caused a rapid spread throughout manufacturing industries and beyond. Yet, little has been published so far on quality assurance in epidemiology. In this article we review three models for quality assurance (Juran, Donabedian and ISO 9000) and showcase how these can be brought together in one intuitive, systematic and flexible approach to quality assurance in epidemiology. The resulting Open Quality approach refers back to the three processes identified by Juran (planning, control and verification). During the planning stage, we propose a subdivision of the study process in a set of steps and a definition of quality attributes corresponding to activities in that step as suggested by the ISO approach. We refer to the Donabedian model to determine the level at which the control/monitoring should take place-structure, processes or outcomes. Along with an overview of the Open Quality approach we propose an Open Quality tool to support the definition of quality attributes, failure modes, preventive strategies, verification activities, and corrective actions, which form the backbone of the Open Quality approach.

Participants' Comprehension of the Informed Consent in an Epidemiological Study on Dementia Prevalence: A Qualitative Study

Aim: In the absence of an effective treatment, informed participation in dementia research can hardly be underestimated. However, although informed consent is key in biomedical research, it may become a barrier to participation. Whether informed consent may cause confusion and contribute to unfair participant selection in dementia research is not known. In preparation of a future epidemiological study on the prevalence and impact of dementia in Switzerland, we aimed to conduct a qualitative study to explore participants' comprehension of the purpose of informed consent form and process shortly after participation in the pilot and validation study that preceded the large scale survey. Methods: We conducted a qualitative study with 22 participants of the validation phase of an epidemiological study on the prevalence and impact of dementia in Switzerland to capture their understanding of both the nature and the content of the informed consent form and process. Participants were older adults (65 years or more) eligible for a dementia epidemiological study and their informant (a person who could provide information on their health and cognition). None of the participants reported to be suffering from dementia at the time of the interview. Results: We found that participants held inaccurate and potentially trust-threatening beliefs regarding the scope of the informed consent. Participants identified contradictory contextual, formal and content needs that are difficult to be fulfilled, and misperceived the clinical and research settings in terms of informed consent procedures. Conclusions: Participants and their proxies should be informed about both the scope of the informed consent process, and the content of the informed consent document in a focused, age-appropriate manner, while dispelling confusion about the purpose of research.

Frameworks for evaluation and integration of data in regulatory evaluations: The need for excellence in regulatory toxicology

Following a number of published expressions of concern about the reliability of experimental science and the implications of non-reproducibility for regulatory toxicology, the European Risk Forum undertook to consider what practises might improve the basis on which regulatory decisions might be made. Guidelines which may be useful in assessments are presented. The document acknowledges the value of the experimental standards used in most regulatory studies but indicates how these may fail to provide the ‘best outcome’ and how imperfect studies based on outdated views of pathophysiology of disease in H. Sapiens may offer little of predictive value.

Bridging research integrity and global health epidemiology (BRIDGE) statement: guidelines for good epidemiological practice

BACKGROUND

Research integrity and research fairness have gained considerable momentum in the past decade and have direct implications for global health epidemiology. Research integrity and research fairness principles should be equally nurtured to produce high-quality impactful research-but bridging the two can lead to practical and ethical dilemmas. In order to provide practical guidance to researchers and epidemiologist, we set out to develop good epidemiological practice guidelines specifically for global health epidemiology, targeted at stakeholders involved in the commissioning, conduct, appraisal and publication of global health research.

METHODS

We developed preliminary guidelines based on targeted online searches on existing best practices for epidemiological studies and sought to align these with key elements of global health research and research fairness. We validated these guidelines through a Delphi consultation study, to reach a consensus among a wide representation of stakeholders.

RESULTS

A total of 45 experts provided input on the first round of e-Delphi consultation and 40 in the second. Respondents covered a range of organisations (including for example academia, ministries, NGOs, research funders, technical agencies) involved in epidemiological studies from countries around the world (Europe: 19; Africa: 10; North America: 7; Asia: 5; South-America: 3 Australia: 1). A selection of eight experts were invited for a face-to-face meeting. The final guidelines consist of a set of 6 standards and 42 accompanying criteria including study preparation, protocol development, data collection, data management, data analysis, dissemination and communication.

CONCLUSION

While guidelines will not by themselves guard global health from questionable and unfair research practices, they are certainly part of a concerted effort to ensure not only mutual accountability between individual researchers, their institutions and their funders but most importantly their joint accountability towards the communities they study and society at large.

The strong focus on positive results in abstracts may cause bias in systematic reviews: a case study on abstract reporting bias

BACKGROUND

Research articles tend to focus on positive findings in their abstract, especially if multiple outcomes have been studied. At the same time, search queries in databases are generally limited to the abstract, title and keywords fields of an article. Negative findings are therefore less likely to be detected by systematic searches and to appear in systematic reviews. We aim to assess the occurrence of this 'abstract reporting bias' and quantify its impact in the literature on the association between diesel exhaust exposure (DEE) and bladder cancer.

METHODS

We set up a broad search query related to DEE and cancer in general. Full-texts of the articles identified in the search output were manually scanned. Articles were included if they reported, anywhere in the full-text, the association between DEE and bladder cancer. We assume that the use of a broad search query and manual full-text scanning allowed us to catch all the relevant articles, including those in which bladder cancer was not mentioned in the abstract, title or keywords.

RESULTS

We identified 28 articles. Only 12 of these (43%) had mentioned bladder in their abstract, title or keywords. A meta-analysis based on these 12 detectable articles yielded a pooled risk estimate of 1.10 (95% confidence interval [CI] 0.97-1.25), whereas the meta-analysis based on all 28 articles yielded a pooled estimate of 1.03 (95% CI 0.96-1.11).

CONCLUSIONS

This case study on abstract reporting bias shows that (a) more than half of all relevant articles were missed by a conventional search query and (b) this led to an overestimation of the pooled effect. Detection of articles will be improved if all studied exposure and outcome variables are reported in the keywords. The restriction on the maximum number of keywords should be lifted.

Guidelines and recommendations for ensuring Good Epidemiological Practice (GEP): a guideline developed by the German Society for Epidemiology

OBJECTIVE

To revise the German guidelines and recommendations for ensuring Good Epidemiological Practice (GEP) that were developed in 1999 by the German Society for Epidemiology (DGEpi), evaluated and revised in 2004, supplemented in 2008, and updated in 2014.

METHODS

The executive board of the DGEpi tasked the third revision of the GEP. The revision was arrived as a result of a consensus-building process by a working group of the DGEpi in collaboration with other working groups of the DGEpi and with the German Association for Medical Informatics, Biometry and Epidemiology, the German Society of Social Medicine and Prevention (DGSMP), the German Region of the International Biometric Society (IBS-DR), the German Technology, Methods and Infrastructure for Networked Medical Research (TMF), and the German Network for Health Services Research (DNVF). The GEP also refers to related German Good Practice documents (e.g. Health Reporting, Cartographical Practice in the Healthcare System, Secondary Data Analysis).

RESULTS

The working group modified the 11 guidelines (after revision: 1 ethics, 2 research question, 3 study protocol and manual of operations, 4 data protection, 5 sample banks, 6 quality assurance, 7 data storage and documentation, 8 analysis of epidemiological data, 9 contractual framework, 10 interpretation and scientific publication, 11 communication and public health) and modified and supplemented the related recommendations. All participating scientific professional associations adopted the revised GEP.

CONCLUSIONS

The revised GEP are addressed to everyone involved in the planning, preparation, execution, analysis, and evaluation of epidemiological research, as well as research institutes and funding bodies.