How researchers perceive research misconduct in biomedicine and how they would prevent it: A qualitative study in a small scientific community

Perception of organizational climate by university staff and students in medicine and humanities: A qualitative study

Organizational climate and culture are important for research organizations because they foster research integrity and responsible conduct of research, reduce questionable research practices, and improve job satisfaction. The aim of our study was to explore how employees and students perceive organizational climate and its consequences in the university setting. We conducted semi-structured interviews with senior students and employees (teaching and non-teaching staff) from two different university schools: School of Medicine and Faculty of Humanities and Social Sciences. Participants were asked questions regarding perceived climate, working environment, and the role of the institution. The data were analyzed using reflexive thematic analysis approach. Three themes were identified. The first theme addressed the difference in the perception and understanding of organizational climate. The second theme dealt with institutional issues emanating from organizational climate. The third theme described the behavior of stakeholders in the formation of organizational climate. Organizational climate is important concept in academic organizations as it influences both employees, particularly early career researchers, and students. Institutional leadership can strongly influence organizational climate, which can in turn affect job and job satisfaction. Due to the importance of personal morality on everyday decision-making, virtue-based research integrity training could be useful in improving academic institutions' organizational climate.

Five aspects of research waste in biomedicine: A scoping review

BACKGROUND

The number of published journal articles has grown exponentially during the last 30 years, which may have led to some wasteful research. However, the terminology associated with research waste remains unclear. To address this, we aimed to identify, define, and categorize the aspects of research waste in published biomedical reports.

METHODS

In this scoping review, we systematically searched for biomedical literature reports from 1993 to 2023 in two databases, focusing on those addressing and defining research waste. Through data charting, we analyzed and categorized the aspects of research waste.

RESULTS

Based on 4285 initial records in the searches, a total of 832 reports were included in the analysis. The included reports were primarily narrative reviews (26%) and original reports (21%). We categorized research waste into five aspects: methodological, invisible, negligible, underreported, and structural (MINUS) research waste. More than half of the reports (56%) covered methodological research waste concerning flaws in study design, study conduct, or analysis. Invisible research waste covered nonpublication, discontinuation, and lack of data-sharing. Negligible research waste primarily concerned unnecessary repetition, for example, stemming from the absence of preceding a trial with a systematic review of the literature. Underreported research waste mainly included poor reporting, resulting in a lack of transparency. Structural research waste comprised inadequate management, collaboration, prioritization, implementation, and dissemination.

CONCLUSION

MINUS encapsulates the five main aspects of research waste. Recognizing these aspects of research waste is important for addressing and preventing further research waste and thereby ensuring efficient resource allocation and scientific integrity.

Factors influencing the promotion and implementation of research integrity in research performing and research funding organizations: A scoping review

Promoting and implementing research integrity is considered the joint responsibility and effort of multiple stakeholders in the research community. We conducted a scoping review and analyzed 236 research articles and gray literature publications from biomedical sciences, social sciences, natural sciences (including engineering), and humanities that dealt with the factors that may positively or negatively impact the promotion and implementation of research integrity. Critical appraisal of evidence was performed for studies describing interventions aimed at research integrity promotion in order to provide insight into the effectiveness of these interventions. The results of this scoping review provide a comprehensive taxonomy of factors with positive or negative impact and their relatedness to individual researchers, research performing and funding organizations, and the system of science. Moreover, the results show that efforts for fostering and promoting research integrity should be implemented at all three levels (researcher, institution, system) simultaneously to deliver greater adherence and implementation of research integrity practices. Although various educational interventions aiming at research integrity promotion exist, we were not able to conclude on the effectiveness of explored interventions due to the methodological quality issues in the studies.

How do researchers perceive research misbehaviors? A case study of Indian researchers

Despite ample evidence of increasing research misconduct in India, little attention has been paid to understanding researchers' perception of research integrity and research misconduct among young Indian researchers. Interviews among 30 research scholars were conducted at Pondicherry University in India to understand their experience and perception of research misconduct. The top three influencing factors for scientific misconduct, according to the participants, were unavailability of adequate funds (35%), pressure from research supervisors (29%), and desperation to publish articles (25%). The participants had witnessed research misconduct in different forms i.e., data fabrication, falsification, and plagiarism. However, plagiarism was the most often cited cause of misbehavior in our interviews. Majority of participants have witnessed or personally encountered multiple instances where authorship conflicts occurred. The other questionable research practices highlighted in the study were improper citations, authorship disputes like gift and ghost authorships, misrepresentation of statistical data, failure to publish negative results. In an increasingly diverse and changing research environment, our research calls for practical research guidelines based on honesty, openness, and accountability that can help articulate and strengthen scientists' core values. More importantly, scientific misconduct can only be prevented by using a multifaceted strategy that includes identifying instances of scientific misconduct and implementing suitable deterrents and treatments that could change the behavior associated with such misconduct.

Institutional capacity to prevent and manage research misconduct: perspectives from Kenyan research regulators

BACKGROUND

Research misconduct i.e. fabrication, falsification, and plagiarism is associated with individual, institutional, national, and global factors. Researchers' perceptions of weak or non-existent institutional guidelines on the prevention and management of research misconduct can encourage these practices. Few countries in Africa have clear guidance on research misconduct. In Kenya, the capacity to prevent or manage research misconduct in academic and research institutions has not been documented. The objective of this study was to explore the perceptions of Kenyan research regulators on the occurrence of and institutional capacity to prevent or manage research misconduct.

METHODS

Interviews with open-ended questions were conducted with 27 research regulators (chairs and secretaries of ethics committees, research directors of academic and research institutions, and national regulatory bodies). Among other questions, participants were asked: (1) How common is research misconduct in your view? (2) Does your institution have the capacity to prevent research misconduct? (3) Does your institution have the capacity to manage research misconduct? Their responses were audiotaped, transcribed, and coded using NVivo software. Deductive coding covered predefined themes including perceptions on occurrence, prevention detection, investigation, and management of research misconduct. Results are presented with illustrative quotes.

RESULTS

Respondents perceived research misconduct to be very common among students developing thesis reports. Their responses suggested there was no dedicated capacity to prevent or manage research misconduct at the institutional and national levels. There were no specific national guidelines on research misconduct. At the institutional level, the only capacity/efforts mentioned were directed at reducing, detecting, and managing student plagiarism. There was no direct mention of the capacity to manage fabrication and falsification or misconduct by faculty researchers. We recommend the development of Kenya code of conduct or research integrity guidelines that would cover misconduct.

Biomedical supervisors' role modeling of open science practices

Supervision is one important way to socialize Ph.D. candidates into open and responsible research. We hypothesized that one should be more likely to identify open science practices (here publishing open access and sharing data) in empirical publications that were part of a Ph.D. thesis when the Ph.D. candidates' supervisors engaged in these practices compared to those whose supervisors did not or less often did. Departing from thesis repositories at four Dutch University Medical centers, we included 211 pairs of supervisors and Ph.D. candidates, resulting in a sample of 2062 publications. We determined open access status using UnpaywallR and Open Data using Oddpub, where we also manually screened publications with potential open data statements. Eighty-three percent of our sample was published openly, and 9% had open data statements. Having a supervisor who published open access more often than the national average was associated with an odds of 1.99 to publish open access. However, this effect became nonsignificant when correcting for institutions. Having a supervisor who shared data was associated with 2.22 (CI:1.19-4.12) times the odds to share data compared to having a supervisor that did not. This odds ratio increased to 4.6 (CI:1.86-11.35) after removing false positives. The prevalence of open data in our sample was comparable to international studies; open access rates were higher. Whilst Ph.D. candidates spearhead initiatives to promote open science, this study adds value by investigating the role of supervisors in promoting open science.

The Mentor's Role in Fostering Research Integrity Standards Among New Generations of Researchers: A Review of Empirical Studies

Promoting research integrity practices among doctoral candidates and early career researchers is important for creating a stable and healthy research environment. In addition to teaching specific technical skills and knowledge, research supervisors and mentors inevitably convey research practices, both directly and indirectly. We conducted a scoping review to summarise the role of mentors in fostering research integrity practices, mentors' responsibilities and the role that institutions have in supporting good mentorship. We searched five different databases and included studies that used an empirical methodology. After searching, a total of 1199 articles were retrieved, of which 24 were eligible for analysis. After snowballing, a total of 35 empirical articles were selected. The review discusses various themes such as the importance of good mentorship, poor mentorship practices, virtues and qualities of mentors, responsibilities and activities of mentors, group mentoring and responsibilities of the institution in supporting good mentorship. This review demonstrates the importance of mentors instilling responsible research practices and attitudes, and promoting research integrity among their mentees. Mentors are responsible for providing explicit guidance and for acting as good role models. The review highlights how poor mentorship can have a bad impact on the research climate. In addition, the review highlights the important influence that institutions can have in supporting mentorship.

“It is Very Difficult for us to Separate Ourselves from this System”: Views of European Researchers, Research Managers, Administrators and Governance Advisors on Structural and Institutional Influences on Research Integrity

Research integrity is fundamental to the validity and reliability of scientific findings, and for ethical conduct of research. As part of PRINTEGER (Promoting Integrity as an Integral Dimension of Excellence in Research), this study explores the views of researchers, research managers, administrators, and governance advisors in Estonia, Italy, Norway and UK, focusing specifically on their understanding of institutional and organisational influences on research integrity.

A total of 16 focus groups were conducted. Thematic analysis of the data revealed that competition is pervasive and appeared in most themes relating to integrity. The structural frameworks for research such as funding, evaluation and publication were thought to both protect and, more commonly, undermine integrity. In addition, institutional systems, including workload and research governance, shaped participants’ day-to-day work environment, also affecting research integrity. Participants also provided ideas for promoting research integrity, including training, and creating conditions that would be supportive of research integrity.

These findings support a shift away from individual blame and towards the need for structural and institutional changes, including organisations in the wider research environment, for example funding bodies and publishing companies.

Stakeholders' Experiences of Research Integrity Support in Universities: A Qualitative Study in Three European Countries

Fostering research integrity (RI) increasingly focuses on normative guidance and supportive measures within institutions. To be successful, the implementation of support should be informed by stakeholders' experiences of RI support. This study aims to explore experiences of RI support in Dutch, Spanish and Croatian universities. In total, 59 stakeholders (Netherlands n = 25, Spain n = 17, Croatia n = 17) participated in 16 focus groups in three European countries. Global themes on RI support experiences were identified by thematic analysis. Themes identified were: 'RI governance and institutional implementation', 'RI roles and structures', 'RI education and supervision', and 'Infrastructure, technology and tools supporting daily practice'. Experiences of support differed between countries in relation to: the efforts to translate norms into practice; the extent to which RI oversight was a responsibility of RE structures, or separate RI structures; and the availability of support close to research practice, such as training, responsible supervision, and adequate tools and infrastructure. The study reinforces the importance of a whole institutional approach to RI, embedded within local jurisdictions, rules, and practices. A whole institutional approach puts the emphasis of responsibility on institutions rather than individual researchers. When such an approach is lacking, some stakeholders look for intervention by authorities, such as funders, outside of the university.

RESPONSE_ABILITY A Card-Based Engagement Method to Support Researchers' Ability to Respond to Integrity Issues

Issues related to research integrity receive increasing attention in policy discourse and beyond with most universities having introduced by now courses addressing issues of good scientific practice. While communicating expectations and regulations related to good scientific practice is essential, criticism has been raised that integrity courses do not sufficiently address discipline and career-stage specific dimensions, and often do not open up spaces for in-depth engagement. In this article, we present the card-based engagement method RESPONSE_ABILITY, which aims at supporting researchers in developing their ability to respond to challenges of good scientific practice. The method acknowledges that what counts and what does not count as acceptable practice may not be as clear-cut as imagined and that research environments matter when it comes to integrity issues. Using four sets of cards as stimulus material, participants are invited to reflect individually and collectively about questions of research integrity from different perspectives. This approach is meant to train them to negotiate in which contexts certain practices can still be regarded as acceptable and where possible transgressions might begin. RESPONSE_ABILITY can be seen as fostering the creation of an integrity culture as it invites a more reflexive engagement with ideals and realities of good practice and opens a space to address underlying value conflicts researchers may be confronted with. Concluding the article, we call for caution that addressing issues of integrity meaningfully requires striking a delicate balance between raising researchers' awareness of individual responsibilities and creating institutional environments that allow them to be response-able.

Reducing tensions and expediting manuscript submission via an authorship agreement for early-career researchers: A pilot study

Authorship can be a source of tension on research teams, in academic/industry collaborations, and between mentors/mentees. Authorship misconduct is prevalent among biomedical researchers, and disputes about authorship can generate tensions that have the potential to disrupt professional relationships and damage careers. Early-career researchers may experience particular challenges navigating authorship both because of inexperience and power differentials; in effect, they lack the language and confidence to have these conversations and may feel unwilling to challenge the status quo. The authors implemented an Authorship Agreement for use when collaborating on a manuscript and hypothesized that using this agreement would reduce authorship tensions and speed time to manuscript submission by helping early-career investigators manage authorship conversations more effectively. The authors surveyed trainees (n = 65) on the prevalence of authorship-related tensions and compared the results from the first survey in 2017 to the final survey in 2020. The decrease in tensions around meeting deadlines was significant (z = 2.59, p = 0.010). The authors believe the effect of an Authorship Agreement on authorship-related tensions has not previously been investigated. This work extends what is known about the prevalence of commonly cited authorship tensions, and provides evidence of the effectiveness of steps that can be taken to alleviate them.

Survey on the Research Misconduct and Questionable Research Practices of Medical Students, PhD Students, and Supervisors at the Zagreb School of Medicine in Croatia

This cross-sectional study evaluates the knowledge, attitudes, experiences, and behavior of final year medical students, PhD students, and supervisors at the School of Medicine of the University of Zagreb in relation to research misconduct, questionable research practices, and the research environment. The overall response rate was 36.4% (68%-100% for the paper survey and 8%-15% for the online surveys). The analysis reveals statistically significant differences in attitude scores between PhD students and supervisors, the latter having attitudes more in concordance with accepted norms. The results overall show a nonnegligible incidence of self-reported misconduct and questionable research practices, as well as some problematic attitudes towards misconduct and questionable research practices. The incidence of problematic authorship practices was particularly high. The research environment was evaluated as being mostly supportive of research integrity.

Perspectives of key stakeholders on essential virtues for good scientific practice in research areas

In contrast to the principle-based approach to ethics and research integrity (ERI) training, which stresses the importance of following moral rules, the virtue-based approach focuses on developing good character traits. This study has aimed to explore what virtues mean in scientific practice and their suitable place in ERI training, using a qualitative approach. Two face-to-face focus group discussions were conducted with 21 participants. Heterogeneous purposive sampling was used to reach participants from different countries, organization types (academia, research, publishing, private sector), scientific disciplines and stages of their scientific careers. Data generated during the focus group discussions were analyzed using a reflexive thematic analysis approach, and three main themes were developed. The first theme addressed the relativity of virtue meanings because the participants differed in their definitions and understandings of the concept of virtue. The second theme referred to the acquisition of virtues through social interactions because participants saw virtues mostly as social constructs acquired through socialization and education. The third theme addressed the differences in the importance of particular virtues in research. Participants felt that particular virtues were more important than others because some of them are necessary for responsible research, and some are not.

Interventions for Organizational Climate and Culture in Academia: A Scoping Review

Organizational climate and culture may influence different work-related outcomes, including responsible conduct of research and research misconduct in academic or research organizations. In this scoping review we collected evidence on outcomes of interventions to change organizational climate or culture in academic or research settings. Out of 32,093 documents retrieved by the search, we analysed 207 documents in full text, out of which 7 met the eligibility criteria and were included in the final analysis. The included studies measured organizational climate (2 studies), organizational culture (4 studies), or both (1 study) at biomedical faculties (4 studies) or non-academic university departments (3 studies). Four studies had post-test, and three before-and-after study designs. The majority of interventions were face-to-face activities (meetings, different teambuilding activities), and two were based on organizational change. Six studies reported positive changes in organizational climate/culture after the intervention. These positive changes were measured as improvements in score on different questionnaire survey or were described through authors' or external evaluator's narrative reports. However, the methodological quality of the studies was low, both for qualitative and quantitative study designs. Replicable studies, using rigorous methods and clearly defined outcomes are urgently needed if organizations want to achieve a real change in organizational climate or culture for responsible research. The protocol for this scoping review was registered at https://osf.io/7zjqb .

Research Misconduct in the Fields of Ethics and Philosophy: Researchers' Perceptions in Spain

Empirical studies have revealed a disturbing prevalence of research misconduct in a wide variety of disciplines, although not, to date, in the areas of ethics and philosophy. This study aims to provide empirical evidence on perceptions of how serious a problem research misconduct is in these two disciplines in Spain, particularly regarding the effects that the model used to evaluate academics' research performance may have on their ethical behaviour. The methodological triangulation applied in the study combines a questionnaire, a debate at the annual meeting of scientific association, and in-depth interviews. Of the 541 questionnaires sent out, 201 responses were obtained (37.1% of the total sample), with a significant difference in the participation of researchers in philosophy (30.5%) and in ethics (52.8%); 26 researchers took part in the debate and 14 interviews were conducted. The questionnaire results reveal that 91.5% of the respondents considered research misconduct to be on the rise; 63.2% considered at least three of the fraudulent practices referred to in the study to be commonplace, and 84.1% identified two or more such practices. The researchers perceived a high prevalence of duplicate publication (66.5%) and self-plagiarism (59.0%), use of personal influence (57.5%) and citation manipulation (44.0%), in contrast to a low perceived incidence of data falsification or fabrication (10.0%). The debate and the interviews corroborated these data. Researchers associated the spread of these misconducts with the research evaluation model applied in Spain.

Rethinking success, integrity, and culture in research (part 1) - a multi-actor qualitative study on success in science

BACKGROUND

Success shapes the lives and careers of scientists. But success in science is difficult to define, let alone to translate in indicators that can be used for assessment. In the past few years, several groups expressed their dissatisfaction with the indicators currently used for assessing researchers. But given the lack of agreement on what should constitute success in science, most propositions remain unanswered. This paper aims to complement our understanding of success in science and to document areas of tension and conflict in research assessments.

METHODS

We conducted semi-structured interviews and focus groups with policy makers, funders, institution leaders, editors or publishers, research integrity office members, research integrity community members, laboratory technicians, researchers, research students, and former-researchers who changed career to inquire on the topics of success, integrity, and responsibilities in science. We used the Flemish biomedical landscape as a baseline to be able to grasp the views of interacting and complementary actors in a system setting.

RESULTS

Given the breadth of our results, we divided our findings in a two-paper series, with the current paper focusing on what defines and determines success in science. Respondents depicted success as a multi-factorial, context-dependent, and mutable construct. Success appeared to be an interaction between characteristics from the researcher (Who), research outputs (What), processes (How), and luck. Interviewees noted that current research assessments overvalued outputs but largely ignored the processes deemed essential for research quality and integrity. Interviewees suggested that science needs a diversity of indicators that are transparent, robust, and valid, and that also allow a balanced and diverse view of success; that assessment of scientists should not blindly depend on metrics but also value human input; and that quality should be valued over quantity.

CONCLUSIONS

The objective of research assessments may be to encourage good researchers, to benefit society, or simply to advance science. Yet we show that current assessments fall short on each of these objectives. Open and transparent inter-actor dialogue is needed to understand what research assessments aim for and how they can best achieve their objective.

STUDY REGISTRATION

osf.io/33v3m.

Rethinking success, integrity, and culture in research (part 2) - a multi-actor qualitative study on problems of science

BACKGROUND

Research misconduct and questionable research practices have been the subject of increasing attention in the past few years. But despite the rich body of research available, few empirical works also include the perspectives of non-researcher stakeholders.

METHODS

We conducted semi-structured interviews and focus groups with policy makers, funders, institution leaders, editors or publishers, research integrity office members, research integrity community members, laboratory technicians, researchers, research students, and former-researchers who changed career to inquire on the topics of success, integrity, and responsibilities in science. We used the Flemish biomedical landscape as a baseline to be able to grasp the views of interacting and complementary actors in a system setting.

RESULTS

Given the breadth of our results, we divided our findings in a two-paper series with the current paper focusing on the problems that affect the integrity and research culture. We first found that different actors have different perspectives on the problems that affect the integrity and culture of research. Problems were either linked to personalities and attitudes, or to the climates in which researchers operate. Elements that were described as essential for success (in the associate paper) were often thought to accentuate the problems of research climates by disrupting research culture and research integrity. Even though all participants agreed that current research climates need to be addressed, participants generally did not feel responsible nor capable of initiating change. Instead, respondents revealed a circle of blame and mistrust between actor groups.

CONCLUSIONS

Our findings resonate with recent debates, and extrapolate a few action points which might help advance the discussion. First, the research integrity debate must revisit and tackle the way in which researchers are assessed. Second, approaches to promote better science need to address the impact that research climates have on research integrity and research culture rather than to capitalize on individual researchers' compliance. Finally, inter-actor dialogues and shared decision making must be given priority to ensure that the perspectives of the full research system are captured. Understanding the relations and interdependency between these perspectives is key to be able to address the problems of science.

STUDY REGISTRATION

https://osf.io/33v3m.

Differing perceptions concerning research misconduct between China and Flanders: A qualitative study

In the field of research integrity, there has been increasing interest in the influence of culture on research misconduct. Yet, there is a lack of empirical study on how differently researchers from distinct cultural backgrounds perceive research misconduct. Hence, we used the qualitative approach to investigate and compare perspectives concerning research misconduct between Chinese and Flemish researchers. By means of 45 interviews we explored their perspectives on types, determinants of, and solutions to research misconduct. Our findings show elements of scientific culture shared by both groups, but also clear dissimilarities. The Chinese participants more often mentioned plagiarism and inappropriate authorship as examples of research misconduct, while Flemish respondents brought up fabrication and falsification. Research misconduct was associated with diverse determinants, though the Chinese favored the "bad apple" theory (more intrinsic), while the Flemish pointed to the "publish or perish" pressure and attributed misconduct to situational aspects (rather extrinsic). Accordingly, they proposed diverse strategies to handle this issue, yet education and training were recommended by both groups. This study confirms that research misconduct is the result of many factors intertwining and interacting, and suggests that cultural traits contribute to our perceptions of research misconduct and subsequent bias in that context.

Authorship stories panel discussion: Fostering ethical authorship by cultivating a growth mindset

Because peer review publication is essential for academic advancement across scientific fields, when authorship is wrongly attributed the consequences can be profound, particularly for junior researchers who are still establishing their professional norms and scientific reputations. Professional societies have published guidelines for authorship, yet authorship dilemmas frequently arise and have harmful consequences for scientific careers. Researchers have noted the complexities of authorship and called for new mechanisms to foster more ethical research cultures within institutions. To address this call, we organized a panel discussion at the Institute for Clinical Research Education at the University of Pittsburgh in which senior faculty members from diverse backgrounds and professional disciplines discussed their own authorship challenges (e.g., renegotiating author order, reconciling inter-professional authorship norms, managing coauthor power differentials) and offered strategies to avoid and/or resolve them. Informed by growth mind-set theory, our storytelling format facilitated an open exchange between senior and junior researchers, situated authorship dilemmas in specific contexts and career stages, and taught researchers how to address authorship challenges not adequately informed by guideline recommendations. Though not empirically assessed, we believe this approach represents a simple, low-cost, and replicable way to cultivate ethical and transparent authorship practices among researchers across scientific fields.

Is failure to raise concerns about misconduct a breach of integrity? Researchers' reflections on reporting misconduct

This article describes and discusses the views of researchers on the significance of raising concerns about scientific misconduct in their work environment and the reasons or circumstances that might deter them from doing so. In this exploratory qualitative research study, we conducted in-depth interviews with 33 researchers working in life sciences and medicine. They represent three seniority levels and five universities across Switzerland. A large majority of respondents in this research study argued that failure to raise concerns about scientific misconduct compromises research integrity. This is an encouraging result demonstrating that researchers try to adhere to high ethical standards. However, further interaction with respondents highlighted that this correct ethical assessment does not lead researchers to take the consequent action of raising concerns. The factors that discourage researchers from raising concerns need to be addressed at the level of research groups, institutions, and by setting a positive precedent which helps them to believe in the system's ability to investigate concerns raised in a timely and professional manner. Training of researchers in research integrity related issues will have limited utility unless it is coupled with the creation of research culture where raising concerns is a standard practice of scientific and research activities.