How Do We Know What Works? A Review and Critique of Current Practices in Ethics Training Evaluation

The present situation of and challenges in research ethics and integrity promotion: Experiences in East Asia

As relatively new economies to the global research arena, East Asian nations have fully realized the importance of research integrity in recent decades. This article conducts document analysis to demonstrate and discuss the current situation of research integrity campaigns in Taiwan, Korea, and Japan, nations that have similar cultural backgrounds and socioeconomic statuses. This article emphasizes the common situations faced by these three nations both individually and collectively. Based on a four-pillar framework, research integrity campaigns in these nations are making progress in terms of policies and regulations, institutional management, researchers' education and training, and the handling of misconduct cases. Various issues and challenges have also emerged in this context, although these efforts may have had positive impacts on research communities in these three nations. Challenges associated with research integrity governance, institutional willingness, RCR instructor qualifications, the effectiveness of education, and the standardization of definitions of misconduct and noncompliance are also highlighted. The issues discussed in this article are expected to have implications for research communities and policy-makers in these three nations as well as in a global context.

Development of consensus on essential virtues for ethics and research integrity training using a modified Delphi approach

Most ethics and research integrity (ERI) training approaches are based on teaching moral rules, duties or responsibilities, often not sufficiently addressing virtue-based ethics. This study aimed to obtain a consensus among relevant experts on the importance of essential virtues for ERI training and their acquisitions. A modified Delphi consensus process was conducted in three rounds; 31 ERI experts participated in Round 1 and 23 in Round 2 and Round 3. Based on findings generated from qualitative data in Round 1, a structured questionnaire with 90 different statements grouped under five domains was developed for Round 2 and Round 3. After the final round, a consensus was achieved on two-thirds of statements included in this study. The experts agreed that virtues are based on learned and reflected attitudes and that the appropriate direction to acquire research virtues is through continuing education using case studies and discussions based on real-life scenarios. Furthermore, the consensus was obtained on 35 scientific virtues that should be stimulated in ERI training, prioritizing honesty, integrity, accountability, criticism and fairness as the most essential scientific virtues for good research practice. These results should be considered in developing or adjusting the ERI training program and materials.

An integrated learning framework of corporate training system: a grounded theory approach

Purpose

Rooting in the literature on training and laying on Kirkpatrick model, this paper aims to explore key drivers of corporate training to identify how they can be combined into an integrated framework of learning for human capital development.

Design/methodology/approach

By adopting the constructivist grounded theory, this contribution analyzes the experience carried out in the last ten years by Virvelle, an Italian corporate training firm.

Findings

Results show the rise of five core categories, g1iving rise to an integrated model of Kirkpatrick. Their dynamic interplay led to a new orientation of Kirkpatrick model giving rise to a metalearning ecosystem.

Research limitations/implications

Managerial implications have identified key factors on which building and implementing appropriate corporate training programmes capable of triggering co-generative processes of value creation. Particularly, the essential role of learning quality culture, digital technology and personalization are detected in integrating not only hard but furthermore soft shades of learning. Concerning theoretical implications, the emergence of key structural and systems enabling dimensions for learning, and contextual mechanisms involved in reshaping training effectiveness and achieving integrated learning outcomes are detected. The main limitation of this study lies in the need to generalize results: the conceptualized framework needs to be empirically tested.

Originality/value

The value of this research is built along three main points. The first is the integration among the core categories that an integrated learning system can be built on, promoting learning quality culture through positive feedback loops. The second is represented by the chance to enhance an integrated mutual knowledge development among engaged actors, thereby shaping a more holistic and multidimensional learning model. The third is related to the transversal role that digital technology plays in all phases of the training process as it integrates and enriches them.

Item and rater variabilities in students' evaluation of teaching in a university in Ghana: application of Many-Facet Rasch Model

This research examined the item and rater variabilities in students' evaluation of teaching and courses exercise at the University of Cape Coast (UCC) through the lenses of the Many-Facet Rasch Model (MFRM). The study covered students during the 2019/2020 academic year in the selected university, analysing secondary data obtained from the Directorate of Academic Planning and Quality Assurance, UCC (DAPQA-UCC). The data were analysed by conducting partial credit MFRM analyses. It was found that the sources of measurement errors in the student evaluation exercise included halo effect, non-functional item structure, inconsistent students' ratings, rater leniency, and non-functional rating scale. It was concluded that data from students' appraisal of lecturers' teaching should be used with caution. It was recommended that DAPQA-UCC and the university management should train students on the evaluation of teaching, as well as review the existing evaluation form for appraising courses and teaching by subjecting the instrument to rigorous validation procedures.

Gelingende Ethik-Lehre in der Medizin. Erkenntnisse aus der Lehrforschung

Die Frage nach den Faktoren, die eine wirksame Ethik-Lehre in der Medizin ausmachen, blieb bislang weitgehend unbeantwortet. Vor allem im deutschsprachigen Raum wird hier zu wenig Forschung betrieben. Aufgrund fehlender wissenschaftlich aussagekräftiger Evaluationsstudien lässt sich somit mitunter nur vermuten, wie wirksam bestimmte Lehrformate und -methoden in der Ethik-Lehre tatsächlich sind. Die Auswahl von Lehrformaten und -methoden, die Ethik-Dozierende für das Erreichen eines festgelegten Lernziels einsetzen, wird häufig nicht nach evidenzbasierten Kriterien, sondern auf der Grundlage von guten oder schlechten Lehrerfahrungen sowie von unmittelbarem Feedback der Studierenden getroffen. Im vorliegenden Beitrag werden nach einem kurzen Überblick über Evaluationsverfahren ethischer Kompetenzen Erkenntnisse aus ausgewählten internationalen Wirksamkeitsstudien vorgestellt und auf ihre Relevanz für den Medizinethik-Unterricht diskutiert. Wenngleich die Erkenntnisse aus diesen Evaluations- und Meta-Studien aus anderen, angrenzenden Bereichen wie der Forschungsethik und anderen Lehrkontexten kommen, so können sie doch als Diskussionsanstoß dienen und dazu beitragen, Eckpunkte für die Gestaltung wirksamer Ethik-Lehre in der Medizin im deutschsprachigen Raum zu definieren.

Perception and reaction of Nanyang Technological University (NTU) researchers to different forms of research integrity education modality

BACKGROUND

Research and academic institutions use various delivery channels to deliver Research Integrity (RI) education in their communities. Yet there is no consensus on the best delivery method and the effectiveness of these channels in inculcating a positive RI culture varies across institutions. Hence, this study aimed to understand the preferences of the research community in Nanyang Technological University (NTU), Singapore.

METHODS

An online survey was conducted on NTU research community to understand their experience with, and preference for each RI education mode offered in NTU. The RI education modes surveyed in the general ranking question are Data Management Plan (DMP) workshops, Epigeum e-Learning, Compass e-newsletter (email), and NTU policy on Research Integrity and Responsible Conduct of Research. There were 242 responses, comprising 50% research students, 32.2% research staff and 17.8% faculty members. Non-parametric statistical techniques were used to analyse preferences across different RI education modes and within sub-groups (i.e., fields, age, native language, roles in research community).

RESULTS

More than 92% of respondents subscribed to the importance of RI education, but with different preferences for education modes. With respect to RI education in NTU, Compass e-newsletters were ranked the lowest (p < 0.05). Most felt that they were too wordy and unengaging, making it difficult to absorb information. Similarly, Epigeum e-Learning (p < 0.05) and 'policy' (p < 0.05) were found to be too lengthy in presentation. The compulsory NTU RI education modes (Epigeum e-learning and 'policy') enjoyed higher participation rates of 70-80% compared with 32-37% for the self-regulated modes (DMP workshop and e-newsletter). This suggests that regulatory mechanisms are still necessary to promote participation in RI education, and thus, core RI education content should be made compulsory in research/academic institutions. Although Epigeum is a compulsory course, some may not have participated in the programme due to technical issues or they might have forgotten to participate in the programme within the permissible timeframe. For all four RI education modes in NTU, the lack of awareness was among the top cited reasons for not participating.

CONCLUSIONS

Most NTU researchers perceived RI education positively although they may have reservations for some approaches. Conversely, e-Learning is favored over all the other modes except for the mode of Policy. Findings from this study are useful for improving the design of RI education strategies to be more appealing to the research community by enhancing user experience in terms of user-friendliness, relevance to specialisation, providing concise information and better presentation of materials For institutions with similar modes of RI education as NTU, these results may be relevant in improving participation rates and presentation of RI education modes, such as the use of infographics and more concise information.

Developing a competency framework for health research ethics education and training

Health research ethics (HRE) training programmes are being developed and implemented globally, often with a goal of increasing local capacity to assure ethical conduct in health-related research. Yet what it means for there to be sufficient HRE capacity is not well-defined, and there is currently no consensus on outcomes that HRE training programmes should collectively intend to achieve. Without defining the expected outcomes, meaningful evaluation of individual participants and programmes is challenging. In this article, we briefly describe the evolution of formal education in HRE, articulate the need for a framework to define outcomes for HRE training programmes, and provide guidance for developing HRE competency frameworks that define outcomes suited to their contexts. We detail critical questions for developing HRE competency frameworks using a six-step process: (1) define the purposes, intended uses and scope of the framework; (2) describe the context in which practice occurs; (3) gather data using a variety of methods to inform the competency framework; (4) translate the data into competencies that can be used in educational programmes; (5) report on the competency development process and results and (6) evaluate and update the competency framework. We suggest that competency frameworks should be feasible to develop using this process, and such efforts promise to contribute to programmatic advancement.

Design thinking: a cognitive resource for improving workforce analytics and training evaluation

Purpose

The firms use training evaluation practices (TEPs) to determine the return of billions of dollars spent on employee training and development activities. The firms need to modernize the set of TEPs for evidence-based workforce management decisions. This study aims to examine a mediation mechanism to explain how human resource (HR) professionals’ design thinking (DT) mindset strengthens the set of TEPs using predictive workforce analytics (PWAs).

Design/methodology/approach

The authors used SPSS computational named MLMED to test the proposed relationships by collecting data from 180 management professionals serving in subsidiaries of multinational corporations in Pakistan.

Findings

The statistical results demonstrated that DT is not directly related to firms’ TEPs. However, the statistical results supported the mediating role of firms’ use of PWAs between DT and TEPs.

Originality/value

The findings offer a new perspective for firms to use HR professionals’ DT mindset for modernizing the set of existing HR practices.

Side effects associated with organizational interventions: A perspective

Drawing on examples from published research, the authors offer a perspective on the side effects that are associated with organizational interventions. This perspective is framed in the context of the many hard-won positive influences that industrial and organizational (I-O) psychologists have had on individuals, groups, organizations, and social institutions over the last century. With a few exceptions, we argue that side effects tend to receive less attention from I-O psychology researchers and practitioners than they deserve. A systematic approach to studying, monitoring, and advertising side effects is needed to better understand their causes, consequences, and the contexts in which they are most likely to emerge. The purpose of this piece is to stimulate conversations within the field about the phenomenon of side effects as well as what might be done to improve our science and practice in this domain.

Current Approaches for Integrating Responsible and Ethical Conduct of Research (RECR) Education into Course-based Undergraduate Research Experiences: A National Assessment

Course-based undergraduate research experiences (CUREs), which often engage students as early as freshman year, have become increasingly common in biology curricula. While many studies have highlighted the benefits of CUREs, little attention has been paid to responsible and ethical conduct of research (RECR) education in such contexts. Given this observation, we adopted a mixed methods approach to explore the extent to which RECR education is being implemented and assessed in biological sciences CUREs nationwide. Survey and semistructured interview data show a general awareness of the importance of incorporating RECR education into CUREs, with all respondents addressing at least one RECR topic in their courses. However, integration of RECR education within the CURE environment primarily focuses on the application of RECR during research practice, often takes the form of corrective measures, and appears to be rarely assessed. Participants reported lack of time and materials as the main barriers to purposeful inclusion of RECR education within their courses. These results underscore a need for the CURE community to develop resources and effective models to integrate RECR education into biology CUREs.

Virtue-based ethics and integrity of research: train-the-trainer programme for upholding the principles and practices of the European Code of Conduct for Research Integrity (VIRT2UE)

Background: Recognising the importance of addressing ethics and research integrity (ERI) in Europe, in 2017, the All European Academies (ALLEA) published a revised and updated European Code of Conduct for Research Integrity (ECoC). Consistent application of the ECoC by researchers across Europe will require its widespread dissemination, as well as an innovative training programme and novel tools to enable researchers to truly uphold and internalise the principles and practices listed in the Code.

Aim: VIRT2UE aims to develop a sustainable train-the-trainer blended learning programme enabling contextualised ERI teaching across Europe focusing on understanding and upholding the principles and practices of the ECoC.

Vision: The VIRT2UE project recognises that researchers not only need to have knowledge of the ECoC, but also to be able to truly uphold and internalise the principles underpinning the code. They need to learn how to integrate them into their everyday practice and understand how to act in concrete situations. VIRT2UE addresses this challenge by providing ERI trainers and researchers with an innovative blended (i.e. combined online and off-line approaches) learning programme that draws on a toolbox of educational resources and incorporates an e-learning course (including a YouTube channel) and face-to-face sessions designed to foster moral virtues. ERI trainers and researchers from academia and industry will have open access to online teaching material. Moreover, ERI trainers will learn how to facilitate face-to-face sessions of researchers, which focus on learning how to apply the content of the teaching material to concrete situations in daily practice.

Objectives: VIRT2UE’s work packages (WP) will: conduct a conceptual mapping amongst stakeholders to identify and rank the virtues which are essential for good scientific practice and their relationship to the principles and practices of the ECoC (WP1); identify and consult ERI trainers and the wider scientific community to understand existing capacity and deficiencies in ERI educational resources (WP2); develop the face-to-face component of the train-the-trainer programme which provides trainers with tools to foster researchers’ virtues and promote the ECoC and iteratively develop the programme based on evaluations (WP3); produce educational materials for online learning by researchers and trainers (WP4); implement and disseminate the train-the-trainer programme across Europe, ensuring the training of sufficient trainers for each country and build capacity and consistency by focusing on underdeveloped regions and unifying fragmented efforts (WP5); and develop the online training platform and user interface, which will be instrumental in evaluation of trainers’ and researchers’ needs and project sustainability (WP6).

Impact: The VIRT2UE training programme will promote consistent application of the ECoC across Europe. The programme will affect behaviour on the individual level of trainers and researchers – simultaneously developing an understanding of the ECoC and other ERI issues, whilst also developing scientific virtues, enabling the application of the acquired knowledge to concrete situations and complex moral dilemmas. Through a dedicated embedding strategy, the programme will also have an impact on an institutional level. The train-the-trainer approach multiplies the impact of the programme by reaching current and future European ERI trainers and, subsequently, the researchers they train.

Reflecting on Responsible Conduct of Research: A Self Study of a Research-Oriented University Community

Research-oriented universities are known for prolific research activity that is often supported by students in faculty-guided research. To maintain ethical standards, universities require on-going training of both faculty and students to ensure Responsible Conduct of Research (RCR). However, previous research has indicated RCR-based training is insufficient to address the ethical dilemmas that are prevalent within academic settings: navigating issues of authorship, modeling relationships between faculty and students, minimization of risk, and adequate informed consent. U.S. universities must explore ways to identify and improve RCR concerns for current (faculty) and future researchers (students). This article reports the findings of a self-study (N = 50) of research stakeholders (students and faculty) at a top tier research institution. First, we report on their perceived importance of applying RCR principles. Second, we explore relationships between stakeholder backgrounds (e.g., prior training, field, and position) and how they ranked the degree of ethical concerns in fictitious vignettes that presented different unethical issues university students could encounter when conducting research. Vignette rankings suggested concerns of inappropriate relationships, predatory authorship and IRB violations which were judged as most unethical, which was dissimilar to what sampled researchers reported in practice as the most important RCR elements to understand and adhere to for successful research. Regression models indicated there was no significant relationship between individuals’ vignette ethics scores and backgrounds, affirming previous literature suggesting that training can be ineffectual in shifting researcher judgments of ethical dilemmas. Recommendations for training are discussed.

Perspectives of key stakeholders on essential virtues for good scientific practice in research areas

In contrast to the principle-based approach to ethics and research integrity (ERI) training, which stresses the importance of following moral rules, the virtue-based approach focuses on developing good character traits. This study has aimed to explore what virtues mean in scientific practice and their suitable place in ERI training, using a qualitative approach. Two face-to-face focus group discussions were conducted with 21 participants. Heterogeneous purposive sampling was used to reach participants from different countries, organization types (academia, research, publishing, private sector), scientific disciplines and stages of their scientific careers. Data generated during the focus group discussions were analyzed using a reflexive thematic analysis approach, and three main themes were developed. The first theme addressed the relativity of virtue meanings because the participants differed in their definitions and understandings of the concept of virtue. The second theme referred to the acquisition of virtues through social interactions because participants saw virtues mostly as social constructs acquired through socialization and education. The third theme addressed the differences in the importance of particular virtues in research. Participants felt that particular virtues were more important than others because some of them are necessary for responsible research, and some are not.

A Little Goes a Long Way: Adapting an Ethics Training Program to Work for Smaller Universities

The present project modified an existing ethics intervention aimed at graduate students, which had previously been evaluated and determined to be effective. The existing program was modified to shorten it from a 2 full-day training to a 1 full-day training. The effectiveness of the modified training program was evaluated using multiple dependent measures: perceptions of ethical dilemmas, ethical decision making and the using of cognitive strategies for ethical decision making, and reactions to the training. The results of the present study indicated that there were significant differences from pretraining to posttraining on measures of perceptions of ethical problems and markers of the cognitive processes involved in ethical decision making, including a focus on the ethical elements of the problem, and overall decision ethicality. Finally, participants reacted favorably to the program. Implications of these results are discussed.

Taiwanese and American Graduate Students' Misconceptions Regarding Responsible Conduct of Research: A Cross-National Comparison Using a Two-Tier Test Approach

Individual researchers may interpret responsible conduct of research (RCR) in various ways, especially given the diversity of research personnel in modern science. Therefore, understanding individuals' RCR-related misconceptions is important, as it can help RCR instructors customize their lessons to target learners' incorrect and incomplete ideas. In this vein, this study aimed to explore whether Taiwanese and American graduate students differ in their perceptions and misconceptions regarding RCR-related concepts and, if so, to determine these differences. A diagnostic assessment, the Revised RCR Reasoning Test (rev-RCRRT), was developed to pursue the intended goal. The rev-RCRRT is a two-tier test capable of diagnosing whether a student's justifications of ethical acceptance in relation to specific RCR-related concepts are based on incorrect or incomplete ideas of RCR. The current results indicated that, first, participating graduate students' test performances dropped drastically between the first- and second-tier items, suggesting that they were able to judge the ethical acceptability of given RCR-specific scenarios but lacked the advanced knowledge required to explain their judgments. Second, in general, American students achieved significantly better scores on the rev-RCRRT than Taiwanese students. Third, the two groups held different RCR-related misconceptions centered around various RCR topics. Specifically, Taiwanese students' misconceptions involved concepts related to authorship, piecemeal publication, and human-subject protection. However, American students sometimes misjudged the issues regarding duplicate submissions and publication and the reproducibility of research and replication of ideas. In summary, through a cross-national comparative method, this study not only suggests that graduate students from different national backgrounds interpret RCR differently but also provides substantial evidence for the employment of a two-tier test approach in RCR-specific contexts. The implications of the current findings for future research and the utility of using two-tier tests in RCR instruction are also discussed in this article.

A Quality Checklist for Responsible Conduct of Research (RCR) Education: A proposal to complement the Predictive Modeling Tool

This article presents a Quality Checklist for Responsible Conduct of Research (RCR) education. The Checklist is a tool for teachers and educational developers in RCR education containing the results of eleven reviews on the impact of RCR education. It makes these data accessible in a layered way, such that users can quickly find the information that they are interested in. The tool can complement the Predictive Modeling Tool , which allows users to fill out information about a course and provides recommendations on how the course's efficacy can be improved. We present our approach to developing the Quality Checklist prototype tool, the tool itself and how it can be used. We compare it to the PMT and discuss the added value of the Quality Checklist prototype tool, as well as its limitations. Finally, we indicate some of the ways in which the prototype tool could be further improved.

Enhancing training effectiveness for organizations through blockchain-enabled training effectiveness measurement (BETEM)

Purpose

Due to technology advancement or transparency in system, there is a constant inflow and outflow of technology in the business for transparency and efficiency. To seize a competitive advantage, companies have emerged new technological solutions to respond to the change in the organization environment. There is a surge in the requirement of learning opportunities and effective training programs in the organization. The current study has been an effort to understand the potential of blockchain technology that can create better training evaluation.

Design/methodology/approach

The electronic-Delphi (e-Delphi) method has been conducted by recording the final consensus and to find a balance for implementation of blockchain technology and measuring training effectiveness. The current research is one of its new types where blockchain-enabled training effectiveness measurement (BETEM) model has been formulated using a qualitative approach.

Findings

The study has considered human resource (HR) professionals as the experts and based on their responses, the formulation of theoretical network model has been structured using e-Delphi–BETEM (e-DLH–BETEM) approach. By critically examining the experts’ responses and comments, the study formulated the four major themes and 11 subthemes for the smooth functioning of the BETEM for an organization.

Research limitations/implications

The research aims to aid innovations in BETEMs model for training evaluation. The model will contribute incrementally toward the complete transformation of the training development programs of employees. The goal of BETEMs is to ensure that organizations, specifically HR personals can prepare themselves to have competitive advantage by using blockchain technology.

Originality/value

The application of blockchain technology in measuring the training effectiveness is an addition to existing literature as majority of existing studies have studied the use of technology for measuring training effectiveness.

Un lieu d’accueil pour l’élaboration de la souffrance du soignant : réflexion sur le cursus de formation en éthique au programme de psychiatrie de l’Université de Sherbrooke

La spécificité des soins en psychiatrie liée au contexte actuel rend les enjeux éthiques particulièrement saillants. Les résidents en formation dans cette discipline médicale sont confrontés à de tels enjeux dans bien des situations difficiles, lesquels peuvent fréquemment occasionner un inconfort marqué et une souffrance morale. Les futurs médecins sont outillés de connaissances et de compétences qui devraient leur permettre d’aborder les enjeux éthiques inhérents à la pratique, car l’enseignement de cette discipline est maintenant une condition d’accréditation des programmes de résidence au Canada. Or, bien des questions subsistent quant à la conception d’un enseignement en éthique clinique qui soit valide et efficient pour ces jeunes praticiens. Dans cet essai, nous tenterons d’esquisser des pistes de réponses à ce champ large de questionnements, à partir de notre expérience vécue en tant que résidents. Après avoir examiné certaines spécificités du dispositif pédagogique dont nous avons bénéficié au sein du programme de résidence en psychiatrie à l’Université de Sherbrooke, nous analyserons en quoi la structure du cursus proposé peut être un exemple positif pour une formation en éthique adéquate pour les jeunes professionnels de santé que sont les résidents. Plus spécifiquement, nous mettrons en évidence comment le fait de créer un espace pour accueillir la souffrance du soignant en formation peut avoir un impact sur sa propre sensibilité à la souffrance du sujet qu’il soigne.

Training evaluation: a configurational analysis of success and failure of trainers and trainees

Purpose

This study aims to investigate the formative evaluations of the training programmes of a Portuguese national railway public company for an entire calendar year. The aim is to uncover alternative configurations for the design of training programmes to create better levels of evaluation. This study is based on the following research question: What are the configurations that lead to the success and or failure of trainers and trainees? Among those, are there any common designs that generate the success and or failure of both trainers and trainees?

Design/methodology/approach

This study used matched data from an entire calendar year to examine the trainers and trainees’ evaluations of 429 training events. This study also used a fuzzy-set qualitative comparative analysis (fsQCA) to provide configurations that generate the success or failure of trainers and trainees. This methodology offers alternative pathways to the same outcomes and thus gives managers different options to reach similar results.

Findings

The results show that there are more configurations that lead to trainers’ success (five) than to its absence (four). However, the configurations that lead to trainees’ success (three) are less than those that lead to its absence (six). The findings indicate that a single common configuration exists that leads to high evaluations.

Research limitations/implications

This study does not address summative evaluations. Regarding data, the study acknowledges the use of self-evaluations for trainees, although they serve as a proxy for a learning evaluation. The generalisation of the results outside the Portuguese railway company’s context is not possible.

Practical implications

The proposed analysis is applicable to other settings without restrictions. Managers may replicate this study’s approach in their organisations to uncover the alternative configurations that lead to the success or failure of trainers and trainees. They may adopt the ones that lead to successful outcomes and avoid the ones that lead to undesired ones.

Originality/value

This study is innovative because it addresses concurrently the success or failure of trainers and trainees that is only possible by using the fsQCA method. This study opted to use this method to provide alternative pathways to extreme outcomes: the most successful or the most unsuccessful. These multiple pathways are better results compared to traditional quantitative statistical methods that only provide a single estimated solution to the presence of the dependent variable; for example, a regression analysis or structural equation modelling.

Recommendations for Effective Integration of Ethics and Responsible Conduct of Research (E/RCR) Education into Course-Based Undergraduate Research Experiences: A Meeting Report

Advancement of the scientific enterprise relies on individuals conducting research in an ethical and responsible manner. Educating emergent scholars in the principles of ethics/responsible conduct of research (E/RCR) is therefore critical to ensuring such advancement. The recent impetus to include authentic research opportunities as part of the undergraduate curriculum, via course-based undergraduate research experiences (CUREs), has been shown to increase cognitive and noncognitive student outcomes. Because of these important benefits, CUREs are becoming more common and often constitute the first research experience for many students. However, despite the importance of E/RCR in the research process, we know of few efforts to incorporate E/RCR education into CUREs. The Ethics Network for Course-based Opportunities in Undergraduate Research (ENCOUR) was created to address this concern and promote the integration of E/RCR within CUREs in the biological sciences and related disciplines. During the inaugural ENCOUR meeting, a four-pronged approach was used to develop guidelines for the effective integration of E/RCR in CUREs. This approach included: 1) defining appropriate student learning objectives; 2) identifying relevant curriculum; 3) identifying relevant assessments; and 4) defining key aspects of professional development for CURE facilitators. Meeting outcomes, including the aforementioned E/RCR guidelines, are described herein.

Ownership-based asymmetries in training evaluation practices of call centres

Purpose

The purpose of this paper is to explore the underlying asymmetries in training evaluation practices of call centre (CC) firms based on their “in-house” and “subcontractor” ownership heterogeneity.

Design/methodology/approach

The data for this qualitative inquiry were collected from key informants of 13 different CCs in Pakistan through semi-structured interviews.

Findings

The findings revealed various asymmetries in training evaluation practices among in-house and subcontractor CCs based on five different dimensions of two renowned training evaluation frameworks.

Practical implications

Training evaluation professionals can benefit from training evaluation methods identified in this study for measuring training evaluation practice and advancing future research.

Originality/value

This study has theoretically contributed to the existing research on firm heterogeneity and human resource management by focussing on training evaluation practices in CCs.

Continuous Evaluation in Ethics Education: A Case Study

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

Review of Instructional Approaches in Ethics Education

Increased investment in ethics education has prompted a variety of instructional objectives and frameworks. Yet, no systematic procedure to classify these varying instructional approaches has been attempted. In the present study, a quantitative clustering procedure was conducted to derive a typology of instruction in ethics education. In total, 330 ethics training programs were included in the cluster analysis. The training programs were appraised with respect to four instructional categories including instructional content, processes, delivery methods, and activities. Eight instructional approaches were identified through this clustering procedure, and these instructional approaches showed different levels of effectiveness. Instructional effectiveness was assessed based on one of nine commonly used ethics criteria. With respect to specific training types, Professional Decision Processes Training (d = 0.50) and Field-Specific Compliance Training (d = 0.46) appear to be viable approaches to ethics training based on Cohen's d effect size estimates. By contrast, two commonly used approaches, General Discussion Training (d = 0.31) and Norm Adherence Training (d = 0.37), were found to be considerably less effective. The implications for instruction in ethics training are discussed.

Validation and Use of a Predictive Modeling Tool: Employing Scientific Findings to Improve Responsible Conduct of Research Education

Although recent evidence suggests ethics education can be effective, the nature of specific training programs, and their effectiveness, varies considerably. Building on a recent path modeling effort, the present study developed and validated a predictive modeling tool for responsible conduct of research education. The predictive modeling tool allows users to enter ratings in relation to a given ethics training program and receive instantaneous evaluative information for course refinement. Validation work suggests the tool's predicted outcomes correlate strongly (r = 0.46) with objective course outcomes. Implications for training program development and refinement are discussed.

Are Ethics Training Programs Improving? A Meta-Analytic Review of Past and Present Ethics Instruction in the Sciences

Given the growing public concern and attention placed on cases of research misconduct, government agencies and research institutions have increased their efforts to develop and improve ethics education programs for scientists. The present study sought to assess the impact of these increased efforts by sampling empirical studies published since the year 2000. Studies published prior to 2000 examined in other meta-analytic work were also included to provide a baseline for assessing gains in ethics training effectiveness over time. In total,this quantitative review consisted of 66 empirical studies, 106 ethics courses, 150 effect sizes, and 10,069 training participants. Overall, the findings indicated that ethics instruction resulted in sizable benefits to participants and has improved considerably within the last decade. A number of specific findings also emerged regarding moderators of instructional effectiveness. Recommendations are discussed for improving the development, delivery, and evaluation of ethics instruction in the sciences.