A developmental trajectory supporting the evaluation and achievement of competencies: Articulating the Mastery Rubric for the nurse practitioner (MR-NP) program curriculum

A Sisyphean task: Developing and revising public health nursing competencies

BACKGROUND

Competencies are intended to enhance the public health workforce's skills. Competencies used to evaluate public health nursing (PHN) practice and education have been promoted by several nursing organizations. Having multiple sets of competencies raises questions about redundancies and their usefulness in evaluating PHN, as well as the central question about the value of the competencies themselves.

METHODS

A literature review of psychometric evaluation research of the competencies was performed. Qualitative content analyses were conducted of seven documents: Association of Community Health Nursing Educators', 2000 and 2010 essentials; Quad Council Coalition's 2004, 2011, and 2018 competencies; and the American Nurses Association's, 2013 and the 2021 draft of PHN scope and standards of practice with respect to competency definition, conceptual basis, and use of an established taxonomy.

RESULTS

No psychometric evaluations of the competency sets were found. Textual content analysis revealed inconsistent and or missing competency definitions and theoretical frameworks with competencies proliferating over time. Taxonomy analysis identified minimal competencies at higher complexity levels according to Bloom's revised taxonomy.

CONCLUSIONS

Analyzed competencies lack reliability and validity testing, making assessment difficult for PHN educators and practitioners. Multiple and competing competencies further erode PHN's visibility, even among public health nurses. With unending revisions of PHN competencies and lack of supporting evidence regarding their effect and their integration into education or practice, recommendations for future efforts are offered.

Content Validation of the Quality and Safety Framed Clinical Evaluation for Nurse Practitioner Students

BACKGROUND

Clinical performance evaluation is a high-stakes assessment that requires a valid and reliable instrument. There appear to be no identified clinical evaluation instruments developed for nurse practitioner (NP) students that have undergone content validation.

PURPOSE

This study describes the process to develop, validate, and pilot a clinical evaluation instrument for NP students framed in the Quality and Safety Education of Nurses Competencies for advanced practice.

METHODS

Six expert nurse educators were recruited for the purpose of rating items for relevance for inclusion in the Quality and Safety Framed Clinical Evaluation Instrument for NP Students using the content validity index. The instrument was pilot tested in a primary care clinical course.

RESULTS

Two rounds of review yielded a 34-item content validated instrument.

CONCLUSIONS

Evidence suggests that the Quality and Safety Framed Clinical Evaluation for NP Students is a valid and reliable instrument to evaluate the clinical performance of NP students.

The Preparation of Stewards with the Mastery Rubric for Stewardship: Re-Envisioning the Formation of Scholars and Practitioners

A steward of the discipline was originally defined as “someone who will creatively generate new knowledge, critically conserve valuable and useful ideas, and responsibly transform those understandings through writing, teaching, and application”. This construct was articulated to support and strengthen doctoral education. The purpose of this paper is to expand the construct of stewardship so that it can be applied to both scholars and non-academic practitioners, and can be initiated earlier than doctoral education. To accomplish and justify this, we describe a general developmental trajectory supporting cross-curriculum teaching for stewardship of a discipline as well as of a profession. We argue that the most important features of stewardship, comprising the public trust for the future of their discipline or profession, are obtainable by all practitioners, and are not limited to those who have completed doctoral training. The developmental trajectory is defined using the Mastery Rubric construct, which requires articulating the knowledge, skills, and abilities (KSAs) to be targeted with a curriculum; recognizable stages of performance of these KSAs; and performance level descriptors of each KSA at each stage. Concrete KSAs of stewardship that can be taught and practiced throughout the career (professional or scholarly) were derived directly from the original definition. We used the European guild structure’s stages of Novice, Apprentice, Journeyman, and Master for the trajectory, and through a consensus-based standard setting exercise, created performance level descriptors featuring development of Bloom’s taxonometric cognitive abilities (see Appendix A) for each KSA. Together, these create the Mastery Rubric for Stewardship (MR-S). The MR-S articulates how stewardly behavior can be cultivated and documented for individuals in any disciplinary curriculum, whether research-intensive (preparing “scholars”) or professional (preparing members of a profession or more generally for the work force). We qualitatively assess the validity of the MR-S by examining its applicability to, and concordance with professional practice standards in three diverse disciplinary examples: (1) History; (2) Statistics and Data Science; and (3) Neurosciences. These domains differ dramatically in terms of content and methodologies, but students in each discipline could either continue on to doctoral training and scholarship, or utilize doctoral or pre-doctoral training in other professions. The MR-S is highly aligned with the practice standards of all three of these domains, suggesting that stewardship can be meaningfully cultivated and utilized by those working in or outside of academia, supporting the initiation of stewardship prior to doctoral training and for all students, not only those who will earn PhDs or be scholars first and foremost. The MR-S can be used for curriculum development or revision in order to purposefully promote stewardship at all levels of higher education and beyond. The MR-S renders features of professional stewardship accessible to all practitioners, enabling formal and informal, as well as self-directed, development and refinement of a professional identity.

The Mastery Rubric for Bioinformatics: A tool to support design and evaluation of career-spanning education and training

As the life sciences have become more data intensive, the pressure to incorporate the requisite training into life-science education and training programs has increased. To facilitate curriculum development, various sets of (bio)informatics competencies have been articulated; however, these have proved difficult to implement in practice. Addressing this issue, we have created a curriculum-design and -evaluation tool to support the development of specific Knowledge, Skills and Abilities (KSAs) that reflect the scientific method and promote both bioinformatics practice and the achievement of competencies. Twelve KSAs were extracted via formal analysis, and stages along a developmental trajectory, from uninitiated student to independent practitioner, were identified. Demonstration of each KSA by a performer at each stage was initially described (Performance Level Descriptors, PLDs), evaluated, and revised at an international workshop. This work was subsequently extended and further refined to yield the Mastery Rubric for Bioinformatics (MR-Bi). The MR-Bi was validated by demonstrating alignment between the KSAs and competencies, and its consistency with principles of adult learning. The MR-Bi tool provides a formal framework to support curriculum building, training, and self-directed learning. It prioritizes the development of independence and scientific reasoning, and is structured to allow individuals (regardless of career stage, disciplinary background, or skill level) to locate themselves within the framework. The KSAs and their PLDs promote scientific problem formulation and problem solving, lending the MR-Bi durability and flexibility. With its explicit developmental trajectory, the tool can be used by developing or practicing scientists to direct their (and their team's) acquisition of new, or to deepen existing, bioinformatics KSAs. The MR-Bi is a tool that can contribute to the cultivation of a next generation of bioinformaticians who are able to design reproducible and rigorous research, and to critically analyze results from their own, and others', work.