1
|
Michael M, Griggs AC, Shields IH, Sadighi M, Hernandez J, Chan C, McHugh M, Nichols BE, Joshi K, Testa D, Raj S, Preble R, Lazzara EH, Greilich PE. Improving handover competency in preclinical medical and health professions students: establishing the reliability and construct validity of an assessment instrument. BMC MEDICAL EDUCATION 2021; 21:518. [PMID: 34600497 PMCID: PMC8487478 DOI: 10.1186/s12909-021-02943-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Accepted: 09/15/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND As part of the worldwide call to enhance the safety of patient handovers of care, the Association of American Medical Colleges (AAMC) requires that all graduating students "give or receive a patient handover to transition care responsibly" as one of its Core Entrustable Professional Activities (EPAs) for Entering Residency. Students therefore require educational activities that build the necessary teamwork skills to perform structured handovers. To date, a reliable instrument designed to assess teamwork competencies, like structured communication, throughout their preclinical and clinical years does not exist. METHOD Our team developed an assessment instrument that evaluates both the use of structured communication and two additional teamwork competencies necessary to perform safe patient handovers. This instrument was utilized to assess 192 handovers that were recorded from a sample of 229 preclinical medical students and 25 health professions students who participated in a virtual course on safe patient handovers. Five raters were trained on utilization of the assessment instrument, and consensus was established. Each handover was reviewed independently by two separate raters. RESULTS The raters achieved 72.22 % agreement across items in the reviewed handovers. Krippendorff's alpha coefficient to assess inter-rater reliability was 0.6245, indicating substantial agreement among the raters. A confirmatory factor analysis (CFA) demonstrated the orthogonal characteristics of items in this instrument with rotated item loadings onto three distinct factors providing preliminary evidence of construct validity. CONCLUSIONS We present an assessment instrument with substantial reliability and preliminary evidence of construct validity designed to evaluate both use of structured handover format as well as two team competencies necessary for safe patient handovers. Our assessment instrument can be used by educators to evaluate learners' handoff performance as early as their preclinical years and is broadly applicable in the clinical context in which it is utilized. In the journey to optimize safe patient care through improved teamwork during handovers, our instrument achieves a critical step in the process of developing a validated assessment instrument to evaluate learners as they seek to accomplish this goal.
Collapse
Affiliation(s)
- Meghan Michael
- Department of Anesthesiology and Pain Management, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Mail Code 9068, Dallas, TX 75390 USA
| | - Andrew C. Griggs
- Department of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, 1 Aerospace Blvd, Daytona Beach, FL 32114 USA
| | - Ian H. Shields
- Office of Quality, Safety, and Outcomes Education, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Mozhdeh Sadighi
- Department of Undergraduate Medical Education, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Jessica Hernandez
- Department of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Chrissy Chan
- Department of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Mary McHugh
- Department of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Blake E. Nichols
- Department of Pediatrics, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Mail Code 9063, Dallas, TX 75390 USA
| | - Kavita Joshi
- Department of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Daniel Testa
- Department of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Sonika Raj
- Department of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Richard Preble
- Office of Quality, Safety, and Outcomes Education, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390 USA
| | - Elizabeth H. Lazzara
- Department of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, 1 Aerospace Blvd, Daytona Beach, FL 32114 USA
| | - Philip E. Greilich
- Department of Anesthesiology and Pain Management, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Mail Code 9068, Dallas, TX 75390 USA
| |
Collapse
|
2
|
Abstract
OBJECTIVE Human factors and ergonomics (HF/E) frameworks and methods are becoming embedded in the health informatics community. There is now broad recognition that health informatics tools must account for the diverse needs, characteristics, and abilities of end users, as well as their context of use. The objective of this review is to synthesize the current nature and scope of HF/E integration into the health informatics community. METHODS Because the focus of this synthesis is on understanding the current integration of the HF/E and health informatics research communities, we manually reviewed all manuscripts published in primary HF/E and health informatics journals during 2020. RESULTS HF/E-focused health informatics studies included in this synthesis focused heavily on EHR customizations, specifically clinical decision support customizations and customized data displays, and on mobile health innovations. While HF/E methods aimed to jointly improve end user safety, performance, and satisfaction, most HF/E-focused health informatics studies measured only end user satisfaction. CONCLUSION HF/E-focused health informatics researchers need to identify and communicate methodological standards specific to health informatics, to better synthesize findings across resource intensive HF/E-focused health informatics studies. Important gaps in the HF/E design and evaluation process should be addressed in future work, including support for technology development platforms and training programs so that health informatics designers are as diverse as end users.
Collapse
|
3
|
Cuffy C, Hagiwara N, Vrana S, McInnes BT. Measuring the quality of patient-physician communication. J Biomed Inform 2020; 112:103589. [PMID: 33035705 DOI: 10.1016/j.jbi.2020.103589] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 10/01/2020] [Accepted: 10/04/2020] [Indexed: 11/30/2022]
Abstract
Patient-physician communication is an often overlooked yet a very important aspect of providing medical care. Positive patient-physician quality of communication within discourse has an influence on various aspects of a consultation such as a patient's treatment adherence to prescribed medical regimen and their medical care outcome. As few reference standards exist for exploring semantics within the patient-physician setting and its effects on personalized healthcare, this paper presents a study exploring three methods to capture, model and evaluate patient-physician communication among three distinct data-sources. We introduce, compare and contrast these methods for capturing and modeling patient-physician communication quality using relatedness between discourse content within a given consultation. Results are shown for all three data-sources and communication quality scores among physicians recorded. We found our models demonstrate the ability to capture positive communication quality between both participants within a consultation. We also evaluate these findings against self-reported questionnaires highlighting various aspects of the consultation and rank communication quality among seventeen physicians who consulted amid one-hundred and thirty-two patients.
Collapse
Affiliation(s)
- Clint Cuffy
- Virginia Commonwealth University, 401 S. Main St., Richmond, VA 23284, USA.
| | - Nao Hagiwara
- Virginia Commonwealth University, 401 S. Main St., Richmond, VA 23284, USA
| | - Scott Vrana
- Virginia Commonwealth University, 401 S. Main St., Richmond, VA 23284, USA
| | - Bridget T McInnes
- Virginia Commonwealth University, 401 S. Main St., Richmond, VA 23284, USA
| |
Collapse
|