A review of the design and development processes of simulation for training in healthcare - A technology-centered versus a human-centered perspective

Designing digital patient experiences: The digital health design framework

BACKGROUND

Digital health (DH) brings considerable benefits, but it comes with potential risks. Human Factors (HF) play a critical role in providing high-quality and acceptable DH solutions. Consultation with designers is crucial for reflecting on and improving current DH design practices.

OBJECTIVES

We investigated the general DH design processes, challenges, and corresponding strategies that can improve the digital patient experience (PEx).

METHODS

A semi-structured interview study with 24 design professionals. All audio recordings were transcribed, deidentified, grammatically corrected, and imported into ATLAS.ti for data analysis. Three coders participated in data coding following the thematic analysis approach.

RESULTS

We identified eight DH design stages and grouped them into four phases: preparation, problem-thinking, problem-solving, and implementation. The analysis presented twelve design challenges associated with contextual, practical, managerial, and commercial aspects that can hinder the design process. We identified eight common strategies used by respondents to tackle these challenges.

CONCLUSIONS

We propose a Digital Health Design (DHD) framework to improve the digital PEx. It provides an overview of design deliverables, activities, stakeholders, challenges, and corresponding strategies for each design stage.

Human-Centered Design and Benefit Realization Management in Digital Health Care Solution Development: Protocol for a Systematic Review

BACKGROUND

Earlier research shows that a significant number of resources are wasted on software projects delivering less than the planned benefits. It has, however, been evidenced that adopting a human-centered design approach when designing health devices can be beneficial. This understanding from earlier research has raised our interest in investigating how human-centered design might contribute to realizing the potential benefits of health care software projects. To our current knowledge, this intersection of human-centered design and benefit realization management has not yet comprehensively and consistently been researched within the context of digital health care solutions. Therefore, there is a need for evidence synthesis using systematic reviews to address this potential research gap.

OBJECTIVE

The objective of this study is to examine if human-centered design helps benefit realization management processes in the development of digital health care solutions and thereby enables better benefit realization. We explore the evidence of assumed or confirmed benefits of using human-centered design in the health care domain and whether better results have been reported when the benefit realization management process is followed.

METHODS

This protocol was developed following the PRISMA-P (Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols) guidelines. The proposed review would use a planned and systematic approach to identify, evaluate, and synthesize relevant and recent studies (reported in English) to see if there is evidence that using human-centered design and benefit realization management has a positive effect on realizing set benefits in those projects. We will commence a systematic literature search using human-centered design, benefit realization management, and health care-related search terms within 5 repositories (ACM Digital Library, PubMed Central, Scopus, PubMed, and Web of Science). After removing duplicate results, a preliminary scan for titles and abstracts will be done by at least 2 reviewers. Any incongruities regarding whether to include articles for full-text review will be resolved by a third reviewer based on the predefined criteria.

RESULTS

Initial queries of 2086 records have been executed and papers are being prescreened for inclusion. The search was initiated in December 2023 and the results are expected in 2024. We anticipate finding evidence of the use of human-centered design in the development of digital health care solutions. However, we expect evidence of benefitting from both human-centered design and benefit realization management in this context to be scarce.

CONCLUSIONS

This protocol will guide the review of existing literature on the use of human-centered design and benefit realization management when developing digital health care solutions. The review will specifically focus on finding evidence of confirmed benefits derived from the use of human-centered design and benefit realization management. There may be an opportunity to gain a broader understanding of the tools or approaches that provide evidence of increased benefit realization within the health care domain.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/56125.

Human-centered design in the context of social determinants of health in maternity care: methods for meaningful stakeholder engagement

PURPOSE

The screening process for social determinants of health (SDoH) includes questions regarding life circumstances and barriers to accessing health care. For patients, these questions may be intrusive, biased, and potentially risky. This article describes human-centered design methods to engage birthing parents and health care team members around SDoH screening and referral in maternity care.

METHODS

Three phases of qualitative research with birthing parents, health care teams, and hospital administrators were conducted in the United States. Shadowing, interviews, focus groups, and participatory workshops addressed the explicit and tacit concerns of the stakeholders regarding SDoH during maternity care.

RESULTS

Birthing parents wanted to be informed of the purpose of the clinic collecting SDoH information and how this information is used. Health care teams want to feel they are providing reliable and quality resources to their patients. They would like greater transparency that administrators are acting on SDoH data and the information is reaching people that can assist patients.

CONCLUSION

As clinics implement patient-centered strategies for addressing SDoH in maternity care, it is important to include patients' perspectives. This human-centered design approach advances understanding of knowledge and emotional needs around SDoH and offers insights to meaningful engagement around sensitive health data.

Roadmapping 5.0 Technologies in Agriculture: A Technological Proposal for Developing the Coffee Plant Centered on Indigenous Producers' Requirements from Mexico, via Knowledge Management

The coffee plant, with more than 40 billion shrubs, 9 million tons of grains produced, and 80% of its production accounted for by small-scale producers, has been severely damaged since the emergence of Hemileia vastatrix and Hypothenemus hampei. Despite technological support, these pests have caused 20% to 40% production losses, a 50% to 60% deficit in performance, and a cost of between USD 70 million and USD 220 million to the world economies, which forces us to rethink actions centered on people as the key elements to develop appropriate solutions. For this, the present study presents a technological proposal centered on small indigenous coffee producer requirements for introducing Industry 5.0 technologies, considering roadmapping, knowledge management, statistical analysis, and the social, productive, and digital contexts of five localities in Mexico. The results show a correlation between monitoring and control, soil analysis, the creation of organic fertilizers, accompaniment, and coffee experimentation, as the actions to be implemented, proposing the introduction of a mobile application; sensors, virtual platforms, dome-shaped greenhouses, and spectrophotometric technology as relevant technologies centered on indigenous coffee producers' requirements. This study is important for policymakers, academics, and producers who wish to develop strategies centered on people in Mexico and the world.

Working With Robots: Human Resource Development Considerations in Human–Robot Interaction

Advancements in robotic technology have accelerated the adoption of collaborative robots in the workplace. The role of humans is not reduced, but robotic technology requires different high-level responsibilities in human–robot interaction (HRI). Based on a human-centered perspective, this literature review is to explore current knowledge on HRI through the lens of HRD and propose the roles of HRD in this realm. The review identifies HRD considerations that help implement effective HRI in three human-centered domains: human capabilities, collaboration configuration, and attributes related to contact. The eight HRD considerations include employees’ attitudes toward robots, their readiness for robot technology, communication with robots, human–robot team building, leading multiple robots, systemwide collaboration, safety interventions, and ethical issues. Theoretical implications, practical implications, and limitations are discussed. This paper contributes to HRD by introducing potential areas of multidisciplinary collaborations to help organizations implement robotic systems.

Hospital preparedness during epidemics using simulation: the case of COVID-19

This paper presents a discrete event simulation model to support decision-making for the short-term planning of hospital resource needs, especially Intensive Care Unit (ICU) beds, to cope with outbreaks, such as the COVID-19 pandemic. Given its purpose as a short-term forecasting tool, the simulation model requires an accurate representation of the current system state and high fidelity in mimicking the system dynamics from that state. The two main components of the simulation model are the stochastic modeling of patient admission and patient flow processes. The patient arrival process is modelled using a Gompertz growth model, which enables the representation of the exponential growth caused by the initial spread of the virus, followed by a period of maximum arrival rate and then a decreasing phase until the wave subsides. We conducted an empirical study concluding that the Gompertz model provides a better fit to pandemic-related data (positive cases and hospitalization numbers) and has superior prediction capacity than other sigmoid models based on Richards, Logistic, and Stannard functions. Patient flow modelling considers different pathways and dynamic length of stay estimation in several healthcare stages using patient-level data. We report on the application of the simulation model in two Autonomous Regions of Spain (Navarre and La Rioja) during the two COVID-19 waves experienced in 2020. The simulation model was employed on a daily basis to inform the regional logistic health care planning team, who programmed the ward and ICU beds based on the resulting predictions.

A Virtual Smash Room for Venting Frustration or Just Having Fun: Participatory Design of Virtual Environments in Digitally Reinforced Cancer Rehabilitation

BACKGROUND

Cancer rehabilitation is central for helping patients and relatives create a functional everyday life based on the changes in life conditions. The needs are highly individual and include physical, mental, and social challenges. Cancer rehabilitation programs offer coping strategies, including guidelines on how to handle emotions.

OBJECTIVE

This paper presents a participatory design activity where patients in cancer rehabilitation use a virtual smash room, which is a virtual environment where the user can break things, mainly porcelain or glass items such as vases or plates. The objective is to understand attitudes to, and some effects of, using this application, as well as eliciting ideas of other virtual environments that would be desired.

METHODS

The virtual environment presented here, the virtual smash room, was designed at the request of a patient with cancer who wanted a tool for venting frustration. In this virtual environment, the user can break porcelain, vases, and plates. Patients participating in a week-long cancer rehabilitation program tested the virtual smash room and reported their experiences through a questionnaire. The questionnaire comprised three sections: (1) a subset of the Intrinsic Motivation Inventory (IMI), (2) a subset of the Virtual Reality Symptoms Questionnaire (VRSQ), and (3) a free-text response section.

RESULTS

A total of 101 responses were gathered. The results from the IMI questions showed that the participants found the virtual experience enjoyable (mean 4.52, maximum 5, SD 0.73), and it helped them retain their focus (mean 4.44, maximum 5, SD 0.74). The VRSQ revealed that there were only minor symptoms related to general discomfort (5.9%, n=6), fatigue (5.9%, n=6), nausea (3.0%, n=3), and tired eyes (8.9%, n=9), while several participants experienced dizziness (22.8%, n=23). Since only postmeasurements were gathered, nothing could be concluded about the prevalence of these symptoms before testing. The free-text responses indicated that the user group had many ideas for other virtual environments to use in cancer rehabilitation.

CONCLUSIONS

This study presents a concept of using virtual reality in the cancer rehabilitation process and exemplifies activities of patient participation in the design process. Virtual reality has potential in being both distracting and enjoyable, while certain aspects of cybersickness might be especially important to consider for a user group already experiencing physical and mental issues. The results will act as input in the process of further designing virtual applications in digitally reinforced cancer rehabilitation.

Involvement of End Users in the Development of Serious Games for Health Care Professions Education: Systematic Descriptive Review

BACKGROUND

On the basis of ethical and methodological arguments, numerous calls have been made to increase the involvement of end users in the development of serious games (SGs). Involving end users in the development process is considered a way to give them power and control over educational software that is designed for them. It can also help identify areas for improvement in the design of SGs and improve their efficacy in targeted learning outcomes. However, no recognized guidelines or frameworks exist to guide end users' involvement in SG development.

OBJECTIVE

The aim of this study is to describe how end users are involved in the development of SGs for health care professions education.

METHODS

We examined the literature presenting the development of 45 SGs that had reached the stage of efficacy evaluation in randomized trials. One author performed data extraction using an ad hoc form based on a design and development framework for SGs. Data were then coded and synthesized on the basis of similarities. The coding scheme was refined iteratively with the involvement of a second author. Results are presented using frequencies and percentages.

RESULTS

End users' involvement was mentioned in the development of 21 of 45 SGs. The number of end users involved ranged from 12 to 36. End users were often involved in answering specific concerns that arose during the SG design (n=6) or in testing a prototype (n=12). In many cases, researchers solicited input from end users regarding the goals to reach (n=10) or the functional esthetics of the SGs (n=7). Most researchers used self-reported questionnaires (n=7).

CONCLUSIONS

Researchers mentioned end users' involvement in the development of less than half of the identified SGs, and this involvement was also poorly described. These findings represent significant limitations to evaluating the impact of the involvement of end users on the efficacy of SGs and in making recommendations regarding their involvement.

TECHNOLOGY TRANSFER ASSISTANCE PROJECT BRINGS VA HEALTH CARE IDEAS TO LIFE

Clinicians and staff of the Department of Veterans Affairs Health Care System (VA), who provide services to veterans, have invented many devices and methods for improving veterans' lives. However, translating those inventions to the market has been a challenge due to limited collaboration between the clinical inventors and the scientists, researchers, and engineers who can produce the prototypes necessary for licensing the technology. The VA Technology Transfer Program office and the Human Engineering Research Laboratories, a research laboratory with experience with developing prototypes and licensing technology, jointly developed a program called the Technology Transfer Assistance Project (TTAP) to bridge the gap between clinical inventors and prototypes ready for licensing. This paper describes TTAP and provides examples of the first inventions that were developed or enhanced through TTAP.

Health Care Providers' Performance, Mindset, and Attitudes Toward a Neonatal Resuscitation Computer-Based Simulator: Empirical Study

BACKGROUND

Neonatal resuscitation involves a complex sequence of actions to establish an infant's cardiorespiratory function at birth. Many of these responses, which identify the best action sequence in each situation, are taught as part of the recurrent Neonatal Resuscitation Program training, but they have a low incidence in practice, which leaves health care providers (HCPs) less prepared to respond appropriately and efficiently when they do occur. Computer-based simulators are increasingly used to complement traditional training in medical education, especially in the COVID-19 pandemic era of mass transition to digital education. However, it is not known how learners' attitudes toward computer-based learning and assessment environments influence their performance.

OBJECTIVE

This study explores the relation between HCPs' attitudes toward a computer-based simulator and their performance in the computer-based simulator, RETAIN (REsuscitation TrAINing), to uncover the predictors of performance in computer-based simulation environments for neonatal resuscitation.

METHODS

Participants were 50 neonatal HCPs (45 females, 4 males, 1 not reported; 16 respiratory therapists, 33 registered nurses and nurse practitioners, and 1 physician) affiliated with a large university hospital. Participants completed a demographic presurvey before playing the game and an attitudinal postsurvey after completing the RETAIN game. Participants' survey responses were collected to measure attitudes toward the computer-based simulator, among other factors. Knowledge on neonatal resuscitation was assessed in each round of the game through increasingly difficult neonatal resuscitation scenarios. This study investigated the moderating role of mindset on the association between the perceived benefits of understanding the terminology used in the computer-based simulator, RETAIN, and their performance on the neonatal resuscitation tasks covered by RETAIN.

RESULTS

The results revealed that mindset moderated the relation between participants' perceived terminology used in RETAIN and their actual performance in the game (F3,44=4.56, R2=0.24, adjusted R2=0.19; P=.007; estimate=-1.19, SE=0.38, t44=-3.12, 95% CI -1.96 to -0.42; P=.003). Specifically, participants who perceived the terminology useful also performed better but only when endorsing more of a growth mindset; they also performed worse when endorsing more of a fixed mindset. Most participants reported that they enjoyed playing the game. The more the HCPs agreed that the terminology in the tutorial and in the game was accessible, the better they performed in the game, but only when they reported endorsing a growth mindset exceeding the average mindset of all the participants (F3,44=6.31, R2=0.30, adjusted R2=0.25; P=.001; estimate=-1.21, SE=0.38, t44=-3.16, 95% CI -1.99 to -0.44; P=.003).

CONCLUSIONS

Mindset moderates the strength of the relationship between HCPs' perception of the role that the terminology employed in a game simulator has on their performance and their actual performance in a computer-based simulator designed for neonatal resuscitation training. Implications of this research include the design and development of interactive learning environments that can support HCPs in performing better on neonatal resuscitation tasks.

The national health information technology human factors and ergonomics agenda

Health information technology (IT) implementation has encompassed much of the United States health care system over the past decade, and user frustration with health IT has steadily increased. Human factors and ergonomics (HFE) methods and approaches can improve the design, implementation, and use of health IT for clinicians and consumers. To better understand the effect of federal HFE in health IT research funding, the authors conducted a review of several key, specific initiatives. The review focused on the goals and accomplishments of these initiatives. Findings to date show that HFE is improving the usefulness of health IT, but additional research and new methods are needed. Corresponding research funding and policy priorities are identified. New HFE work and innovative approaches are needed to capitalize on HFE knowledge, principles, and methods to improve the design, implementation, and use of health IT at a broader scale.

Midwifery students’ retention of learning after screen-based simulation training on neonatal resuscitation: a pilot study

Simulation in medical education is widely used to teach both technical and non-technical skills. The use of tools such as screen-based simulation raises the question of their efficiency and the retention rate for knowledge and skills. In this study, we measured midwives’ retention of learning after screen-based simulation training on neonatal resuscitation. 14 midwifery students participated in this pilot study. They undertook two screen-based simulation sessions 2 months apart. Measurements included a knowledge quiz, a self-efficacy assessment and two experts’ evaluations of the Anaesthetists’ Non-Technical Skills (ANTS) and Neonatal Resuscitation Performance Evaluation (NRPE) scoring (non-technical and technical skills, respectively). A demographic survey with open-ended questions on professional experience and learning concluded the study. We showed an improvement in the self-efficacy assessment (p<0.05), the knowledge quiz (p<0.01) and the ANTS evaluation (p<0.0001). However, there was no significant difference in the NRPE score. The students enjoyed the apprenticeship aspect of the screen-based simulation. Repeated exposure to a screen-based simulation on neonatal resuscitation could be advantageous for non-technical skills training, self-confidence and retention of knowledge. This is still a work in progress, undergoing further investigation with more participants and new variables.

A method for quantifying key components of the opening process for opening pouch-style packages containing medical devices

Healthcare-associated infections are a serious worldwide health concern. Although contaminated medical devices are an avenue for infection, little research has evaluated the techniques used to open sterile packages. The goal of this study was to develop a method to quantify aspects of the package opening process in accordance with opening guidelines and then to demonstrate this methodology through a small sample of clinicians opening two sizes of pouch-style packages. Using motion capture techniques, a method was designed to quantify 11 parameters associated with the opening process. The method was then tested with nine healthcare professionals. Results indicated that all participants crossed the sterile field when opening packages. When opening large packages, participants spent significantly more time over the simulated sterile field and there was a trend towards more manipulations as compared to opening smaller packages. This methodology can be used to quantify the opening process, compare opening practices, and for assessment during the learning process.

Quantifying the cognitive cost of laparo-endoscopic single-site surgeries: Gaze-based indices

BACKGROUND

Despite the growing interest concerning the laparo-endoscopic single-site surgery (LESS) procedure, LESS presents multiple difficulties and challenges that are likely to increase the surgeon's cognitive cost, in terms of both cognitive load and performance. Nevertheless, there is currently no objective index capable of assessing the surgeon cognitive cost while performing LESS. We assessed if gaze-based indices might offer unique and unbiased measures to quantify LESS complexity and its cognitive cost. We expect that the assessment of surgeon's cognitive cost to improve patient safety by measuring fitness-for-duty and reducing surgeons overload.

METHODS

Using a wearable eye tracker device, we measured gaze entropy and velocity of surgical trainees and attending surgeons during two surgical procedures (LESS vs. multiport laparoscopy surgery [MPS]). None of the participants had previous experience with LESS. They performed two exercises with different complexity levels (Low: Pattern Cut vs. High: Peg Transfer). We also collected performance and subjective data.

RESULTS

LESS caused higher cognitive demand than MPS, as indicated by increased gaze entropy in both surgical trainees and attending surgeons (exploration pattern became more random). Furthermore, gaze velocity was higher (exploration pattern became more rapid) for the LESS procedure independently of the surgeon's expertise. Perceived task complexity and laparoscopic accuracy confirmed gaze-based results.

CONCLUSION

Gaze-based indices have great potential as objective and non-intrusive measures to assess surgeons' cognitive cost and fitness-for-duty. Furthermore, gaze-based indices might play a relevant role in defining future guidelines on surgeons' examinations to mark their achievements during the entire training (e.g. analyzing surgical learning curves).