7 Themes for guiding situated ergonomic assessments of medical devices: a case study of an inpatient glucometer

Detectability of use errors in summative usability tests of medical devices: Impact of the test environment

The regulations on summative usability evaluations of medical devices (MDs) emphasize that the test environment must have sufficient ecological validity for generalization to real-life use. Here, we examined the influence of environmental fidelity (a component of ecological validity) on the detectability of MD use errors. A total of 140 participants participated in a summative usability evaluation of an anaphylactic shock auto-injector device under either a high-fidelity condition or a condition acceptable from the manufacturer's perspective, lower-fidelity condition. The numbers of errors detected in each condition were compared by applying descriptive statistics and logistic and Poisson multivariate regressions. We found that the level of fidelity did not influence the overall number of use errors detected but did influence the detection of certain use errors. To optimize the test environment and increase the detection of use errors, each environmental feature's role in the test task should first be examined.

Introducing a Remote Patient Monitoring Usability Impact Model to Overcome Challenges

Telehealth and remote patient monitoring (RPM), in particular, have been through a massive surge of adoption since 2020. This initiative has proven potential for the patient and the healthcare provider in areas such as reductions in the cost of care. While home-use medical devices or wearables have been shown to be beneficial, a literature review illustrates challenges with the data generated, driven by limited device usability. This could lead to inaccurate data when an exam is completed without clinical supervision, with the consequence that incorrect data lead to improper treatment. Upon further analysis of the existing literature, the RPM Usability Impact model is introduced. The goal is to guide researchers and device manufacturers to increase the usability of wearable and home-use medical devices in the future. The importance of this model is highlighted when the user-centered design process is integrated, which is needed to develop these types of devices to provide the proper user experience.

Human factors engineering for medical devices: European regulation and current issues

A large proportion of the patient injuries or deaths attributable to medical device (MD) misuse can be eliminated and/or mitigated by adopting an effective human factors and ergonomics (HFE) approach. The implementation of a usability engineering process is now mandatory for MD manufacturers seeking to obtain the European Union's CE Mark. Here, we describe the European Union's HFE regulation and highlight the challenges faced by (i) manufacturers implementing this regulation and (ii) regulatory bodies charged with assessing the compliance of usability files. In Europe, 95% of MD manufacturers are small- and medium-sized enterprises; compliance with the CE Mark regulations is a real challenge to their competitiveness. Levels of knowledge about HFE vary greatly from one regulatory organization to another, which can sometimes lead to very different expectations. We also present the specific use-related risk management approach required by the HFE regulation. Lastly, we focus on the limitations of the HFE regulation for MDs and on future HFE challenges in further reducing and/or eliminating MD use errors. The main challenge is the need to go beyond technology design and the premarket assessment and to look at the postproduction stage; the coupling between an MD and a sociotechnical system can lead to consequences that were not predicted during the design process. This implies the need to consider the emerging properties of technologies in use by involving all the stakeholders.

Usability issues in the operating room - Towards contextual design guidelines for medical device design

Most usability assessments of medical devices describe the problems of individual devices in detail, but few account for the real context of use or provide designers with actionable guidelines for improvement. To fill this gap, this paper reports the results of a case study on the usability of operating room technologies and documents the creation of contextual design guidelines for operating room device design. We spent 64 h in a gynecological operating unit conducting interviews with staff and observing device use during surgery. With qualitative analysis methods and based on existing usability principles, we created 21 design guidelines for the operating room context. The new guidelines highlight interactions between multiple devices, staff members, as well as other contextual factors. While the guidelines require further validation, they can potentially support the creation of more safe, ergonomic, and intuitive medical devices.

Study Protocol for Two-Steps Parallel Randomized Controlled Trial: Pre-Clinical Usability Tests for a New Double-Chamber Syringe

A new double-chamber syringe (DUO Syringe) was developed for intravenous drug administration and catheter flushing. This study presents a protocol for pre-clinical usability tests to validate the golden prototype of this new device, performed in a high-fidelity simulation lab by nurses. A two-steps parallel randomized controlled trial with two arms was designed (with standard syringes currently used in clinical practice and with the DUO Syringe). After randomization, eligible and consented participants will be requested to perform, individually, intravenous drug administration and flushing, following the arm that has been allocated. The procedure will be video-recorded for posterior analyses. After the completion of the tasks, nurses will be asked to answer a demographic survey, as well as an interview about their qualitative assessment of the device. A final focus group with all participants will also be conducted. Primary outcomes will concern the DUO Syringe's effectiveness, efficiency, and safety, while secondary outcomes will focus on nurses' satisfaction and intention of use. The pre-clinical protocol was defined according to the legal requirements and ISO norms and was reviewed and approved by the Ethics Committee of the Health Sciences Research Unit: Nursing of the Nursing School of Coimbra.

Impact of Design on Medical Device Safety

The growing number of emerging medical technologies and sophistication of modern medical devices (MDs) that improve both survival and quality of life indexes are often challenged by alarming cases of vigilance data cover-up and lack of sufficient pre- and post-authorization controls. Combining Quality with Risk Management processes and implementing them as early as possible in the design of MDs has proven to be an effective strategy to minimize residual risk. This article aims to discuss how the design of MDs interacts with their safety profile and how this dipole of intended performance and safety may be supported by Human Factors Engineering (HFE) throughout the Total Product Life-Cycle (TPLC) of an MD in order to capitalize on medical technologies without exposing users and patients to unnecessary risks.

Assessing the Usability of a Task-Shifting Device for Inserting Subcutaneous Contraceptive Implants for Use in Low-Income Countries

Women in low- and middle-income countries (LMICs) have limited access to long-acting contraceptives. Access to long-acting contraceptives, such as subcutaneous contraceptive implants, could be increased by task-shifting implant administration from advanced to minimally trained healthcare providers. The objective of this study was to investigate the usability of a task-shifting device for administering subcutaneous contraceptive implants. Healthcare providers (n = 128) from multiple health centers in Ethiopia were trained to administer implants on an arm simulator with the traditional method and a method using the device. Participants were observed while inserting implants into the arm simulator, and procedural error rates were calculated. Observations were analyzed using an iterative inductive coding methodology. For the device-assisted method, minimally trained healthcare providers had larger procedural error rates than other professions (p = 0.002). For the traditional method, physicians had larger procedural error rates than nurses and midwives (p = 0.03). Several procedural errors were identified such as participants inserting and removing the trocar and plunger completely or inserting and/or removing the trocar too far or not enough. These findings reinforce the importance of performing formative usability testing during the early phases of a medical device design process, considering users' mental models, and avoiding assumptions about healthcare providers' abilities.

Hand-Product Contact Point Detection on Surgical Instruments – A User Evaluation

The interaction of hand tools with the user is crucial and a key factor for his or her performance. In specific medical devices like surgical instruments, it is also important to ensure patient safety, namely, to avoid the risk of a surgical instrument’s being left inside a body.

This article investigates the patterns of hand-to-product contact areas by identifying the potential locations to couple an external add-on tracing device on surgical instruments. A user evaluation study was conducted to determine the contact areas between the surgeons’ hands and different surgical instruments. The methodology, the results, and a discussion are described below.

Reducing Treatment Errors Through Point-of-Care Glucometer Configuration

BACKGROUND

Blood glucose (BG) testing is the most widely performed point-of-care (POC) test in a hospital setting. Multiple adverse events reported to the Food and Drug Administration (FDA) revealed that treatment decisions may be affected by information displayed on the POC glucometer's results screen. A randomized, crossover simulation study was conducted to compare two results screen configurations for ACCU-CHEK Inform II, a POC glucometer.

METHODS

Prior to the study, a heuristic evaluation of the results screen configurations and a pilot study were conducted to select the two results screen configurations for comparison. At two multicampus medical centers, 66 nurse participants experienced two computer-based simulation scenarios that asked them to interpret glucometer readings and make treatment decisions for simulated patients with 32 mg/dL BG levels and subtle symptoms of hypoglycemia. One scenario displayed a numeric value ("32 mg/dL"), and the other displayed a range abbreviation, such as "RR LO" (out of reportable range; low). Treatment errors were recorded when the participant did not treat the hypoglycemic patient with glucose or when they administered insulin.

RESULTS

When ACCU-CHEK Inform II displayed an "RR LO" reading, 10.6% of participants made a treatment error, including 6.7% of participants with prior training on the meaning of an "RR LO" reading. None of the participants made a treatment error when ACCU-CHEK Inform II displayed a "32 mg/dL" reading.

CONCLUSION

Displaying a numeric BG reading eliminated potentially life-threating treatment errors caused by confusing range abbreviations. Manufacturers should consider these findings during future research and development of POC glucometers.

Qualitative ergonomics/human factors research in health care: Current state and future directions

The objective of this systematic review was to understand the current state of Ergonomics/Human Factors (E/HF) qualitative research in health care and to draw implications for future efforts. This systematic review identified 98 qualitative research papers published between January 2005 and August 2015 in the seven journals endorsed by the International Ergonomics Association with an impact factor over 1.0. The majority of the studies were conducted in hospitals and outpatient clinics, were focused on the work of formal health care professionals, and were classified as cognitive or organizational ergonomics. Interviews, focus groups, and observations were the most prevalent forms of data collection. Triangulation and data archiving were the dominant approaches to ensuring rigor. Few studies employed a formal approach to qualitative inquiry. Significant opportunities remain to enhance the use of qualitative research to advance systems thinking within health care.

See I told you I was taking it! - Attitudes of adolescents with asthma towards a device monitoring their inhaler use: Implications for future design

Adherence to treatment in asthma is often poor, particularly in adolescents and children where the condition is most prevalent. Electronic monitoring devices have shown potential for improving inhaler use, yet little research has considered the attitudes of patients towards these devices. We gave seven adolescents with asthma an electronic monitoring device to use for one month and collected their views on important issues including monitoring and data sharing. Our results showed that participants felt positively about using the data to demonstrate responsibility for their condition to both their parents and medical professionals, but expressed concern for the attention the device's appearance could draw to them and their asthma. This paper considers the positive and negative perceptions of this novel device and provides new insight into the attitudes of adolescents towards inhaler monitoring, as well as future directions for design and development of monitoring devices for asthma and other chronic medical conditions.

Usability Evaluation of a Blood Glucose Monitoring System With a Spill-Resistant Vial, Easier Strip Handling, and Connectivity to a Mobile App: Improvement of Patient Convenience and Satisfaction

BACKGROUND

Proper management of diabetes mellitus requires regular self-monitoring of blood glucose (SMBG). This research evaluated the usability of the Accu-Chek® Guide Meter that includes a spill-resistant vial, easier strip handling, and wireless connectivity to a mobile app.

METHODS

A total of 197 participants were allowed to experience typical blood glucose testing tasks on the Accu-Chek Guide Meter, review data such as last result, patterns, and target percentage on the meter and on the mobile app, and then evaluate their experience through a human factors usability survey. Participants used a 6-point agree/disagree scale to rate 34 market statement questions.

RESULTS

The results of a Pearson chi-square proportions test for each of the 34 market statement questions showed a significant difference (P < .0001) between the disagree responses (1-3) and agree responses (4-6). An overwhelming majority of participants found all aspects of the system, including the test strips, strip vial, and data analysis on the meter and the mobile app, to be a good fit for their lifestyle and to provide a better testing experience.

CONCLUSIONS

This study found superior usability of the new meter system over the participants' current meters in both the United States and France.

Combining situated Cognitive Engineering with a novel testing method in a case study comparing two infusion pump interfaces

We validated the usability of a new infusion pump interface designed with a situated Cognitive Engineering approach by comparing it to a reference interface using a novel testing method employing repeated measurements and process measures, in addition to traditional outcome measures. The sample consisted of 25 nurses who performed eight critical tasks three times. Performance measures consisted of number and type of errors, deviations from a pre-established normative path solution, task completion times, number of keystrokes, mental effort and preferences in use. Results showed that interaction with the new interface resulted in 18% fewer errors, 90% fewer normative path deviations, 42% lower task completion times, 40% fewer keystrokes, 39% lower mental effort and 76% more subjective preferences in use. These outcomes suggest that within the scope of this case study, combining the situated Cognitive Engineering approach with a novel testing method addresses various shortcomings of earlier testing methods.

A product-service system approach to telehealth application design

A considerable proportion of current point-of-care devices do not offer a wide enough set of capabilities if they are to function in any telehealth system. There is a need for intermediate devices that lie between healthcare devices and service networks. The development of an application is suggested that allows for a smartphone to take the role of an intermediate device. This research seeks to identify the telehealth service requirements for long-term condition management using a product-service system approach. The use of product-service system has proven to be a suitable methodology for the design and development of telehealth smartphone applications.

Patient safety and interactive medical devices: Realigning work as imagined and work as done

Medical devices are essential tools for modern healthcare delivery. However, significant issues can arise if medical devices are designed for ‘work as imagined’ when this is misaligned with ‘work as done’. This problem can be compounded as the details of device design, in terms of usability and the way a device supports or changes working practices, often receives limited attention. The ways devices are designed and used affect patient safety and quality of care: inappropriate design can provoke user error, create system vulnerabilities and divert attention from other aspects of patient care. Current regulation involves a series of pre-market checks relating to device usability, but this assumes that devices are always used under the conditions and for the purposes intended (i.e. work as imagined); there are many reasons for devices being used in ways other than those assumed at development time. Greater attention needs to be paid to learning points in actual use and user experience (i.e. work as done). This needs to inform manufacturers’ designs, management procurement decisions and local decisions about how devices are used in practice to achieve co-adaptation; without these, we foster risks and inefficiencies in healthcare.