A new global and comprehensive model for ICU ventilator performances evaluation

Evaluation of the Puritan Bennett™ 980 Ventilator System Safety and Performance in the Real-World Setting

Purpose

Mechanical ventilation is a life-supporting intervention but is associated with known risks and complications. To improve the efficacy and safety profile of mechanical ventilation, manufacturers have developed advanced ventilator settings, modes, and alarm strategies to optimize ventilation for patient needs while avoiding complications. However, there is little real-world data published on the deployment of ventilator technology. The main objective of this study was to assess the clinical safety and performance of the Puritan Bennett™ 980 Ventilator System (PB980) using real-world clinical data collected from a diverse, global patient population.

Methods

This was a multi-center, post-market registry study that included nine sites: four in the United States of America, one in Europe, and four in China. Patients were enrolled into the registry if they were intended to be treated with a PB980. Data collection began at the start of ventilation and continued until extubation off the ventilator or up to seven days of ventilation, whichever occurred first. Subjects were divided by age into three categories: infants (0-365 days), pediatric (1-17 years), and adult (18 years and older). The primary outcome was device-related complication rate.

Results

Two-hundred-and-eleven subjects were enrolled (41 infants, 48 pediatric, and 122 adults). Sixteen deaths, unrelated to device deficiency, occurred during the data collection timeframe (relative frequency: 7.58, 95% CI: 4.40, 12.0). Only one device-related adverse event was reported (relative frequency: 0.47% 95% CI: 0.01%, 2.61%).

Conclusion

Ventilation by the PB980 was delivered safely in this multi-center observational study, which included a diverse sample of patients with broad ventilatory needs.

Are all ventilators for NIV performing the same? A bench analysis

Global pandemic due to COVID-19 has increased the interest for ventilators´ use worldwide. New devices have been developed and older ones have undergone a renewed interest, but we lack robust evidence about performance of each ventilator to match appropriate device to a given patient and care environment. The aim of this bench study was to investigate the performance of six devices for noninvasive ventilation, and to compare them in terms of volume delivered, trigger response, pressurization capacity and synchronization in volume assisted controlled and pressure support ventilation. All ventilators were tested under thirty-six experimental conditions by using the lung model ASL5000® (IngMar Medical, Pittsburgh, PA). Two leak levels, two muscle inspiratory efforts and three mechanical patterns were combined for simulation. Trigger function was assessed by measurement of trigger-delay time. Pressurization capacity was evaluated as area under the pressure-time curve over the first 500 ms after inspiratory effort onset. Synchronization was evaluated by the asynchrony index and by incidence and type of asynchronies in each condition. All ventilators showed a good performance, even if pressurization capacity was worse than expected. Leak level did not affect their function. Differences were found during low muscle effort and obstructive pattern. In general, Philips Trilogy Evo/EV300 and Hamilton C3 showed the best results. NIV devices successfully compensate air leaks but still underperform with low muscle effort and obstructive lungs. Clinicians´ must have a clear understanding of the goals of NIV both for devices´ choice and set main parameters to achieve therapy success.

Monitoring the patient-ventilator asynchrony during non-invasive ventilation

Patient-ventilator asynchrony is a major issue during non-invasive ventilation and may lead to discomfort and treatment failure. Therefore, the identification and prompt management of asynchronies are of paramount importance during non-invasive ventilation (NIV), in both pediatric and adult populations. In this review, we first define the different forms of asynchronies, their classification, and the method of quantification. We, therefore, describe the technique to properly detect patient-ventilator asynchronies during NIV in pediatric and adult patients with acute respiratory failure, separately. Then, we describe the actions that can be implemented in an attempt to reduce the occurrence of asynchronies, including the use of non-conventional modes of ventilation. In the end, we analyzed what the literature reports on the impact of asynchronies on the clinical outcomes of infants, children, and adults.

Preliminary Design and Development of a Mechanical Ventilator Using Industrial Automation Components for Rapid Deployment During the COVID-19 Pandemic

The novel coronavirus disease 2019 (COVID-19) created a shortage of mechanical ventilators in the healthcare sector, resulting in rationed distribution, ethical dilemmas, and high mortalities. This technical report outlines the design and product outcome of a mechanical ventilator based on readily available off-the-shelf components, minimizing the dependence on manufacturing facilities. The ventilator was designed to operate in both hospitals and remote locations, having the ability to operate off various gas pressures and low voltage supplies. Due to the COVID-19 restrictions, the challenges of developing a device in an online setting with minimal manufacturing assistance were explored. Within a 10-day period, the team designed, prototyped, and conducted preliminary feasibility testing on the mechanical ventilator. The proposed design was not intended to replace, or be used as a medically approved ventilator, but demonstrates the ability to exploit off-the-shelf components to enable fast development and assembly. 

Causes of use errors in ventilation devices - Systematic review

A systematic review according to the PRISMA reporting standard was performed to identify causes of use errors in mechanical ventilators described in the literature. The PubMed search resulted in the inclusion of 16 papers. The errors described were systematically analyzed with regard to their causes and categorized in an adapted cause-and-effect diagram. The causes of use errors were related to specific usability issues and to the general condition that medical staff often work with different ventilators. When many devices are used, the different user interfaces are a source of use errors, since, for example, the same ventilation modes have different names. In order to avoid the identified causes for use errors in the future, this work offers manufacturers of ventilation devices design recommendations and the possibility to include the results in their risk management. In addition, standardizing user interface content across all ventilators, as in ISO 19223, can help reduce use errors.

Patient–Ventilator Interaction Testing Using the Electromechanical Lung Simulator xPULM™ during V/A-C and PSV Ventilation Mode

During mechanical ventilation, a disparity between flow, pressure and volume demands of the patient and the assistance delivered by the mechanical ventilator often occurs. This paper introduces an alternative approach of simulating and evaluating patient–ventilator interactions with high fidelity using the electromechanical lung simulator xPULM™. The xPULM™ approximates respiratory activities of a patient during alternating phases of spontaneous breathing and apnea intervals while connected to a mechanical ventilator. Focusing on different triggering events, volume assist-control (V/A-C) and pressure support ventilation (PSV) modes were chosen to test patient–ventilator interactions. In V/A-C mode, a double-triggering was detected every third breathing cycle, leading to an asynchrony index of 16.67%, which is classified as severe. This asynchrony causes a significant increase of peak inspiratory pressure (7.96 ± 6.38 vs. 11.09 ± 0.49 cmH2O, p < 0.01)) and peak expiratory flow (−25.57 ± 8.93 vs. 32.90 ± 0.54 L/min, p < 0.01) when compared to synchronous phases of the breathing simulation. Additionally, events of premature cycling were observed during PSV mode. In this mode, the peak delivered volume during simulated spontaneous breathing phases increased significantly (917.09 ± 45.74 vs. 468.40 ± 31.79 mL, p < 0.01) compared to apnea phases. Various dynamic clinical situations can be approximated using this approach and thereby could help to identify undesired patient–ventilation interactions in the future. Rapidly manufactured ventilator systems could also be tested using this approach.

The usability of ventilator maintenance user interface: A comparative evaluation of user task performance, workload, and user experience

Poor usability designed of ventilator user interface can easily lead to human error. In this study, we evaluated the usability design of ventilator maintenance user interface and identified problems related to the usability of user interface that could easily cause human error. Sixteen respiratory therapists participated in this usability study. The usability of the ventilator maintenance user interface was evaluated by participants' task performance (task completion time, task error rate), physiological workload (eye-fixation duration) and perceived workload (NASA-TLX), and user experience (questionnaire). For task performance, task completion time and task error rate showed significant differences. For task completion time, significant difference was found when conducting ventilator self-test (p < 0.001), replace the breathing circuit (p = 0.047), and check battery status (p = 0.005). For task error rate, the three ventilators showed significant difference (p = 0.012), and the Serov I showed a significantly higher task error rate than the Boaray 5000D (p = 0.031). For workload, the Serov I was associated with higher physiological and perceived workloads than other ventilators (p < 0.05). For user experience, the Boaray 5000D received better scores among the ventilators in terms of ease to maintain, friendly to maintain, and willingness to use (p < 0.05, respectively). Our study adds available literature for usability evaluation of ventilator maintenance user interface. The results indicate that the maintenance user interface of the Boaray 5000D performed better than the other two tested ventilators. Moreover, the study results also proved that eye-fixation duration can be a reliable tool for evaluating the usability of ventilator user interface.

Wearable devices for remote vital signs monitoring in the outpatient setting: an overview of the field

Early detection of physiological deterioration has been shown to improve patient outcomes. Due to recent improvements in technology, comprehensive outpatient vital signs monitoring is now possible. This is the first review to collate information on all wearable devices on the market for outpatient physiological monitoring.

A scoping review was undertaken. The monitors reviewed were limited to those that can function in the outpatient setting with minimal restrictions on the patient’s normal lifestyle, while measuring any or all of the vital signs: heart rate, ECG, oxygen saturation, respiration rate, blood pressure and temperature.

A total of 270 papers were included in the review. Thirty wearable monitors were examined: 6 patches, 3 clothing-based monitors, 4 chest straps, 2 upper arm bands and 15 wristbands. The monitoring of vital signs in the outpatient setting is a developing field with differing levels of evidence for each monitor. The most common clinical application was heart rate monitoring. Blood pressure and oxygen saturation measurements were the least common applications. There is a need for clinical validation studies in the outpatient setting to prove the potential of many of the monitors identified.

Research in this area is in its infancy. Future research should look at aggregating the results of validity and reliability and patient outcome studies for each monitor and between different devices. This would provide a more holistic overview of the potential for the clinical use of each device.

A Usability Study of 3 Radiotherapy Systems: A Comparative Evaluation Based on Expert Evaluation and User Experience

BACKGROUND The complex user interface design of radiotherapy treatment delivery systems can lead to use error and patient harm. In this study, we present the results of a comparison of 3 radiotherapy treatment delivery systems now used in China. MATERIAL AND METHODS We conducted a comprehensive usability study of 3 radiotherapy treatment delivery systems. Expert evaluation was performed through heuristic evaluation with 3 human-factors experts and 1 experienced radiation therapist for each system. User experience was assessed through perceived system usability and workload, using the National Aeronautics and Space Administration Task Load Index and the Post-Study System Usability Questionnaire. RESULTS For the expert evaluation, 47 usability problems were identified for Varian Trilogy, 75 for Elekta Precise, and 37 for Shinva XHA600E. Most problems were classified as major and minor usability problems, and were found in the process of patient setup and setup verification. For the user experience, radiation therapists presented a lower workload for Varian Trilogy compared to Elekta Precise (P<0.01) and Shinva XHA600E (P<0.01), and a lower workload for Elekta Precise compared to Shinva XHA600E (P=0.020). Radiation therapists perceived a higher system usability for Varian Trilogy compared to Shinva XHA600E (P<0.01), and a higher system usability for Elekta Precise compared to Shinva XHA600E (P<0.01). CONCLUSIONS This research provides valuable data on how 3 radiotherapy treatment delivery systems compare. The results of this study may be useful for hospital equipment procurement decisions, and designing next-generation products to improve patient safety.

Comprehensive Evaluation of User Interface for Ventilators Based on Respiratory Therapists' Performance, Workload, and User Experience

Background

Poor ergonomic design of ventilators can result in human errors. In this study, we evaluated the ergonomics of ventilators through respiratory therapists’ performance, workload, and user experience.

Material/Methods

Sixteen respiratory therapists were recruited to this usability study of 3 ventilators. Participants had to perform 7 tasks on each ventilator. Respiratory therapists’ performance was measured by task errors of all tasks for each participant. Workload was measured by objective measurement (blink rate and duration) and by subjective measurement (NASA-TLX). User experience was assessed by the USE Questionnaire.

Results

For task errors, significant differences were found among ventilators (p<0.05) and the Evital 4 received higher task errors when compared to the Servo I (p<0.05). For blink rate, significant differences were found in tasks of starting the ventilator, ventilator monitoring values recognition, ventilator setting parameters modification, alarm parameter recognition, and resetting among ventilators (p<0.05). Furthermore, blink duration was also found to be significant differently in tasks of starting the ventilator, mode and setting parameters recognition, ventilator monitoring values recognition, ventilator mode modification, and alarm parameter recognition and resetting, as well as in the average of all tasks (p<0.05). For perceived workload, the Evital 4 received higher NASA-TLX scores among ventilators. For user experience, the Servo I received the highest scores on the USE Questionnaire among the ventilators.

Conclusions

The study provides a comprehensive evaluation method of user interface based on respiratory therapists’ performance, workload, and user experience. In addition, this study suggests that the ergonomic design of the Evital 4 is poor. Finally, we found that eye motion (blink rate and duration) may be useful to assess the ergonomics of a user interface.

Usability Study of the User-Interface of Intensive Care Ventilators Based on User Test and Eye-Tracking Signals

BACKGROUND The aim of this study was to evaluate the ergonomics of the user-interface for 3 intensive care ventilators, and identify usability problems leading to user errors. MATERIAL AND METHODS Sixteen respiratory therapists were recruited to perform 6 specific user-interface operational tasks on ventilators. Data (task completion time, pupil diameter, average slope of pupil diameter change, and subjective evaluation) were collected through objective measurement, questionnaires, and an eye-tracking instrument. RESULTS For task completion time, there were significant differences among ventilators in recognition tasks of ventilator mode and settings (P<0.05), modification of ventilator modes and recognizing (P<0.05) and changing alarm settings (P<0.05). A mean of 15±2 task failures was observed for each ventilator. For the change of pupil diameter, a significant difference was observed between ventilators (except task 2, P<0.05). For average slope of pupil diameter change, a significant difference was also observed between ventilators (except task 2, P<0.05). The Servo I showed a better correlation between task completion time and pupil diameter change. The subjective evaluation results were clear: Evital 4 received worst scores in terms of friendliness of user-interface, information display and safety (respectively, P<0.05). CONCLUSIONS The present study provided valuable evidence to indicate the ergonomic of ventilators now used in China. With the result of this study, we can infer that the Evital 4 were poorly ergonomic designed. Furthermore, the study also demonstrated that eye-tracking can be a promising tool to evaluate the ergonomics of the user-interface.