1
|
Braun R, Tfirn M, Ford RM. Listening to life: Sonification for enhancing discovery in biological research. Biotechnol Bioeng 2024. [PMID: 38678506 DOI: 10.1002/bit.28729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Revised: 04/05/2024] [Accepted: 04/16/2024] [Indexed: 05/01/2024]
Abstract
Sonification, or the practice of generating sound from data, is a promising alternative or complement to data visualization for exploring research questions in the life sciences. Expressing or communicating data in the form of sound rather than graphs, tables, or renderings can provide a secondary information source for multitasking or remote monitoring purposes or make data accessible when visualizations cannot be used. While popular in astronomy, neuroscience, and geophysics as a technique for data exploration and communication, its potential in the biological and biotechnological sciences has not been fully explored. In this review, we introduce sonification as a concept, some examples of how sonification has been used to address areas of interest in biology, and the history of the technique. We then highlight a selection of biology-related publications that involve sonifications of DNA datasets and protein datasets, sonifications for data collection and interpretation, and sonifications aimed to improve science communication and accessibility. Through this review, we aim to show how sonification has been used both as a discovery tool and a communication tool and to inspire more life-science researchers to incorporate sonification into their own studies.
Collapse
Affiliation(s)
- Rhea Braun
- Department of Chemical Engineering, School of Engineering and Applied Sciences, University of Virginia, Charlottesville, Virginia, USA
| | - Maxwell Tfirn
- Department of Music, Christopher Newport University, Newport News, Virginia, USA
| | - Roseanne M Ford
- Department of Chemical Engineering, School of Engineering and Applied Sciences, University of Virginia, Charlottesville, Virginia, USA
| |
Collapse
|
2
|
Anesthesia personnel’s visual attention regarding patient monitoring in simulated non-critical and critical situations, an eye-tracking study. BMC Anesthesiol 2022; 22:167. [PMID: 35637450 PMCID: PMC9149329 DOI: 10.1186/s12871-022-01705-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 05/20/2022] [Indexed: 11/10/2022] Open
Abstract
Background Cognitive ergonomics design of patient monitoring may reduce human factor errors in high-stress environments. Eye-tracking is a suitable tool to gain insight into the distribution of visual attention of healthcare professionals with patient monitors, which may facilitate their further development. Methods This prospective, exploratory, high-fidelity simulation study compared anesthesia personnel’s visual attention (fixation count and dwell-time) to 15 areas of interest on the patient monitor during non-critical and critical anesthesia situations. Furthermore, we examined the extent to which participants’ experience influenced visual attention and which vital signs displayed on the patient monitor received the most visual attention. We used mixed zero-inflated Poisson regression and mixed linear models to analyze the data. Results Analyzing 23 ten-minute scenarios, we found significantly more fixations to the areas of interest on the patient monitor during critical than non-critical situations (rate ratio of 1.45; 95% CI 1.33 to 1.59; p < 0.001). However, the dwell-time on the areas of interest did not significantly differ between the non-critical and critical situations (coefficient of − 1.667; 95% CI − 4.549 to 1.229; p = 0.27). The professional experience did not significantly influence the visual attention (fixation: rate ratio of 0.88; 95% CI 0.54 to 1.43; p = 0.61 and dwell-time: coefficient of 0.889; 95% CI − 1.465 to 3.229; p = 0.27). Over all situations, anesthesia personnel paid the most attention to the vital signs blood pressure (fixation: mean [SD] of 108 [74.83]; dwell-time: mean [SD] of 27 [15.90] seconds), end-expiratory carbon dioxide (fixation: mean [SD] of 59 [47.39]; dwell-time: mean [SD] of 30 [21.51] seconds), and the electrocardiogram (fixation: mean [SD] of 58 [64.70]; dwell-time: mean [SD] of 15 [14.95] seconds). Conclusions Critical anesthesia situations increased anesthesia personnel’s visual interaction with the patient monitor. Furthermore, we found that their visual attention focused mainly on a few vital signs. To assist clinicians in critical situations, manufacturers should optimize monitors to convey necessary information as easily and quickly as possible and optimize the visibility of less frequently observed but equally critical vital signs, especially when they are in an abnormal range. Supplementary Information The online version contains supplementary material available at 10.1186/s12871-022-01705-6.
Collapse
|
3
|
Sanderson PM, Loeb RG, Liley H, Liu D, Paterson E, Hinckfuss K, Zestic J. Signaling Patient Oxygen Desaturation with Enhanced Pulse Oximetry Tones. Biomed Instrum Technol 2022; 56:46-57. [PMID: 35671368 PMCID: PMC9767428 DOI: 10.2345/0899-8205-56.2.46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Manufacturers could improve the pulse tones emitted by pulse oximeters to support more accurate identification of a patient's peripheral oxygen saturation (SpO2) range. In this article, we outline the strengths and limitations of the variable-pitch tone that represents SpO2 of each detected pulse, and we argue that enhancements to the tone to demarcate clinically relevant ranges are feasible and desirable. The variable-pitch tone is an appreciated and trusted feature of the pulse oximeter's user interface. However, studies show that it supports relative judgments of SpO2 trends over time and is less effective at supporting absolute judgments about the SpO2 number or conveying when SpO2 moves into clinically important ranges. We outline recent studies that tested whether acoustic enhancements to the current tone could convey clinically important ranges more directly, without necessarily using auditory alarms. The studies cover the use of enhanced variable-pitch pulse oximeter tones for neonatal and adult use. Compared with current tones, the characteristics of the enhanced tones represent improvements that are both clinically relevant and statistically significant. We outline the benefits of enhanced tones, as well as discuss constraints of which developers of enhanced tones should be aware if enhancements are to be successful.
Collapse
Affiliation(s)
- Penelope M Sanderson
- Penelope M. Sanderson, PhD, is professor of cognitive engineering and human factors in the Schools of Psychology, Clinical Medicine, and Information Technology and Electrical Engineering at The University of Queensland in Queensland, Australia.
| | - Robert G Loeb
- Robert G. Loeb, MD, is an honorary professor in the School of Psychology at The University of Queensland in Queensland, Australia, and an emeritus clinical professor at University of Florida-Gainesville
| | - Helen Liley
- Helen Liley, MBCh, FRACP, is a senior staff specialist at Mater Mothers' Hospital and a professor in the Faculty of Medicine at The University of Queensland in Queensland, Australia
| | - David Liu
- David Liu, MBBS, PhD, is an anaesthetics registrar at Sunshine Coast University Hospital in Queensland, Australia, and a senior lecturer in the Faculty of Medicine at The University of Queensland in Queensland, Australia
| | - Estrella Paterson
- Estrella Paterson, PhD, is a postdoctoral fellow in the School of Psychology at The University of Queensland in Queensland, Australia
| | - Kelly Hinckfuss
- Kelly Hinckfuss, MPhil, is a clinical masters student in the School of Psychology at The University of Queensland in Queensland, Australia
| | - Jelena Zestic
- Jelena Zestic, PhD, is a human systems engineer at Boeing Research and Technology in Brisbane, Australia
| |
Collapse
|
4
|
Sanderson PM, Loeb RG, Liley H, Liu D, Paterson E, Hinckfuss K, Zestic J. Signaling Patient Oxygen Desaturation with Enhanced Pulse Oximetry Tones. Biomed Instrum Technol 2022. [PMID: 35671368 DOI: 10.2345/1943-5967-56.2.46] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Manufacturers could improve the pulse tones emitted by pulse oximeters to support more accurate identification of a patient's peripheral oxygen saturation (SpO2) range. In this article, we outline the strengths and limitations of the variable-pitch tone that represents SpO2 of each detected pulse, and we argue that enhancements to the tone to demarcate clinically relevant ranges are feasible and desirable. The variable-pitch tone is an appreciated and trusted feature of the pulse oximeter's user interface. However, studies show that it supports relative judgments of SpO2 trends over time and is less effective at supporting absolute judgments about the SpO2 number or conveying when SpO2 moves into clinically important ranges. We outline recent studies that tested whether acoustic enhancements to the current tone could convey clinically important ranges more directly, without necessarily using auditory alarms. The studies cover the use of enhanced variable-pitch pulse oximeter tones for neonatal and adult use. Compared with current tones, the characteristics of the enhanced tones represent improvements that are both clinically relevant and statistically significant. We outline the benefits of enhanced tones, as well as discuss constraints of which developers of enhanced tones should be aware if enhancements are to be successful.
Collapse
Affiliation(s)
- Penelope M Sanderson
- Penelope M. Sanderson, PhD, is professor of cognitive engineering and human factors in the Schools of Psychology, Clinical Medicine, and Information Technology and Electrical Engineering at The University of Queensland in Queensland, Australia.
| | - Robert G Loeb
- Robert G. Loeb, MD, is an honorary professor in the School of Psychology at The University of Queensland in Queensland, Australia, and an emeritus clinical professor at University of Florida-Gainesville
| | - Helen Liley
- Helen Liley, MBCh, FRACP, is a senior staff specialist at Mater Mothers' Hospital and a professor in the Faculty of Medicine at The University of Queensland in Queensland, Australia
| | - David Liu
- David Liu, MBBS, PhD, is an anaesthetics registrar at Sunshine Coast University Hospital in Queensland, Australia, and a senior lecturer in the Faculty of Medicine at The University of Queensland in Queensland, Australia
| | - Estrella Paterson
- Estrella Paterson, PhD, is a postdoctoral fellow in the School of Psychology at The University of Queensland in Queensland, Australia
| | - Kelly Hinckfuss
- Kelly Hinckfuss, MPhil, is a clinical masters student in the School of Psychology at The University of Queensland in Queensland, Australia
| | - Jelena Zestic
- Jelena Zestic, PhD, is a human systems engineer at Boeing Research and Technology in Brisbane, Australia
| |
Collapse
|
5
|
Roche TR, Braun J, Ganter MT, Meybohm P, Herrmann J, Zacharowski K, Raimann FJ, Piekarski F, Spahn DR, Nöthiger CB, Tscholl DW, Said S. Voice alerting as a medical alarm modality for next-generation patient monitoring: a randomised international multicentre trial. Br J Anaesth 2021; 127:769-777. [PMID: 34454710 DOI: 10.1016/j.bja.2021.07.015] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 06/21/2021] [Accepted: 07/07/2021] [Indexed: 10/20/2022] Open
Abstract
BACKGROUND Acoustic alarms in medical devices are vital for patient safety. State-of-the-art patient monitoring alarms are indistinguishable and contribute to alarm fatigue. There are two promising new sound modalities for vital sign alarms. Auditory icons convey alarms as brief metaphorical sounds, and voice alerts transmit information using a clear-spoken language. We compared how reliably healthcare professionals identified alarms using these two modalities. METHODS This investigator-initiated computer-based multicentre simulation study included 28 anaesthesia providers who were asked to identify vital sign alarms in randomised order, once with voice alerts and once with auditory icons. We further assessed time to decision, diagnostic confidence, and perceived helpfulness. We analysed the results using mixed models, adjusted for possible confounders. RESULTS We assessed 14 alarms for each modality, resulting in 392 comparisons across all participants. Compared with auditory icons, healthcare providers had 58 times higher odds of correctly identifying alarms using voice alerts (odds ratio 58.0; 95% confidence interval [CI]: 25.1-133.6; P<0.001), made their decisions about 14 s faster (coefficient -13.9; 95% CI: -15.8 to -12.1 s; P<0.001), perceived higher diagnostic confidence (100% [392 of 392] vs 43% [169 of 392; P<0.001]), and rated voice alerts as more helpful (odds ratio 138.2; 95% CI: 64.9-294.1; P<0.001). The participants were able to identify significantly higher proportions of alarms with voice alerts (98.5%; P<0.001) and auditory icons (54.1%; P<0.001) compared with state-of-the-art alarms (17.9%). CONCLUSIONS Voice alerts were superior to auditory icons, and both were superior to current state-of-the-art auditory alarms. These findings demonstrate the potential that voice alerts hold for patient monitoring.
Collapse
Affiliation(s)
- Tadzio R Roche
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| | - Julia Braun
- Departments of Epidemiology and Biostatistics, Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Michael T Ganter
- Institute of Anaesthesiology and Pain Therapy, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Patrick Meybohm
- Department of Anesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, University of Wuerzburg, Wuerzburg, Germany
| | - Johannes Herrmann
- Department of Anesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, University of Wuerzburg, Wuerzburg, Germany
| | - Kai Zacharowski
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, University Hospital Frankfurt, Goethe University Frankfurt, Frankfurt, Germany
| | - Florian J Raimann
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, University Hospital Frankfurt, Goethe University Frankfurt, Frankfurt, Germany
| | - Florian Piekarski
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, University Hospital Frankfurt, Goethe University Frankfurt, Frankfurt, Germany
| | - Donat R Spahn
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| | - Christoph B Nöthiger
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| | - David W Tscholl
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland.
| | - Sadiq Said
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| |
Collapse
|
6
|
Paterson E, Sanderson PM, Salisbury IS, Burgmann FP, Mohamed I, Loeb RG, Paterson NA. Evaluation of an enhanced pulse oximeter auditory display: a simulation study. Br J Anaesth 2020; 125:826-834. [DOI: 10.1016/j.bja.2020.05.038] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2020] [Revised: 05/11/2020] [Accepted: 05/21/2020] [Indexed: 10/23/2022] Open
|
7
|
Collett R, Salisbury I, Loeb RG, Sanderson PM. Smooth or Stepped? Laboratory Comparison of Enhanced Sonifications for Monitoring Patient Oxygen Saturation. HUMAN FACTORS 2020; 62:124-137. [PMID: 31180734 DOI: 10.1177/0018720819845742] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
BACKGROUND The pulse oximeter (PO) provides anesthesiologists with continuous visual and auditory information about a patient's oxygen saturation (SpO2). However, anesthesiologists' attention is often diverted from visual displays, and clinicians may inaccurately judge SpO2 values when relying on conventional PO auditory tones. We tested whether participants could identify SpO2 value (e.g., "97%") better with acoustic enhancements that identified three discrete clinical ranges by either changing abruptly at two threshold values (stepped-effects) or changing incrementally with each percentage value of SpO2 (smooth-effects). METHOD In all, 79 nonclinicians participated in a between-subjects experiment that compared performance of participants using the stepped-effects display with those who used the smooth-effects display. In both conditions, participants heard sequences of 72 tones whose pitch directly correlated to SpO2 value, and whose value could change incrementally. Primary outcome was percentage of responses that correctly identified the absolute SpO2 percentage, ±1, of the last pulse tone in each sequence. RESULTS Participants using the stepped-effects auditory tones identified absolute SpO2 percentage more accurately (M = 53.7%) than participants using the smooth-effects tones (M = 47.9%, p = .038). Identification of range and detection of transitions between ranges showed even stronger advantages for the stepped-effects display (p < .005). CONCLUSION The stepped-effects display has more pronounced auditory cues at SpO2 range transitions, from which participants can better infer absolute SpO2 values. Further development of a smooth-effects display for this purpose is not necessary.
Collapse
|
8
|
Paterson E, Sanderson PM, Brecknell B, Paterson NAB, Loeb RG. Comparison of Standard and Enhanced Pulse Oximeter Auditory Displays of Oxygen Saturation. Anesth Analg 2019; 129:997-1004. [DOI: 10.1213/ane.0000000000004267] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
9
|
Are Anesthesiology Providers Good Guessers? Heart Rate and Oxygen Saturation Estimation in a Simulation Setting. Anesthesiol Res Pract 2019; 2019:5914305. [PMID: 31428146 PMCID: PMC6679872 DOI: 10.1155/2019/5914305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2019] [Accepted: 06/04/2019] [Indexed: 11/23/2022] Open
Abstract
Background Anesthesia providers may need to interpret the output of vital sign monitors based on auditory cues, in the context of multitasking in the operating room. This study aims to evaluate the ability of different anesthesia providers to estimate heart rate and oxygen saturation in a simulation setting. Methods Sixty anesthesia providers (residents, nurse anesthetics, and anesthesiologists) were studied. Four scenarios were arranged in a simulation context. Two baseline scenarios with and without waveform visual aid, and two scenarios with variation of heart rate and/or oxygen saturation were used to assess the accuracy of the estimation made by the participants. Results When the accurate threshold for the heart rate was set at less than 5 beats per minute, the providers only had a correct estimation at two baseline settings with visual aids (p=0.22 and 0.2237). Anesthesia providers tend to underestimate the heart rate when it increases. Providers failed to accurately estimate oxygen saturation with or without visual aid (p=0.0276 and 0.0105, respectively). Change in recording settings significantly affected the accuracy of heart rate estimation (p < 0.0001), and different experience levels affected the estimation accuracy (p=0.041). Conclusion The ability of anesthesia providers with different levels of experience to assess baseline and variations of heart rate and oxygen saturation is unsatisfactory, especially when oxygen desaturation and bradycardia coexist, and when the subject has less years of experience.
Collapse
|
10
|
|
11
|
Paterson E, Sanderson P, Paterson N, Loeb R. Effectiveness of enhanced pulse oximetry sonifications for conveying oxygen saturation ranges: a laboratory comparison of five auditory displays. Br J Anaesth 2017; 119:1224-1230. [DOI: 10.1093/bja/aex343] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/01/2017] [Indexed: 11/14/2022] Open
|
12
|
Sanderson P, Burns C. Rasmussen and the boundaries of empirical evaluation. APPLIED ERGONOMICS 2017; 59:649-656. [PMID: 28341126 DOI: 10.1016/j.apergo.2016.10.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2016] [Accepted: 10/06/2016] [Indexed: 06/06/2023]
Abstract
In this special issue, many of the papers focus on Rasmussen's analytic contributions to the understanding of work in complex sociotechnical systems. Work is analysed for the purpose of developing new designs that can improve the nature of that work. The evaluation of such designs was a key part of Rasmussen's program, yet he was often sceptical of the claims made for the generalizability of empirical studies. To tackle this problem, he extended his work analysis framework to provide a way of thinking about empirical evaluation. As authors of this paper, we come from two different backgrounds-systems engineering in the case of Burns, and engineering psychology in the case of Sanderson-and over the decades of our respective research programs, we have both performed many empirical investigations: field investigations, simulation studies, and behavioural laboratory experiments. Rasmussen's scepticism-and his writings on the issue-have stimulated and shaped our own research. In this brief paper we present our interpretation of Rasmussen's perspective, we provide examples how our research sits within Rasmussen's framework of constraints defining boundary conditions for experiments, and we draw conclusions for the future.
Collapse
|