Nasal airflow and thoracoabdominal motion in children using infrared thermographic video processing

Breathing mode assessment with thermography: a pilot study

PURPOSE

To present a method for analyzing breathing modes with infrared thermography.

METHODS

This exploratory cross-sectional study used 38 thermal images of inspiration and expiration with nasal breathing and simulated mouth breathing in four nasal breathers without respiratory complaints. Three different data selection forms (line, rectangle, and ellipse) were used to extract the minimum, mean, and maximum temperatures of the regions of interest (nose and mouth) using the FLIR Tools® software.

RESULTS

Among the three selection forms, there was greater temperature variability obtained with the line, revealing limitations in this measurement. There were no differences between the rectangle and ellipse values, showing that both selection forms present similar temperature extraction results. The comparison results between nose and mouth temperatures during inspiration and expiration indicated a statistically significant difference between all measurements, except for mean inspiration temperatures with the rectangle and ellipse. The breathing mode can be distinguished in both inspiration and expiration when using mean mouth temperatures with the rectangle and ellipse.

CONCLUSION

Breathing modes should be assessed based on mean mouth temperatures during inspiration, using the ellipse.

Evaluation of the breathing mode by infrared thermography

OBJECTIVES

To analyze breathing modes with infrared thermography.

METHODS

Cross-sectional observational exploratory study conducted in 20 female participants with a mean age of 26.0-years. The thermograms were made following the principles of the American Academy of Thermology and the Brazilian Thermology Society. The camera FLIR A315 (FLIR Inc., Santa Barbara, CA) was used for the tests. The recordings consisted of the participants breathing normally through the nose for 2min and simulating oral/oronasal breathing for another 2min. The thermograms were analyzed with the FLIR Tools software. An ellipse was placed between the nostrils and the lip commissures to obtain the mean temperatures. The collection was made by two independent researchers, and the normalized non-dimensional temperature was calculated.

RESULTS

The temperature in nasal breathing is higher than in oral/oronasal breathing both for inhaling and exhaling when measured in the region of the mouth. The exhaling temperatures were higher than the inhaling ones in oral/oronasal breathing (through the nose and the mouth) and nasal breathing (only through the nose). The temperature difference between exhaling and inhaling (ΔT) was greater in oral/oronasal breathing when measured in the region of the mouth.

CONCLUSION

The thermographic assessment of breathing modes may be made by comparing the mean temperatures of the mouth, using an ellipse.

LEVEL OF EVIDENCE

Study without consistently applied reference standards.

Accuracy and reliability of the optoelectronic plethysmography and the heart rate systems for measuring breathing rates compared with the spirometer

Measuring breathing rates without a mouthpiece is of interest in clinical settings. Electrocardiogram devices and, more recently, optoelectronic plethysmography (OEP) methods can estimate breathing rates with only a few electrodes or motion-capture markers placed on the patient. This study estimated and compared the accuracy and reliability of three non-invasive devices: an OEP system with 12 markers, an electrocardiogram device and the conventional spirometer. Using the three devices simultaneously, we recorded 72 six-minute epochs on supine subjects. Our results show that the OEP system has a very low limit of agreement and a bias lower than 0.4% compared with the spirometer, indicating that these devices can be used interchangeably. We observed comparable results for electrocardiogram devices. The OEP system facilitates breathing rate measurements and offers a more complete chest-lung volume analysis that can be easily associated with heart rate analysis without any synchronisation process, for useful features for clinical applications and intensive care.

Implementation of Thermal Camera for Non-Contact Physiological Measurement: A Systematic Review

Non-contact physiological measurements based on image sensors have developed rapidly in recent years. Among them, thermal cameras have the advantage of measuring temperature in the environment without light and have potential to develop physiological measurement applications. Various studies have used thermal camera to measure the physiological signals such as respiratory rate, heart rate, and body temperature. In this paper, we provided a general overview of the existing studies by examining the physiological signals of measurement, the used platforms, the thermal camera models and specifications, the use of camera fusion, the image and signal processing step (including the algorithms and tools used), and the performance evaluation. The advantages and challenges of thermal camera-based physiological measurement were also discussed. Several suggestions and prospects such as healthcare applications, machine learning, multi-parameter, and image fusion, have been proposed to improve the physiological measurement of thermal camera in the future.

Automatic Separation of Respiratory Flow from Motion in Thermal Videos for Infant Apnea Detection

Both Respiratory Flow (RF) and Respiratory Motion (RM) are visible in thermal recordings of infants. Monitoring these two signals usually requires landmark detection for the selection of a region of interest. Other approaches combine respiratory signals coming from both RF and RM, obtaining a Mixed Respiratory (MR) signal. The detection and classification of apneas, particularly common in preterm infants with low birth weight, would benefit from monitoring both RF and RM, or MR, signals. Therefore, we propose in this work an automatic RF pixel detector not based on facial/body landmarks. The method is based on the property of RF pixels in thermal videos, which are in areas with a smooth circular gradient. We defined 5 features combined with the use of a bank of Gabor filters that together allow selection of the RF pixels. The algorithm was tested on thermal recordings of 9 infants amounting to a total of 132 min acquired in a neonatal ward. On average the percentage of correctly identified RF pixels was 84%. Obstructive Apneas (OAs) were simulated as a proof of concept to prove the advantage in monitoring the RF signal compared to the MR signal. The sensitivity in the simulated OA detection improved for the RF signal reaching 73% against the 23% of the MR signal. Overall, the method yielded promising results, although the positioning and number of cameras used could be further optimized for optimal RF visibility.

Noncontact Physiological Measurement Using a Camera: A Technical Review and Future Directions

Using a camera as an optical sensor to monitor physiological parameters has garnered considerable research interest in biomedical engineering in recent decades. Researchers have explored the use of a camera for monitoring a variety of physiological waveforms, together with the vital signs carried by these waveforms. Most of the obtained waveforms are related to the human respiratory and cardiovascular systems, and in addition of being indicative of overall health, they can also detect early signs of certain diseases. While using a camera for noncontact physiological signal monitoring offers the advantages of low cost and operational ease, it also has the disadvantages such as vulnerability to motion and lack of burden-free calibration solutions in some use cases. This study presents an overview of the existing camera-based methods that have been reported in recent years. It introduces the physiological principles behind these methods, signal acquisition approaches, various types of acquired signals, data processing algorithms, and application scenarios of these methods. It also discusses the technological gaps between the camera-based methods and traditional medical techniques, which are mostly contact-based. Furthermore, we present the manner in which noncontact physiological signal monitoring use has been extended, particularly over the recent years, to more day-to-day aspects of individuals' lives, so as to go beyond the more conventional use case scenarios. We also report on the development of novel approaches that facilitate easier measurement of less often monitored and recorded physiological signals. These have the potential of ushering a host of new medical and lifestyle applications. We hope this study can provide useful information to the researchers in the noncontact physiological signal measurement community.

Multi-camera infrared thermography for infant respiration monitoring

Respiration is monitored in neonatal wards using chest impedance (CI), which is obtrusive and can cause skin damage to the infants. Therefore, unobtrusive solutions based on infrared thermography are being investigated. This work proposes an algorithm to merge multiple thermal camera views and automatically detect the pixels containing respiration motion or flow using three features. The method was tested on 152 minutes of recordings acquired on seven infants. We performed a comparison with the CI respiration rate yielding a mean absolute error equal to 2.07 breaths/min. Merging the three features resulted in reducing the dependency on the window size typical of spectrum-based features.

Availability and performance of image-based, non-contact methods of monitoring heart rate, blood pressure, respiratory rate, and oxygen saturation: a systematic review

OBJECTIVE

Over the last 15 years, developments in camera technology have coincided with increased availability and affordability. This has led to an increasing interest in using these technologies in healthcare settings. Image-based monitoring methods potentially allow multiple vital signs to be measured concurrently using a non-contact sensor. We have undertaken a systematic review of the current availability and performance of these monitoring methods.

APPROACH

A multiple database search was conducted using MEDLINE, Embase, CINAHL, Cochrane Library, OpenGrey, IEEE Xplore Library and ACM Digital Library to July 2018. We included studies comparing image-based heart rate, respiratory rate, oxygen saturation and blood pressure monitoring methods against one or more validated reference device(s). Each included study was assessed using the modified GRRAS criteria for reporting bias.

MAIN RESULTS

Of 30 279 identified studies, 161 were included in the final analysis. Twenty studies (20/161, 12%) were carried out on patients in clinical settings, while the remainder were conducted in academic settings using healthy volunteer populations. The 18-40 age group was best represented across the identified studies. One hundred and twenty studies (120/161, 75%) estimated heart rate, followed by 62 studies (62/161, 39%) estimating respiratory rate. Fewer studies focused on oxygen saturation (11/161, 7%) or blood pressure (6/161, 4%) estimation. Fifty-one heart rate studies (51/120, 43%) and 24 respiratory rate studies (24/62, 39%) used Bland-Altman analysis to report their results. Of the heart rate studies, 28 studies (28/51, 55%) showed agreement within industry standards of [Formula: see text]5 beats per minute. Only two studies achieved this within clinical settings. Of the respiratory rate studies, 13 studies (13/24, 54%) showed agreement within industry standards of [Formula: see text]3 breaths per minute, but only one study achieved this in a clinical setting. Statistical analysis was heterogeneous across studies with frequent inappropriate use of correlation. The majority of studies (99/161, 61%) monitored subjects for under 5 min. Three studies (3/161, 2%) monitored subjects for over 60 min, all of which were conducted in hospital settings.

SIGNIFICANCE

Heart rate and respiratory rate monitoring using video images is currently possible and performs within clinically acceptable limits under experimental conditions. Camera-derived estimates were less accurate in the proportion of studies conducted in clinical settings. We would encourage thorough reporting of the population studied, details of clinically relevant aspects of methodology, and the use of appropriate statistical methods in future studies. Systematic review registration: PROSPERO CRD42016029167 Protocol: https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-017-0615-3.

Video and audio processing in paediatrics: a review

OBJECTIVE

Video and sound acquisition and processing technologies have seen great improvements in recent decades, with many applications in the biomedical area. The aim of this paper is to review the overall state of the art of advances within these topics in paediatrics and to evaluate their potential application for monitoring in the neonatal intensive care unit (NICU).

APPROACH

For this purpose, more than 150 papers dealing with video and audio processing were reviewed. For both topics, clinical applications are described according to the considered cohorts-full-term newborns, infants and toddlers or preterm newborns. Then, processing methods are presented, in terms of data acquisition, feature extraction and characterization.

MAIN RESULTS

The paper first focuses on the exploitation of video recordings; these began to be automatically processed in the 2000s and we show that they have mainly been used to characterize infant motion. Other applications, including respiration and heart rate estimation and facial analysis, are also presented. Audio processing is then reviewed, with a focus on the analysis of crying. The first studies in this field focused on induced-pain cries and the newest ones deal with spontaneous cries; the analyses are mainly based on frequency features. Then, some papers dealing with non-cry signals are also discussed.

SIGNIFICANCE

Finally, we show that even if recent improvements in digital video and signal processing allow for increased automation of processing, the context of the NICU makes a fully automated analysis of long recordings problematic. A few proposals for overcoming some of the limitations are given.

Respiratory measurement using infrared thermography and respiratory volume monitor during sedation in patients undergoing endoscopic urologic procedures under spinal anesthesia

We aimed to evaluate changes in respiratory pattern after sedation by simultaneously applying a respiratory volume monitor (ExSpiron1Xi, RVM) and infrared thermography (IRT) to patients undergoing spinal anesthesia during endoscopic urologic surgeries. After spinal anesthesia was performed, the patient was placed in a lithotomy position for surgery. Then, we established the baseline of the RVM, and started monitoring the mouth and nose with the infrared camera. SpO₂ was continuously measured throughout these processes. Once the baseline was set, 0.05 mg/kg midazolam was administered for sedation. Apnea was defined as cessation of airflow for ≥ 10 s with respiratory rate of < 6 breaths/min; hypopnea was defined as a decrease in oxygen hemoglobin of > 4%, compared to baseline. We measured the time at which apnea was detected by IRT, the time at which hypopnea was detected by RVM, and the time at which hypoxia was detected by SpO₂. Twenty patients (age: 68.9 ± 11.2 years, body mass index: 24.2 ± 2.6 kg/min²) completed the study. Before sedation, the baseline correlation coefficient of respiratory rate detection between RVM and IRT was 0.866. After midazolam administration, apnea was detected in all subjects within the first 5 min by IRT; the median time required to detect apnea was 102.5 [interquartile range (IQR) 25-75%: 80-155] s. Hypopnea was detected in all subjects within the first 5 min by RVM: the median time required to detect hypopnea was 142.5 (IQR 115-185.2) s. The median time required for SpO₂ to decrease > 4% from baseline was 160 (IQR 125-205) s. Our results suggest that IRT can be useful for rapid detection of respiratory changes in patients undergoing sedation following spinal anesthesia for endoscopic urologic procedures.

Development of a high-resolution infrared thermographic imaging method as a diagnostic tool for acute undifferentiated limp in young children

Acute limp is a common presenting condition in the paediatric emergency department. There are a number of causes of acute limp that include traumatic injury, infection and malignancy. These causes in young children are not easily distinguished. In this pilot study, an infrared thermographic imaging technique to diagnose acute undifferentiated limp in young children was developed. Following required ethics approval, 30 children (mean age = 5.2 years, standard deviation = 3.3 years) were recruited. The exposed lower limbs of participants were imaged using a high-resolution thermal camera. Using predefined regions of interest (ROI), any skin surface temperature difference between the healthy and affected legs was statistically analysed, with the aim of identifying limp. In all examined ROIs, the median skin surface temperature for the affected limb was higher than that of the healthy limb. The small sample size recruited for each group, however, meant that the statistical tests of significant difference need to be interpreted in this context. Thermal imaging showed potential in helping with the diagnosis of acute limp in children. Repeating a similar study with a larger sample size will be beneficial to establish reproducibility of the results. Graphical abstract A young child with an acute undifferentiated limp undergoes thermal imaging and the follow on image analysis assists the limp diagnosis.

New Frontiers for Applications of Thermal Infrared Imaging Devices: Computational Psychopshysiology in the Neurosciences

Thermal infrared imaging has been proposed, and is now used, as a tool for the non-contact and non-invasive computational assessment of human autonomic nervous activity and psychophysiological states. Thanks to a new generation of high sensitivity infrared thermal detectors and the development of computational models of the autonomic control of the facial cutaneous temperature, several autonomic variables can be computed through thermal infrared imaging, including localized blood perfusion rate, cardiac pulse rate, breath rate, sudomotor and stress responses. In fact, all of these parameters impact on the control of the cutaneous temperature. The physiological information obtained through this approach, could then be used to infer about a variety of psychophysiological or emotional states, as proved by the increasing number of psychophysiology or neurosciences studies that use thermal infrared imaging. This paper presents a review of the principal achievements of thermal infrared imaging in computational psychophysiology, focusing on the capability of the technique for providing ubiquitous and unwired monitoring of psychophysiological activity and affective states. It also presents a summary on the modern, up-to-date infrared sensors technology.

Infrared thermography in paediatrics: a narrative review of clinical use

BACKGROUND

Infrared thermography (IRT) has been used in adult medicine for decades, but recent improvements in quality of imaging and increasing computer processing power have allowed for a diversification of clinical applications. The specific usage of IRT in a paediatric population has not been widely explored, so this article aims to summarise the available literature in this area. IRT involves the non-contact, accurate measurement of skin surface temperature to identify temperature changes suggesting disease. IRT could well have unique applications in paediatric medicine.

METHODS

Electronic searches were performed independently by two authors, using the databases of MEDLINE (via Web of Science), the Cochrane Library, CINAHL (EBSCO) and Scopus, including articles published from 1990 to July 2016. The search strategy that was used aimed to include articles that covered the topics of IRT and children, including studies with participants 18 years old or younger. Articles were screened by title and abstract by two authors. Meta-analysis was not performed due to the marked heterogeneity in applications, study design and outcomes: this is a narrative summary of the available literature.

RESULTS

IRT has been shown to be an effective additional diagnostic tool in a number of different paediatric specialties, namely in fracture screening, burns assessment and neonatal monitoring. Small measurable skin temperature changes can effectively add to the clinical picture, while computer-tracking systems can be reliably used to focus investigations on particular areas of the body.

CONCLUSION

Throughout this review of the available literature, there has been a general consensus that this non-invasive, non-irradiating and relatively inexpensive technology may well have a place in the management of paediatric patients in the future.

Estimation of bilateral asynchrony between diaphragm mechanomyographic signals in patients with chronic obstructive pulmonary disease

The aim of the present study was to measure bilateral asynchrony in patients suffering from Chronic Obstructive Pulmonary Disease (COPD) performing an incremental inspiratory load protocol. Bilateral asynchrony was estimated by the comparison of respiratory movements derived from diaphragm mechanomyographic (MMGdi) signals, acquired by means of capacitive accelerometers placed on left and right sides of the rib cage. Three methods were considered for asynchrony evaluation: Lissajous figure, Hilbert transform and Motto's algorithm. Bilateral asynchrony showed an increase at 20, 40 and 60% (values of normalized inspiratory pressure by their maximum value reached in the last inspiratory load) while the very severe group showed an increase at 20, 40, 80, and 100 % during the protocol. These increments in the phase's shift can be due to an increase of the inspiratory load along the protocol, and also as a consequence of distress and fatigue. In summary, this work evidenced the capability to estimate bilateral asynchrony in COPD patients. These preliminary results also showed that the use of capacitive accelerometers can be a suitable sensor for recording of respiratory movement and evaluation of asynchrony in COPD patients.

Evaluation of Ultrasound-Based Sensor to Monitor Respiratory and Nonrespiratory Movement and Timing in Infants

GOAL

To describe and validate a noncontacting sensor that used reflected ultrasound to separately monitor respiratory, nonrespiratory, and caretaker movements of infants.

METHODS

An in-phase and quadrature (I & Q) detection scheme provided adequate bandwidth, in conjunction with postdetection filtering, to separate the three types of movement. The respiratory output was validated by comparing it to the electrical activity of the diaphragm (Edi) obtained from an infant ventilator in 11 infants. The nonrespiratory movement output was compared to movement detected by miniature accelerometers attached to the wrists, ankles, and heads of seven additional infants. Caretaker movement was compared to visual observations annotated in the recordings.

RESULTS

The respiratory rate determined by the sensor was equivalent to that from the Edi signal. The sensor could detect the onset of inspiration significantly earlier than the Edi signal (23+/-69 ms). Nonrespiratory movement was identified with an agreement of 0.9 with the accelerometers. It potentially interfered with the respiratory output an average of 4.7+/-4.5% and 14.9+/15% of the time in infants not requiring or on ventilatory support, respectively. Caretaker movements were identified with 98% sensitivity and specificity. The sensor outputs were independent of body coverings or position.

CONCLUSION

This single, noncontacting sensor can independently quantify these three types of movement.

SIGNIFICANCE

It is feasible to use the sensor as trigger for synchronizing mechanical ventilators to spontaneous breathing, to quantify overall movement, to determine sleep state, to detect seizures, and to document the amount and effects of caretaker activity in infants.

Thermal Infrared Imaging-Based Computational Psychophysiology for Psychometrics

Thermal infrared imaging has been proposed as a potential system for the computational assessment of human autonomic nervous activity and psychophysiological states in a contactless and noninvasive way. Through bioheat modeling of facial thermal imagery, several vital signs can be extracted, including localized blood perfusion, cardiac pulse, breath rate, and sudomotor response, since all these parameters impact the cutaneous temperature. The obtained physiological information could then be used to draw inferences about a variety of psychophysiological or affective states, as proved by the increasing number of psychophysiological studies using thermal infrared imaging. This paper presents therefore a review of the principal achievements of thermal infrared imaging in computational physiology with regard to its capability of monitoring psychophysiological activity.

Validation of the Sonomat: a contactless monitoring system used for the diagnosis of sleep disordered breathing

STUDY OBJECTIVES

To evaluate the ability of the Sonomat to diagnose obstructive sleep apnea (OSA).

DESIGN

Prospective and randomized.

SETTING

Sleep laboratory and home.

PARTICIPANTS

62 subjects; 54 with a clinical history of OSA and 8 normal control subjects.

INTERVENTIONS

N/A.

MEASUREMENTS AND RESULTS

Simultaneous PSG and Sonomat recordings were made in 62 subjects; 2 were excluded due to a poor nasal flow recording in PSG. There were positive correlations between the two devices for measures of sleep time, respiratory events, and the AHI (all correlations > 0.89). Bland-Altman analysis of the AHI showed positive agreement between devices, particularly at levels around common diagnostic thresholds. The mean difference in AHI values was 1.4 events per hour, and at a diagnostic threshold of 15 events per hour, sensitivity and specificity were 88% and 91%. More than 93% of PSG defined respiratory events were identified by the Sonomat and the absence of respiratory events was correctly identified in 91% of occasions. Gender, obesity, and body position did not influence the accuracy of the Sonomat. PSG snore sensors differed in how much snoring was detected when compared to the Sonomat.

CONCLUSION

These data indicate that the Sonomat was reliable and accurate for the diagnosis of OSA. The provision of audible breath sound/snoring replay permits more accurate quantification of snoring. It requires no patient attachment and can be performed in the home with minimal training.

Non-contact monitoring techniques - Principles and applications

This work gives an overview about some non-contact methods for monitoring of physiological activity. In particular, the focus is on ballistocardiography, capacitive ECG, Infrared Thermography, Magnetic Impedance Monitroing and Photoplethymographic Imaging. The principles behind the methods are described and an inside into possible medical applications is offered.