1
|
Martínez-Suárez F, Alvarado-Serrano C, Casas O. Robust algorithm for the detection and classification of QRS complexes with different morphologies using the continuous spline wavelet transform with automatic scale detection. Biomed Phys Eng Express 2024; 10:025008. [PMID: 38109783 DOI: 10.1088/2057-1976/ad16c0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 12/18/2023] [Indexed: 12/20/2023]
Abstract
This work presents an algorithm for the detection and classification of QRS complexes based on the continuous wavelet transform (CWT) with splines. This approach can evaluate the CWT at any integer scale and the analysis is not restricted to powers of two. The QRS detector comprises four stages: implementation of CWT with splines, detection of QRS complexes, searching for undetected QRS complexes, and correction of the R wave peak location in detected QRS complexes. After, the onsets and ends of the QRS complexes are detected. The algorithm was evaluated with synthetic ECG and with the manually annotated databases: MIT-BIH Arrhythmia, European ST-T, QT and PTB Diagnostic ECG. Evaluation results of the QRS detector were: MIT-BIH arrhythmia database (109,447 beats analyzed), sensitivity Se = 99.72% and positive predictivity P+ = 99.87%; European ST-T database (790522 beats analyzed), Se = 99.92% and P+ = 99.55% and QT database (86498 beats analyzed), Se = 99.97% and P+ = 99.99%. To evaluate the delineation algorithm of the QRS onset (Qi) and QRS end (J) with the QT and PTB Diagnostic ECG databases, the mean and standard deviations of the differences between the automatic and manual annotated location of these points were calculated. The standard deviations were close to the accepted tolerances for deviations determined by the CSE experts. The proposed algorithm is robust to noise, artifacts and baseline drifts, classifies QRS complexes, automatically selects the CWT scale according to the sampling frequency of the ECG record used, and adapts to changes in the heart rate, amplitude and morphology of QRS complexes.
Collapse
Affiliation(s)
- Frank Martínez-Suárez
- Bioelectronics Section, Department of Electrical Engineering, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional (CINVESTAV) , Mexico City 07360, Mexico
- Instrumentation, Sensors and Interfaces Group, Universitat Politècnica de Catalunya (Barcelona Tech), Barcelona, Spain
| | - Carlos Alvarado-Serrano
- Bioelectronics Section, Department of Electrical Engineering, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional (CINVESTAV) , Mexico City 07360, Mexico
| | - Oscar Casas
- Instrumentation, Sensors and Interfaces Group, Universitat Politècnica de Catalunya (Barcelona Tech), Barcelona, Spain
| |
Collapse
|
2
|
Chen X, Xie H, Li Z, Cheng G, Leng M, Wang FL. Information fusion and artificial intelligence for smart healthcare: a bibliometric study. Inf Process Manag 2023. [DOI: 10.1016/j.ipm.2022.103113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
3
|
Chen F, Chen Z, Sun H, Zhu J, Wu K, Zhou S, Huang Y. Dendrobium candidum quality detection in both food and medicine agricultural product: Policy, status, and prospective. FRONTIERS IN SUSTAINABLE FOOD SYSTEMS 2022. [DOI: 10.3389/fsufs.2022.1042901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2022] Open
Abstract
Dendrobium candidum (DC) is an agricultural product for both food and medicine. It has a variety of beneficial effects on the human body with antioxidant, anti-inflammatory, antitumor, enhancing immune function, and other pharmacological activities. Due to less natural distribution, harsh growth conditions, slow growth, low reproduction rate, and excessive logging, wild DC has been seriously damaged and listed as an endangered herbal medicine variety in China. At present, the quality of DC was uneven in the market, so it is very necessary to detect its quality. This article summarized the methods of DC quality detection with traditional and rapid nondestructive, and it also expounded the correlation between DC quality factor and endophytes, which provides a theoretical basis for a variety of rapid detection methods in macromolecules. At last, this article put forward a variety of rapid nondestructive detection methods based on the emission spectrum. In view of the complexity of molecular structure, the quality correlation established by spectral analysis was greatly affected by varieties and environment. We discussed the possibility of DC quality detection based on the molecular dynamic calculation and simulation mechanism. Also, a multimodal fusion method was proposed to detect the quality. The literature review suggests that it is very necessary to understand the structure performance relationship, kinetic properties, and reaction characteristics of chemical substances at the molecular level by means of molecular chemical calculation and simulation, to detect a certain substance more accurately. At the same time, several modes are combined to form complementarity, eliminate ambiguity, and uncertainty and fuse the information of multiple modes to obtain more accurate judgment results.
Collapse
|
4
|
Mertes G, Long Y, Liu Z, Li Y, Yang Y, Clifton DA. A Deep Learning Approach for the Assessment of Signal Quality of Non-Invasive Foetal Electrocardiography. SENSORS (BASEL, SWITZERLAND) 2022; 22:3303. [PMID: 35591004 PMCID: PMC9103336 DOI: 10.3390/s22093303] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Revised: 05/28/2021] [Accepted: 06/01/2021] [Indexed: 06/15/2023]
Abstract
Non-invasive foetal electrocardiography (NI-FECG) has become an important prenatal monitoring method in the hospital. However, due to its susceptibility to non-stationary noise sources and lack of robust extraction methods, the capture of high-quality NI-FECG remains a challenge. Recording waveforms of sufficient quality for clinical use typically requires human visual inspection of each recording. A Signal Quality Index (SQI) can help to automate this task but, contrary to adult ECG, work on SQIs for NI-FECG is sparse. In this paper, a multi-channel signal quality classifier for NI-FECG waveforms is presented. The model can be used during the capture of NI-FECG to assist technicians to record high-quality waveforms, which is currently a labour-intensive task. A Convolutional Neural Network (CNN) is trained to distinguish between NI-FECG segments of high and low quality. NI-FECG recordings with one maternal channel and three abdominal channels were collected from 100 subjects during a routine hospital screening (102.6 min of data). The model achieves an average 10-fold cross-validated AUC of 0.95 ± 0.02. The results show that the model can reliably assess the FECG signal quality on our dataset. The proposed model can improve the automated capture and analysis of NI-FECG as well as reduce technician labour time.
Collapse
Affiliation(s)
- Gert Mertes
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX1 2JD, UK; (G.M.); (Z.L.); (D.A.C.)
- Oxford Suzhou Centre for Advanced Research, Suzhou 215123, China
| | - Yuan Long
- Department of Cardiovascular Medicine, Wuhan Children’s Hospital (Wuhan Maternal and Child Healthcare Hospital), Huazhong University of Science and Technology, Wuhan 430015, China;
| | - Zhangdaihong Liu
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX1 2JD, UK; (G.M.); (Z.L.); (D.A.C.)
- Oxford Suzhou Centre for Advanced Research, Suzhou 215123, China
| | - Yuhui Li
- Department of Oncology, Central Hospital of Wuhan, Huazhong University of Science and Technology, Wuhan 430014, China;
| | - Yang Yang
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX1 2JD, UK; (G.M.); (Z.L.); (D.A.C.)
- Oxford Suzhou Centre for Advanced Research, Suzhou 215123, China
| | - David A. Clifton
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX1 2JD, UK; (G.M.); (Z.L.); (D.A.C.)
- Oxford Suzhou Centre for Advanced Research, Suzhou 215123, China
| |
Collapse
|
5
|
Altuve M, Monroy NF. Hidden Markov model-based heartbeat detector using electrocardiogram and arterial pressure signals. Biomed Eng Lett 2021; 11:249-261. [PMID: 34350051 DOI: 10.1007/s13534-021-00192-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 05/04/2021] [Accepted: 05/23/2021] [Indexed: 11/25/2022] Open
Abstract
The automatic detection of a heartbeat is commonly performed by detecting the QRS complex in the electrocardiogram (ECG), however, various noise sources and missing data can jeopardize the reliability of the ECG. Therefore, there is a growing interest in combining the information from many physiological signals to accurately detect heartbeats. To this end, hidden Markov models (HMMs) are used in this work to jointly exploit the information from ECG, arterial blood pressure (ABP) and pulmonary arterial pressure (PAP) signals in order to conceive a heartbeat detector. After preprocessing the physiological signals, a sliding window is used to extract an observation sequence to be passed through two HMMs (previously trained on a training dataset) in order to obtain the log-likelihoods of observation and signals a detection if the difference of log-likelihoods exceeds an adaptive threshold. Several HMM-based heartbeat detectors were conceived to exploit the information from the ECG, ABP and PAP signals from the MIT-BIH Arrhythmia, PhysioNet Computing in Cardiology Challenge 2014, and MGH/MF Waveform databases. A grid search methodology was used to optimize the duration of the observation sequence and a multiplicative factor to form the adaptive threshold. Using the optimal parameters found on a training database through 10-fold cross-validation, sensitivity and positive predictivity above 99% were obtained on the MIT-BIH Arrhythmia and PhysioNet Computing in Cardiology Challenge 2014 databases, while they are above 95% in the MGH/MF waveform database using ECG and ABP signals. Our detector approach showed detection performances comparable with the literature in the three databases. Supplementary Information The online version contains supplementary material available at 10.1007/s13534-021-00192-x.
Collapse
Affiliation(s)
- Miguel Altuve
- Valencian International University, Valencia, Spain
- Applied Biophysics and Bioengineering Group, Simon Bolivar University, Caracas, Venezuela
| | - Nelson F Monroy
- Faculty of Systems and Informatics Engineering, Pontifical Bolivarian University, Bucaramanga, Colombia
| |
Collapse
|
6
|
|
7
|
Cai B, Zhang L, Shi Y. Control Synthesis of Hidden Semi-Markov Uncertain Fuzzy Systems via Observations of Hidden Modes. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:3709-3718. [PMID: 31329568 DOI: 10.1109/tcyb.2019.2921811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This paper investigates the stability analysis and fuzzy control problems for a class of discrete-time fuzzy systems with hidden semi-Markov stochastic uncertainties. The nonlinear plant is described via the Takagi-Sugeno (T-S) fuzzy model, and the parameter uncertainties are represented by a hidden semi-Markov chain. Owing to the semi-Markov kernel (SMK), the probability density functions (PDFs) of sojourn time for different modes in describing the stochastic uncertainties can address different types of distributions according to different target modes. A novel Lyapunov function that depends on the hidden mode and the observed mode with the elapsed time is proposed to analyze the stability and the H∞ performance of the fuzzy system. Then, the sufficient criteria for the elapsed-time-dependent and observed-mode-dependent fuzzy controller are achieved by exploiting the observations of hidden modes, ensuring that the closed-loop system is σ -error mean square stable with guaranteed H∞ performance. A cart-pendulum system is used to demonstrate the effectiveness and applicability of the proposed theoretical results.
Collapse
|
8
|
Akhavan S, Phlypo R, Soltanian-Zadeh H, Kamarei M, Jutten C. A dictionary learning approach for spatio-temporal characterization of absence seizures. Physiol Meas 2019; 40:105008. [PMID: 31569077 DOI: 10.1088/1361-6579/ab4962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE This research explores absence seizures using data recorded from different layers of somatosensory cortex of four genetic absence epilepsy rats from Strasbourg (GAERS). Localizing the active layers of somatosensory cortex (spatial analysis) and investigating the dynamics of recorded seizures (temporal analysis) are the main goals of this research. APPROACH We model the spike discharges of seizures using a generative spatio-temporal model. We assume that there are some states under first-order Markovian model during seizures, and each spike is generated when the corresponding state is activated. We also assume that a few specific epileptic activities (or atoms) exist in each state which are linearly combined and form the spikes. Each epileptic activity is described by two characteristics: (1) its spatial topography which shows the organization of current sources and sinks generating the epileptic activity, and (2) its temporal representation which illustrates the activation function of the epileptic activity. We show that the estimation of the model parameters, i.e. states and their epileptic activities (atoms), is similar to solving a dictionary learning problem for sparse representation. Instead of using classical dictionary learning algorithms, a new approach, taking into account the Markovian nature of the model, is proposed for estimating the models parameters, and its efficiency is experimentally verified. MAIN RESULTS Experimental results show that there are one dominant and one unstable state with two epileptic activities in each during the seizures (temporal analysis). It is also found that the top and bottom layers of the somatosensory cortex are the most active layers during seizures (spatial analysis). The structural model is similar for all rats with a spatial topography which is the same for all rats but a temporal activation which changes according to the rat. SIGNIFICANCE The proposed framework can be applied on any database acquired from a small area of the brain, and can provide valuable spatio-temporal analysis for neuroscientists.
Collapse
Affiliation(s)
- S Akhavan
- University Grenoble Alpes, Grenoble INP, CNRS, GIPSA-lab, Grenoble, France. CIPCE, School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran
| | | | | | | | | |
Collapse
|
9
|
Tejedor J, García CA, Márquez DG, Raya R, Otero A. Multiple Physiological Signals Fusion Techniques for Improving Heartbeat Detection: A Review. SENSORS 2019; 19:s19214708. [PMID: 31671921 PMCID: PMC6864881 DOI: 10.3390/s19214708] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/04/2019] [Revised: 10/10/2019] [Accepted: 10/24/2019] [Indexed: 01/26/2023]
Abstract
This paper presents a review of the techniques found in the literature that aim to achieve a robust heartbeat detection from fusing multi-modal physiological signals (e.g., electrocardiogram (ECG), blood pressure (BP), artificial blood pressure (ABP), stroke volume (SV), photoplethysmogram (PPG), electroencephalogram (EEG), electromyogram (EMG), and electrooculogram (EOG), among others). Techniques typically employ ECG, BP, and ABP, of which usage has been shown to obtain the best performance under challenging conditions. SV, PPG, EMG, EEG, and EOG signals can help increase performance when included within the fusion. Filtering, signal normalization, and resampling are common preprocessing steps. Delay correction between the heartbeats obtained over some of the physiological signals must also be considered, and signal-quality assessment to retain the best signal/s must be considered as well. Fusion is usually accomplished by exploiting regularities in the RR intervals; by selecting the most promising signal for the detection at every moment; by a voting process; or by performing simultaneous detection and fusion using Bayesian techniques, hidden Markov models, or neural networks. Based on the results of the review, guidelines to facilitate future comparison of the performance of the different proposals are given and promising future lines of research are pointed out.
Collapse
Affiliation(s)
- Javier Tejedor
- Department of Information Technology, Escuela Politécnica Superior, Universidad San Pablo-CEU, CEU Universities, Campus Montepríncipe, Boadilla del Monte, 28668 Madrid, Spain.
| | - Constantino A García
- Department of Information Technology, Escuela Politécnica Superior, Universidad San Pablo-CEU, CEU Universities, Campus Montepríncipe, Boadilla del Monte, 28668 Madrid, Spain.
| | - David G Márquez
- Department of Information Technology, Escuela Politécnica Superior, Universidad San Pablo-CEU, CEU Universities, Campus Montepríncipe, Boadilla del Monte, 28668 Madrid, Spain.
| | - Rafael Raya
- Department of Information Technology, Escuela Politécnica Superior, Universidad San Pablo-CEU, CEU Universities, Campus Montepríncipe, Boadilla del Monte, 28668 Madrid, Spain.
| | - Abraham Otero
- Department of Information Technology, Escuela Politécnica Superior, Universidad San Pablo-CEU, CEU Universities, Campus Montepríncipe, Boadilla del Monte, 28668 Madrid, Spain.
| |
Collapse
|
10
|
Tabei F, Zaman R, Foysal KH, Kumar R, Kim Y, Chong JW. A novel diversity method for smartphone camera-based heart rhythm signals in the presence of motion and noise artifacts. PLoS One 2019; 14:e0218248. [PMID: 31216314 PMCID: PMC6583971 DOI: 10.1371/journal.pone.0218248] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2018] [Accepted: 05/29/2019] [Indexed: 11/27/2022] Open
Abstract
The advent of smartphones has advanced the use of embedded sensors to acquire various physiological information. For example, smartphone camera sensors and accelerometers can provide heart rhythm signals to the subjects, while microphones can give respiratory signals. However, the acquired smartphone-based physiological signals are more vulnerable to motion and noise artifacts (MNAs) compared to using medical devices, since subjects need to hold the smartphone with proper contact to the smartphone camera and lens stably and tightly for a duration of time without any movement in the hand or finger. This results in more MNA than traditional methods, such as placing a finger inside a tightly enclosed pulse oximeter to get PPG signals, which provides stable contact between the sensor and the subject's finger. Moreover, a smartphone lens does not block ambient light in an effective way, while pulse oximeters are designed to block the ambient light effectively. In this paper, we propose a novel diversity method for smartphone signals that reduces the effect of MNAs during heart rhythm signal detection by 1) acquiring two heterogeneous signals from a color intensity signal and a fingertip movement signal, and 2) selecting the less MNA-corrupted signal of the two signals. The proposed method has advantages in that 1) diversity gain can be obtained from the two heterogeneous signals when one signal is clean while the other signal is corrupted, and 2) acquisition of the two heterogeneous signals does not double the acquisition procedure but maintains a single acquisition procedure, since two heterogeneous signals can be obtained from a single smartphone camera recording. In our diversity method, we propose to choose the better signal based on the signal quality indices (SQIs), i.e., standard deviation of instantaneous heart rate (STD-HR), root mean square of the successive differences of peak-to-peak time intervals (RMSSD-T), and standard deviation of peak values (STD-PV). As a performance metric evaluating the proposed diversity method, the ratio of usable period is considered. Experimental results show that our diversity method increases the usable period 19.53% and 6.25% compared to the color intensity or the fingertip movement signals only, respectively.
Collapse
Affiliation(s)
- Fatemehsadat Tabei
- Dept. of Electrical and Computer Engineering, Texas Tech University, Lubbock, TX 79401, United States of America
| | - Rifat Zaman
- Dept. of Electrical and Computer Engineering, Texas Tech University, Lubbock, TX 79401, United States of America
| | - Kamrul H. Foysal
- Dept. of Electrical and Computer Engineering, Texas Tech University, Lubbock, TX 79401, United States of America
| | - Rajnish Kumar
- Dept. of Electrical and Computer Engineering, Texas Tech University, Lubbock, TX 79401, United States of America
| | - Yeesock Kim
- Dept. of Civil Engineering and Construction Management, California Baptist University, Riverside, CA 92504, United States of America
| | - Jo Woon Chong
- Dept. of Electrical and Computer Engineering, Texas Tech University, Lubbock, TX 79401, United States of America
| |
Collapse
|
11
|
Khavas ZR, Asl BM. Robust heartbeat detection using multimodal recordings and ECG quality assessment with signal amplitudes dispersion. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 163:169-182. [PMID: 30119851 DOI: 10.1016/j.cmpb.2018.06.009] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2017] [Revised: 03/11/2018] [Accepted: 06/07/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVES The electrocardiogram (ECG) is a bioelectric signal which represents heart's electrical activity graphically. This bioelectric signal is subject of lots of researches and so many algorithms are designed for extracting lots of clinically important parameters from it. Most of these parameters can be measured by detecting R peak of the QRS complex in ECG signal, but when ECG signal is corrupted by different kinds of noise and artifacts, such as electromyogram (EMG) from muscles, power line interference, motion artifacts and changes in electrode-skin interface, detection of R peaks becomes hard or impossible for algorithms which are designed for heart beat detection on ECG signal. In modern patient monitoring devices often not only one ECG signal is recorded but also so many other biological signals are simultaneously recorded from the patient which some of them, such as blood pressure (BP), are containing useful information about the heart activity which could be very helpful in making the heart beat detection more robust. METHODS In this study, a new method is introduced for distinguishing noise free segments of ECG from noisy segments that uses samples amplitudes dispersion with an adaptive threshold for variance of samples amplitude and a method which uses compatibility of detected beats in ECG and some of other signals which are related to the heart activity such as BP, arterial pressure (ART) and pulmonary artery pressure (PAP). A prioritization is applied in other pulsatile signals based on the amplitude and clarity of peaks on them, and a fusion strategy is employed for segments on which ECG is noisy and other available signals in the data, which contain peaks corresponding to R peak of the ECG, are scored in a three steps scoring function. RESULTS The final scores achieved by the proposed algorithm in terms of average sensitivity, positive predictive value, accuracy and F1 measure on the database which is freely available in Physionet Computing in Cardiology Challenge 2014 are respectively 95.47%, 96.03%, 93.11% and 95.62%. CONCLUSIONS The results show the outperformance of the proposed method against other recently published works.
Collapse
Affiliation(s)
- Zahra Rezaei Khavas
- Electrical and Computer Engineering Department, Tarbiat Modares University, Tehran, Iran
| | | |
Collapse
|
12
|
Birrenkott DA, Pimentel MA, Watkinson PJ, Clifton DA. A Robust Fusion Model for Estimating Respiratory Rate From Photoplethysmography and Electrocardiography. IEEE Trans Biomed Eng 2018; 65:2033-2041. [DOI: 10.1109/tbme.2017.2778265] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
13
|
Chandra BS, Sastry CS, Jana S. Robust Heartbeat Detection From Multimodal Data via CNN-Based Generalizable Information Fusion. IEEE Trans Biomed Eng 2018; 66:710-717. [PMID: 30004868 DOI: 10.1109/tbme.2018.2854899] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Heartbeat detection remains central to cardiac disease diagnosis and management, and is traditionally performed based on electrocardiogram (ECG). To improve robustness and accuracy of detection, especially, in certain critical-care scenarios, the use of additional physiological signals such as arterial blood pressure (BP) has recently been suggested. Therefore, estimation of heartbeat location requires information fusion from multiple signals. However, reported efforts in this direction often obtain multimodal estimates somewhat indirectly, by voting among separately obtained signal-specific intermediate estimates. In contrast, we propose to directly fuse information from multiple signals without requiring intermediate estimates, and thence estimate heartbeat location in a robust manner. METHOD We propose as a heartbeat detector, a convolutional neural network (CNN) that learns fused features from multiple physiological signals. This method eliminates the need for hand-picked signal-specific features and ad hoc fusion schemes. Furthermore, being data-driven, the same algorithm learns suitable features from arbitrary set of signals. RESULTS Using ECG and BP signals of PhysioNet 2014 Challenge database, we obtained a score of 94%. Furthermore, using two ECG channels of MIT-BIH arrhythmia database, we scored 99.92%. Both those scores compare favorably with previously reported database-specific results. Also, our detector achieved high accuracy in a variety of clinical conditions. CONCLUSION The proposed CNN-based information fusion (CIF) algorithm is generalizable, robust and efficient in detecting heartbeat location from multiple signals. SIGNIFICANCE In medical signal monitoring systems, our technique would accurately estimate heartbeat locations even when only a subset of channels are reliable.
Collapse
|
14
|
Zhu T, Johnson AEW, Yang Y, Clifford GD, Clifton DA. Bayesian fusion of physiological measurements using a signal quality extension. Physiol Meas 2018; 39:065008. [PMID: 29808824 DOI: 10.1088/1361-6579/aac856] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE The fusion of multiple noisy labels for biomedical data (such as ECG annotations, which may be obtained from human experts or from automated systems) into a single robust annotation has many applications in physiologic monitoring. Directly modelling the difficulty of the task has the potential to improve the fusion of such labels. This paper proposes a means for the incorporation of task difficulty, as quantified by 'signal quality', into the fusion process. APPROACH We propose a Bayesian fusion model to infer a consensus through aggregating labels, where the labels are provided by multiple imperfect automated algorithms (or 'annotators'). Our model incorporates the signal quality of the underlying recording when fusing labels. We compare our proposed model with previously published approaches. Two publicly available datasets were used to demonstrate the feasibility of our proposed model: one focused on QT interval estimation in the ECG and the other focused on respiratory rate (RR) estimation from the photoplethysmogram (PPG). We inferred the hyperparameters of our model using maximum- a posteriori inference and Gibbs sampling. MAIN RESULTS For the QT dataset, our model significantly outperformed the previously published models (root-mean-square error of [Formula: see text] ms for our model versus [Formula: see text] ms from the best existing model) when fusing labels from only three annotators. For the RR dataset, no improvement was observed compared to the same model without signal quality modelling, where our model outperformed existing models (mean-absolute error of [Formula: see text] bpm for our model versus [Formula: see text] bpm from the best existing model). We conclude that our approach demonstrates the feasibility of using a signal quality metric as a confidence measure to improve label fusion. SIGNIFICANCE Our Bayesian learning model provides an extension over existing work to incorporate signal quality as a confidence measure to improve the reliability of fusing labels from biomedical datasets.
Collapse
Affiliation(s)
- Tingting Zhu
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, United Kingdom
| | | | | | | | | |
Collapse
|
15
|
Singh O, Sunkaria RK. A new approach for identification of heartbeats in multimodal physiological signals. J Med Eng Technol 2018; 42:182-186. [PMID: 29671366 DOI: 10.1080/03091902.2018.1457093] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
In this paper, a technique is proposed for detection of heartbeats in multimodal data. Recording of multiple physiological signals from the same subject is common practice nowadays. Multiple physiological signals are generally available but are processed separately without taking into consideration information from other relevant signals. The heartbeats are generally detected from R peaks in electrocardiogram (ECG) signal, however, if ECG is noisy, other signals reflecting the cardiac activity may be used for identifying heartbeats. This paper describes a new method for detection of heartbeats using ECG and arterial blood pressure (ABP) signals. The physiological data are segmented into various fragments and signal quality is determined using the judgment of noise level. If the ECG data fragment is noisy, heartbeats are computed from the ABP fragment. The evaluation was performed on training data set of computing in cardiology challenge 2014. The proposed methodology has resulted in better detection accuracy as compared to the unimodal methods.
Collapse
Affiliation(s)
- Omkar Singh
- a Department of Electronics and Communication Engineering , National Institute of Technology , Jalandhar , India
| | - Ramesh Kumar Sunkaria
- a Department of Electronics and Communication Engineering , National Institute of Technology , Jalandhar , India
| |
Collapse
|
16
|
Singh O, Sunkaria RK. Heartbeat detection in multimodal physiological signals using signal quality assessment based on sample entropy. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2017; 40:917-923. [PMID: 28887765 DOI: 10.1007/s13246-017-0585-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2017] [Accepted: 09/04/2017] [Indexed: 11/25/2022]
Abstract
This paper presents a novel technique to identify heartbeats in multimodal data using electrocardiogram (ECG) and arterial blood pressure (ABP) signals. Multiple physiological signals such as ECG, ABP, and Respiration are often recorded in parallel from the activity of heart. These signals generally possess related information as they are generated by the same physical system. The ECG and ABP correspond to the same phenomenon of contraction and relaxation activity of heart. Multiple signals acquired from various sensors are generally processed independently, thus discarding the information from other measurements. In the estimation of heart rate and heart rate variability, the R peaks are generally identified from ECG signal. Efficient detection of R-peaks in electrocardiogram (ECG) is a key component in the estimation of clinically relevant parameters from ECG. However, when the signal is severely affected by undesired artifacts, this becomes a challenging task. Sometimes in clinical environment, other physiological signals reflecting the cardiac activity such as ABP signal are also acquired simultaneously. Under the availability of such multimodal signals, the accuracy of R peak detection methods can be improved using sensor-fusion techniques. In the proposed method, the sample entropy (SampEn) is used as a metric for assessing the noise content in the physiological signal and the R peaks in ECG and the systolic peaks in ABP signals are fused together to enhance the efficiency of heartbeat detection. The proposed method was evaluated on the 100 records from the computing in cardiology challenge 2014 training data set. The performance parameters are: sensitivity (Se) and positive predictivity (PPV). The unimodal R peaks detector achieved: Se gross = 99.40%, PPV gross = 99.29%, Se average = 99.37%, PPV average = 99.29%. Similarly unimodal BP delineator achieved Se gross = 99.93%, PPV gross = 99.99%, Se average = 99.93%, PPV average = 99.99% whereas, the proposed multimodal beat detector achieved: Se gross = 99.65%, PPV gross = 99.91%, Se average = 99.68%, PPV average = 99.91%.
Collapse
Affiliation(s)
- Omkar Singh
- Department of Electronics and Communication Engineering, National Institute of Technology, Jalandhar, Punjab, 144 011, India.
| | - Ramesh Kumar Sunkaria
- Department of Electronics and Communication Engineering, National Institute of Technology, Jalandhar, Punjab, 144 011, India
| |
Collapse
|
17
|
Park C, Shin H, Lee B. Blockwise PPG Enhancement Based on Time-Variant Zero-Phase Harmonic Notch Filtering. SENSORS 2017; 17:s17040860. [PMID: 28420086 PMCID: PMC5424737 DOI: 10.3390/s17040860] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2017] [Revised: 04/03/2017] [Accepted: 04/11/2017] [Indexed: 11/16/2022]
Abstract
So far, many approaches have been developed for motion artifact (MA) reduction from photoplethysmogram (PPG). Specifically, single-input MA reduction methods are useful to apply wearable and mobile healthcare systems because of their low hardware costs and simplicity. However, most of them are insufficiently developed to be used in real-world situations, and they suffer from a phase distortion problem. In this study, we propose a novel single-input MA reduction algorithm based on time-variant forward-backward harmonic notch filtering. To verify the proposed method, we collected real PPG data corrupted by MA and compared it with existing single-input MA reduction methods. In conclusion, the proposed zero-phase line enhancer (ZLE) was found to be superior for MA reduction and exhibited zero phase response.
Collapse
Affiliation(s)
- Chanki Park
- School of Mechanical Engineering, Gwangju Institute of Science and Technology (GIST), Gwangju 61005, Korea.
| | - Hyunsoon Shin
- Emotion Recognition IoT Research Section, Hyper-connected Communication Research Laboratory, Electronic and Telecommunications Research Institute (ETRI), Daejeon 34129, Korea.
| | - Boreom Lee
- Department of Biomedical Science and Engineering (BMSE), Institute of Integrated Technology (IIT), Gwangju Institute of Science and Technology (GIST), Gwangju 61005, Korea.
| |
Collapse
|
18
|
Birrenkott DA, Pimentel MAF, Watkinson PJ, Clifton DA. Robust estimation of respiratory rate via ECG- and PPG-derived respiratory quality indices. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:676-679. [PMID: 28268418 DOI: 10.1109/embc.2016.7590792] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Respiratory rate (RR) is one of the most informative indicators of a patient's health status. However, automated, non-invasive measurements of RR are insufficiently robust for use in clinical practice. A number of methods have been described in the literature to estimate RR from both photo-plethysmography (PPG) and electrocardiography (ECG) based on three physiological modulations of respiration: amplitude modulation (AM), frequency modulation (FM), and baseline wander (BW). However, the quality of the respiratory information acquired is highly patient-dependent and often too noisy to be used. We address this by proposing respiratory quality indices (RQIs) that quantify the quality of the respiratory signal that can be extracted from each modulation from both PPG and ECG waveforms. Signal quality indices (SQIs) detect artefact in the ECG and PPG, which is relatively straight-forward. RQIs have a different role: they quantify if an individual patient's physiology is modulating the sensor waveforms. We have designed four RQIs based on Fourier transform (RQIFFT), autocorrelation (RQIAC), autoregression (RQIAR), and Hjorth complexity (RQIHC). We validated the approach using PPG and ECG data in the CapnoBase and MIMIC II datasets. We conclude that the novel implementation of an RQI-based preprocessing step has the potential to improve substantially the performance of RR estimation algorithms.
Collapse
|
19
|
Andreotti F, Graser F, Malberg H, Zaunseder S. Non-invasive Fetal ECG Signal Quality Assessment for Multichannel Heart Rate Estimation. IEEE Trans Biomed Eng 2017; 64:2793-2802. [PMID: 28362581 DOI: 10.1109/tbme.2017.2675543] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE The noninvasive fetal ECG (NI-FECG) from abdominal recordings offers novel prospects for prenatal monitoring. However, NI-FECG signals are corrupted by various nonstationary noise sources, making the processing of abdominal recordings a challenging task. In this paper, we present an online approach that dynamically assess the quality of NI-FECG to improve fetal heart rate (FHR) estimation. METHODS Using a naive Bayes classifier, state-of-the-art and novel signal quality indices (SQIs), and an existing adaptive Kalman filter, FHR estimation was improved. For the purpose of training and validating the proposed methods, a large annotated private clinical dataset was used. RESULTS The suggested classification scheme demonstrated an accuracy of Krippendorff's alpha in determining the overall quality of NI-FECG signals. The proposed Kalman filter outperformed alternative methods for FHR estimation achieving accuracy. CONCLUSION The proposed algorithm was able to reliably reflect changes of signal quality and can be used in improving FHR estimation. SIGNIFICANCE NI-ECG signal quality estimation and multichannel information fusion are largely unexplored topics. Based on previous works, multichannel FHR estimation is a field that could strongly benefit from such methods. The developed SQI algorithms as well as resulting classifier were made available under a GNU GPL open-source license and contributed to the FECGSYN toolbox.
Collapse
|
20
|
Pimentel MAF, Johnson AEW, Charlton PH, Birrenkott D, Watkinson PJ, Tarassenko L, Clifton DA. Toward a Robust Estimation of Respiratory Rate From Pulse Oximeters. IEEE Trans Biomed Eng 2016; 64:1914-1923. [PMID: 27875128 PMCID: PMC6051482 DOI: 10.1109/tbme.2016.2613124] [Citation(s) in RCA: 81] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
Goal: Current methods for estimating respiratory rate (RR) from the photoplethysmogram (PPG)
typically fail to distinguish between periods of high- and low-quality input data, and fail to perform well on
independent “validation” datasets. The lack of robustness of existing methods directly results in a lack
of penetration of such systems into clinical practice. The present work proposes an alternative method to improve the
robustness of the estimation of RR from the PPG. Methods: The proposed algorithm is based on the use
of multiple autoregressive models of different orders for determining the dominant respiratory frequency in the three
respiratory-induced variations (frequency, amplitude, and intensity) derived from the PPG. The algorithm was tested on
two different datasets comprising 95 eight-minute PPG recordings (in total) acquired from both children and adults in
different clinical settings, and its performance using two window sizes (32 and 64 seconds) was compared with that of
existing methods in the literature. Results: The proposed method achieved comparable accuracy to
existing methods in the literature, with mean absolute errors (median, 25\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{upgreek}
\usepackage{mathrsfs}
\setlength{\oddsidemargin}{-69pt}
\begin{document}
}{}
$\text {th}$\end{document}–75\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{upgreek}
\usepackage{mathrsfs}
\setlength{\oddsidemargin}{-69pt}
\begin{document}
}{}$\text {th}$\end{document} percentiles for a window size of 32 seconds) of 1.5 (0.3–3.3) and 4.0 (1.8–5.5) breaths
per minute (for each dataset respectively), whilst providing RR estimates for a greater proportion of windows (over
90% of the input data are kept). Conclusion: Increased robustness of RR estimation by the
proposed method was demonstrated. Significance: This work demonstrates that the use of large publicly
available datasets is essential for improving the robustness of wearable-monitoring algorithms for use in clinical
practice.
Collapse
Affiliation(s)
- Marco A F Pimentel
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, U.K
| | - Alistair E W Johnson
- Institute for Medical Engineering & ScienceMassachusetts Institute of Technology
| | | | - Drew Birrenkott
- Department of Engineering ScienceInstitute of Biomedical EngineeringUniversity of Oxford
| | | | - Lionel Tarassenko
- Department of Engineering ScienceInstitute of Biomedical EngineeringUniversity of Oxford
| | - David A Clifton
- Department of Engineering ScienceInstitute of Biomedical EngineeringUniversity of Oxford
| |
Collapse
|
21
|
Ding Q, Bai Y, Erol YB, Salas-Boni R, Zhang X, Hu X. Robust QRS peak detection by multimodal information fusion of ECG and blood pressure signals. Physiol Meas 2016; 37:N84-N95. [PMID: 27734807 DOI: 10.1088/0967-3334/37/11/n84] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
QRS peak detection is a challenging problem when ECG signal is corrupted. However, additional physiological signals may also provide information about the QRS position. In this study, we focus on a unique benchmark provided by PhysioNet/Computing in Cardiology Challenge 2014 and Physiological Measurement focus issue: robust detection of heart beats in multimodal data, which aimed to explore robust methods for QRS detection in multimodal physiological signals. A dataset of 200 training and 210 testing records are used, where the testing records are hidden for evaluating the performance only. An information fusion framework for robust QRS detection is proposed by leveraging existing ECG and ABP analysis tools and combining heart beats derived from different sources. Results show that our approach achieves an overall accuracy of 90.94% and 88.66% on the training and testing datasets, respectively. Furthermore, we observe expected performance at each step of the proposed approach, as an evidence of the effectiveness of our approach. Discussion on the limitations of our approach is also provided.
Collapse
Affiliation(s)
- Quan Ding
- The Home Depot Techshed, Foster City, CA, USA
| | | | | | | | | | | |
Collapse
|
22
|
Eerikäinen LM, Vanschoren J, Rooijakkers MJ, Vullings R, Aarts RM. Reduction of false arrhythmia alarms using signal selection and machine learning. Physiol Meas 2016; 37:1204-16. [PMID: 27454128 DOI: 10.1088/0967-3334/37/8/1204] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
In this paper, we propose an algorithm that classifies whether a generated cardiac arrhythmia alarm is true or false. The large number of false alarms in intensive care is a severe issue. The noise peaks caused by alarms can be high and in a noisy environment nurses can experience stress and fatigue. In addition, patient safety is compromised because reaction time of the caregivers to true alarms is reduced. The data for the algorithm development consisted of records of electrocardiogram (ECG), arterial blood pressure, and photoplethysmogram signals in which an alarm for either asystole, extreme bradycardia, extreme tachycardia, ventricular fibrillation or flutter, or ventricular tachycardia occurs. First, heart beats are extracted from every signal. Next, the algorithm selects the most reliable signal pair from the available signals by comparing how well the detected beats match between different signals based on [Formula: see text]-score and selecting the best match. From the selected signal pair, arrhythmia specific features, such as heart rate features and signal purity index are computed for the alarm classification. The classification is performed with five separate Random Forest models. In addition, information on the local noise level of the selected ECG lead is added to the classification. The algorithm was trained and evaluated with the PhysioNet/Computing in Cardiology Challenge 2015 data set. In the test set the overall true positive rates were 93 and 95% and true negative rates 80 and 83%, respectively for events with no information and events with information after the alarm. The overall challenge scores were 77.39 and 81.58.
Collapse
Affiliation(s)
- Linda M Eerikäinen
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ, Eindhoven, The Netherlands
| | | | | | | | | |
Collapse
|
23
|
Gambarotta N, Aletti F, Baselli G, Ferrario M. A review of methods for the signal quality assessment to improve reliability of heart rate and blood pressures derived parameters. Med Biol Eng Comput 2016; 54:1025-35. [PMID: 26906277 DOI: 10.1007/s11517-016-1453-5] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2014] [Accepted: 01/29/2016] [Indexed: 12/01/2022]
Abstract
The assessment of signal quality has been a research topic since the late 1970s, as it is mainly related to the problem of false alarms in bedside monitors in the intensive care unit (ICU), the incidence of which can be as high as 90 %, leading to alarm fatigue and a drop in the overall level of nurses and clinicians attention. The development of efficient algorithms for the quality control of long diagnostic electrocardiographic (ECG) recordings, both single- and multi-lead, and of the arterial blood pressure (ABP) signal is therefore essential for the enhancement of care quality. The ECG signal is often corrupted by noise, which can be within the frequency band of interest and can manifest similar morphologies as the ECG itself. Similarly to ECG, also the ABP signal is often corrupted by non-Gaussian, nonlinear and non-stationary noise and artifacts, especially in ICU recordings. Moreover, the reliability of several important parameters derived from ABP such as systolic blood pressure or pulse pressure is strongly affected by the quality of the ABP waveform. In this work, several up-to-date algorithms for the quality scoring of a single- or multi-lead ECG recording, based on time-domain approaches, frequency-domain approaches or a combination of the two will be reviewed, as well as methods for the quality assessment of ABP. Additionally, algorithms exploiting the relationship between ECG and pulsatile signals, such as ABP and photoplethysmographic recordings, for the reduction in the false alarm rate will be presented. Finally, some considerations will be drawn taking into account the large heterogeneity of clinical settings, applications and goals that the reviewed algorithms have to deal with.
Collapse
Affiliation(s)
- Nicolò Gambarotta
- Department of Electronics, Information and Bioengeneering, Politecnico di Milano, P.zza Leonardo da Vinci 32, 20133, Milan, Italy
| | - Federico Aletti
- Department of Electronics, Information and Bioengeneering, Politecnico di Milano, P.zza Leonardo da Vinci 32, 20133, Milan, Italy
| | - Giuseppe Baselli
- Department of Electronics, Information and Bioengeneering, Politecnico di Milano, P.zza Leonardo da Vinci 32, 20133, Milan, Italy
| | - Manuela Ferrario
- Department of Electronics, Information and Bioengeneering, Politecnico di Milano, P.zza Leonardo da Vinci 32, 20133, Milan, Italy.
| |
Collapse
|
24
|
Silva I, Moody B, Behar J, Johnson A, Oster J, Clifford GD, Moody GB. Robust detection of heart beats in multimodal data. Physiol Meas 2015. [PMID: 26217894 DOI: 10.1088/0967-3334/36/8/1629] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
This editorial reviews the background issues, the design, the key achievements, and the follow-up research generated as a result of the PhysioNet/Computing in Cardiology (CinC) Challenge 2014, published in the concurrent focus issue of Physiological Measurement. Our major focus was to accelerate the development and facilitate the comparison of robust methods for locating heart beats in long-term multi-channel recordings. A public (training) database consisting of 151 032 annotated beats was compiled from records that contained ECGs as well as pulsatile signals that directly reflect cardiac activity, and other signals that may have few or no observable markers of heart beats. A separate hidden test data set (consisting of 152 478 beats) is permanently stored at PhysioNet, and a public framework has been developed to provide researchers with the ability to continue to automatically score and compare the performance of their algorithms. A scoring criteria based on the averaging of gross sensitivity, gross positive predictivity, average sensitivity, and average positive predictivity is proposed. The top three scores (as of March 2015) on the hidden test data set were 93.64%, 91.50%, and 90.70%.
Collapse
Affiliation(s)
- Ikaro Silva
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139, USA
| | | | | | | | | | | | | |
Collapse
|