1
|
Boccatonda A, Piscaglia F. New perspectives on the use of artificial intelligence in the ultrasound evaluation of lung diseases. J Ultrasound 2024; 27:429-431. [PMID: 38315408 PMCID: PMC11178746 DOI: 10.1007/s40477-023-00866-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2023] [Accepted: 12/20/2023] [Indexed: 02/07/2024] Open
Affiliation(s)
- Andrea Boccatonda
- Internal Medicine, Bentivoglio Hospital, AUSL Bologna, 40010, Bentivoglio, Italy.
| | - Fabio Piscaglia
- Division of Internal Medicine, Hepatobiliary and Immunoallergic Diseases, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Bologna, Italia
- Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy
| |
Collapse
|
2
|
Howell L, Ingram N, Lapham R, Morrell A, McLaughlan JR. Deep learning for real-time multi-class segmentation of artefacts in lung ultrasound. ULTRASONICS 2024; 140:107251. [PMID: 38520819 DOI: 10.1016/j.ultras.2024.107251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 12/20/2023] [Accepted: 01/17/2024] [Indexed: 03/25/2024]
Abstract
Lung ultrasound (LUS) has emerged as a safe and cost-effective modality for assessing lung health, particularly during the COVID-19 pandemic. However, interpreting LUS images remains challenging due to its reliance on artefacts, leading to operator variability and limiting its practical uptake. To address this, we propose a deep learning pipeline for multi-class segmentation of objects (ribs, pleural line) and artefacts (A-lines, B-lines, B-line confluence) in ultrasound images of a lung training phantom. Lightweight models achieved a mean Dice Similarity Coefficient (DSC) of 0.74, requiring fewer than 500 training images. Applying this method in real-time, at up to 33.4 frames per second in inference, allows enhanced visualisation of these features in LUS images. This could be useful in providing LUS training and helping to address the skill gap. Moreover, the segmentation masks obtained from this model enable the development of explainable measures of disease severity, which have the potential to assist in the triage and management of patients. We suggest one such semi-quantitative measure called the B-line Artefact Score, which is related to the percentage of an intercostal space occupied by B-lines and in turn may be associated with the severity of a number of lung conditions. Moreover, we show how transfer learning could be used to train models for small datasets of clinical LUS images, identifying pathologies such as simple pleural effusions and lung consolidation with DSC values of 0.48 and 0.32 respectively. Finally, we demonstrate how such DL models could be translated into clinical practice, implementing the phantom model alongside a portable point-of-care ultrasound system, facilitating bedside assessment and improving the accessibility of LUS.
Collapse
Affiliation(s)
- Lewis Howell
- School of Computing, University of Leeds, Leeds, LS2 9JT, UK; School of Electronic and Electrical Engineering, University of Leeds, Leeds, LS2 9JT, UK
| | - Nicola Ingram
- Leeds Institute of Medical Research, University of Leeds, St James' University Hospital, Leeds, LS9 7TF, UK
| | - Roger Lapham
- Radiology Department, Leeds Teaching Hospital Trust, Leeds General Infirmary, Leeds, LS1 3EX, UK
| | - Adam Morrell
- Radiology Department, Leeds Teaching Hospital Trust, Leeds General Infirmary, Leeds, LS1 3EX, UK
| | - James R McLaughlan
- School of Electronic and Electrical Engineering, University of Leeds, Leeds, LS2 9JT, UK; Leeds Institute of Medical Research, University of Leeds, St James' University Hospital, Leeds, LS9 7TF, UK.
| |
Collapse
|
3
|
Etter L, Betke M, Camelo IY, Gill CJ, Pieciak R, Thompson R, Demi L, Khan U, Wheelock A, Katanga J, Setty BN, Castro-Aragon I. Curated and Annotated Dataset of Lung US Images in Zambian Children with Clinical Pneumonia. Radiol Artif Intell 2024; 6:e230147. [PMID: 38381039 PMCID: PMC10982815 DOI: 10.1148/ryai.230147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 01/10/2024] [Accepted: 02/05/2024] [Indexed: 02/22/2024]
Abstract
See also the commentary by Sitek in this issue. Supplemental material is available for this article.
Collapse
Affiliation(s)
- Lauren Etter
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Margrit Betke
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Ingrid Y. Camelo
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Christopher J. Gill
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Rachel Pieciak
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Russell Thompson
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Libertario Demi
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Umair Khan
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Alyse Wheelock
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | - Janet Katanga
- From the Department of Global Health, School of Public Health, Boston
University Medical Campus, 801 Massachusetts Ave, Boston, MA 02118-2526 (L.E.,
C.J.G., R.P., A.W.); Department of Computer Science, College of Arts and
Sciences, Boston University, Boston, Mass (M.B.); Pediatric Infectious Diseases
Section, Augusta University, Medical College of Georgia, Augusta, Ga (I.Y.C.);
Department of Computer Science, Worcester Polytechnic Institute, Worcester, Mass
(R.T.); Ultrasound Laboratory Trento, University of Trento, Trento, Italy (L.D.,
U.K.); University Teaching Hospital, Lusaka, Zambia (J.K.); and Department of
Radiology, Boston Medical Center, Boston, Mass (B.N.S., I.C.A.)
| | | | | |
Collapse
|
4
|
Park HC, Joo Y, Lee OJ, Lee K, Song TK, Choi C, Choi MH, Yoon C. Automated classification of liver fibrosis stages using ultrasound imaging. BMC Med Imaging 2024; 24:36. [PMID: 38321373 PMCID: PMC10848434 DOI: 10.1186/s12880-024-01209-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 01/21/2024] [Indexed: 02/08/2024] Open
Abstract
BACKGROUND Ultrasound imaging is the most frequently performed for the patients with chronic hepatitis or liver cirrhosis. However, ultrasound imaging is highly operator dependent and interpretation of ultrasound images is subjective, thus well-trained radiologist is required for evaluation. Automated classification of liver fibrosis could alleviate the shortage of skilled radiologist especially in low-to-middle income countries. The purposed of this study is to evaluate deep convolutional neural networks (DCNNs) for classifying the degree of liver fibrosis according to the METAVIR score using US images. METHODS We used ultrasound (US) images from two tertiary university hospitals. A total of 7920 US images from 933 patients were used for training/validation of DCNNs. All patient were underwent liver biopsy or hepatectomy, and liver fibrosis was categorized based on pathology results using the METAVIR score. Five well-established DCNNs (VGGNet, ResNet, DenseNet, EfficientNet and ViT) was implemented to predict the METAVIR score. The performance of DCNNs for five-level (F0/F1/F2/F3/F4) classification was evaluated through area under the receiver operating characteristic curve (AUC) with 95% confidential interval, accuracy, sensitivity, specificity, positive and negative likelihood ratio. RESULTS Similar mean AUC values were achieved for five models; VGGNet (0.96), ResNet (0.96), DenseNet (0.95), EfficientNet (0.96), and ViT (0.95). The same mean accuracy (0.94) and specificity values (0.96) were yielded for all models. In terms of sensitivity, EffcientNet achieved highest mean value (0.85) while the other models produced slightly lower values range from 0.82 to 0.84. CONCLUSION In this study, we demonstrated that DCNNs can classify the staging of liver fibrosis according to METAVIR score with high performance using conventional B-mode images. Among them, EfficientNET that have fewer parameters and computation cost produced highest performance. From the results, we believe that DCNNs based classification of liver fibrosis may allow fast and accurate diagnosis of liver fibrosis without needs of additional equipment for add-on test and may be powerful tool for supporting radiologists in clinical practice.
Collapse
Grants
- NTIS Number: 9991007146 the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health & Welfare, the Ministry of Food and Drug Safety
- HI21C0940110021 the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- No. 2022-0-00101 the Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT)
- the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health & Welfare, the Ministry of Food and Drug Safety
- the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- the Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT)
Collapse
Affiliation(s)
- Hyun-Cheol Park
- Division of Industrial Mathematics, National Institute for Mathematical Sciences, 70, Yuseong-daero, Yuseong-gu, 34047, Daejeon, Republic of Korea
| | - YunSang Joo
- Department of Computer Engineering, Gachon University, 1342, Seongnam-daero, Sujeong-gu, 13120, Seongnam-si, Gyeonggi-do, Republic of Korea
| | - O-Joun Lee
- Department of Artificial Intelligence, The Catholic University of Korea, 43, Jibong-ro, 14662, Bucheon-si, Gyeonggi-do, Republic of Korea
| | - Kunkyu Lee
- Department of Electronic Engineering, Sogang University, 35 Baekbeom-ro, 04107, Seoul, Republic of Korea
| | - Tai-Kyong Song
- Department of Electronic Engineering, Sogang University, 35 Baekbeom-ro, 04107, Seoul, Republic of Korea
| | - Chang Choi
- Department of Computer Engineering, Gachon University, 1342, Seongnam-daero, Sujeong-gu, 13120, Seongnam-si, Gyeonggi-do, Republic of Korea
| | - Moon Hyung Choi
- Department of Radiology, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seoul, Republic of Korea.
| | - Changhan Yoon
- Department of Biomedical Engineering, Department of Nanoscience and Engineering, Inje University, Inje-ro 197, 50834, Gimhae, Gyeongnam, Republic of Korea.
| |
Collapse
|
5
|
Huang L, Lin Y, Cao P, Zou X, Qin Q, Lin Z, Liang F, Li Z. Automated detection and segmentation of pleural effusion on ultrasound images using an Attention U-net. J Appl Clin Med Phys 2024; 25:e14231. [PMID: 38088928 PMCID: PMC10795456 DOI: 10.1002/acm2.14231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 11/19/2023] [Accepted: 11/21/2023] [Indexed: 01/19/2024] Open
Abstract
BACKGROUND Ultrasonic for detecting and evaluating pleural effusion is an essential part of the Extended Focused Assessment with Sonography in Trauma (E-FAST) in emergencies. Our study aimed to develop an Artificial Intelligence (AI) diagnostic model that automatically identifies and segments pleural effusion areas on ultrasonography. METHODS An Attention U-net and a U-net model were used to detect and segment pleural effusion on ultrasound images of 848 subjects through fully supervised learning. Sensitivity, specificity, precision, accuracy, F1 score, the receiver operating characteristic (ROC) curve, and the area under the curve (AUC) were used to assess the model's effectiveness in classifying the data. The dice coefficient was used to evaluate the segmentation performance of the model. RESULTS In 10 random tests, the Attention U-net and U-net 's average sensitivity of 97% demonstrated that the pleural effusion was well detectable. The Attention U-net performed better at identifying negative images than the U-net, which had an average specificity of 91% compared to 86% for the U-net. Additionally, the Attention U-net was more accurate in predicting the pleural effusion region because its average dice coefficient was 0.86 as opposed to the U-net's average dice coefficient of 0.82. CONCLUSIONS The Attention U-net showed excellent performance in detecting and segmenting pleural effusion on ultrasonic images, which is expected to enhance the operation and application of E-FAST in clinical work.
Collapse
Affiliation(s)
- Libing Huang
- Department of UltrasoundShenzhen Second People's HospitalThe First Affiliated Hospital of Shenzhen UniversityShenzhenChina
- Shenzhen University School of MedicineShenzhenChina
| | - Yingying Lin
- Department of Diagnostic RadiologyThe University of Hong KongHong KongChina
| | - Peng Cao
- Department of Diagnostic RadiologyThe University of Hong KongHong KongChina
| | - Xia Zou
- Department of UltrasoundShenzhen Second People's HospitalThe First Affiliated Hospital of Shenzhen UniversityShenzhenChina
| | - Qian Qin
- Shenzhen University School of MedicineShenzhenChina
| | - Zhanye Lin
- Department of UltrasoundLonggang District People's Hospital of ShenzhenShenzhenChina
| | - Fengting Liang
- Department of UltrasoundShenzhen Second People's HospitalThe First Affiliated Hospital of Shenzhen UniversityShenzhenChina
| | - Zhengyi Li
- Department of UltrasoundShenzhen Second People's HospitalThe First Affiliated Hospital of Shenzhen UniversityShenzhenChina
- Shenzhen University School of MedicineShenzhenChina
| |
Collapse
|
6
|
Aujla S, Mohamed A, Tan R, Magtibay K, Tan R, Gao L, Khan N, Umapathy K. Classification of lung pathologies in neonates using dual-tree complex wavelet transform. Biomed Eng Online 2023; 22:115. [PMID: 38049880 PMCID: PMC10696711 DOI: 10.1186/s12938-023-01184-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 11/27/2023] [Indexed: 12/06/2023] Open
Abstract
INTRODUCTION Undiagnosed and untreated lung pathologies are among the leading causes of neonatal deaths in developing countries. Lung Ultrasound (LUS) has been widely accepted as a diagnostic tool for neonatal lung pathologies due to its affordability, portability, and safety. However, healthcare institutions in developing countries lack well-trained clinicians to interpret LUS images, which limits the use of LUS, especially in remote areas. An automated point-of-care tool that could screen and capture LUS morphologies associated with neonatal lung pathologies could aid in rapid and accurate diagnosis. METHODS We propose a framework for classifying the six most common neonatal lung pathologies using spatially localized line and texture patterns extracted via 2D dual-tree complex wavelet transform (DTCWT). We acquired 1550 LUS images from 42 neonates with varying numbers of lung pathologies. Furthermore, we balanced our data set to avoid bias towards a pathology class. RESULTS Using DTCWT and clinical features as inputs to a linear discriminant analysis (LDA), our approach achieved a per-image cross-validated classification accuracy of 74.39% for the imbalanced data set. Our classification accuracy improved to 92.78% after balancing our data set. Moreover, our proposed framework achieved a maximum per-subject cross-validated classification accuracy of 64.97% with an imbalanced data set while using a balanced data set improves its classification accuracy up to 81.53%. CONCLUSION Our work could aid in automating the diagnosis of lung pathologies among neonates using LUS. Rapid and accurate diagnosis of lung pathologies could help to decrease neonatal deaths in healthcare institutions that lack well-trained clinicians, especially in developing countries.
Collapse
Affiliation(s)
- Sagarjit Aujla
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada.
| | - Adel Mohamed
- Department of Pediatrics, Mount Sinai Hospital, 600 University Ave, Toronto, ON, M5G 1X5, Canada
| | - Ryan Tan
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada
| | - Karl Magtibay
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada
| | - Randy Tan
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada
| | - Lei Gao
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada
| | - Naimul Khan
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada
| | - Karthikeyan Umapathy
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada
| |
Collapse
|
7
|
Vukovic D, Wang A, Antico M, Steffens M, Ruvinov I, van Sloun RJ, Canty D, Royse A, Royse C, Haji K, Dowling J, Chetty G, Fontanarosa D. Automatic deep learning-based pleural effusion segmentation in lung ultrasound images. BMC Med Inform Decis Mak 2023; 23:274. [PMID: 38031040 PMCID: PMC10685575 DOI: 10.1186/s12911-023-02362-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 11/03/2023] [Indexed: 12/01/2023] Open
Abstract
BACKGROUND Point-of-care lung ultrasound (LUS) allows real-time patient scanning to help diagnose pleural effusion (PE) and plan further investigation and treatment. LUS typically requires training and experience from the clinician to accurately interpret the images. To address this limitation, we previously demonstrated a deep-learning model capable of detecting the presence of PE on LUS at an accuracy greater than 90%, when compared to an experienced LUS operator. METHODS This follow-up study aimed to develop a deep-learning model to provide segmentations for PE in LUS. Three thousand and forty-one LUS images from twenty-four patients diagnosed with PE were selected for this study. Two LUS experts provided the ground truth for training by reviewing and segmenting the images. The algorithm was then trained using ten-fold cross-validation. Once training was completed, the algorithm segmented a separate subset of patients. RESULTS Comparing the segmentations, we demonstrated an average Dice Similarity Coefficient (DSC) of 0.70 between the algorithm and experts. In contrast, an average DSC of 0.61 was observed between the experts. CONCLUSION In summary, we showed that the trained algorithm achieved a comparable average DSC at PE segmentation. This represents a promising step toward developing a computational tool for accurately augmenting PE diagnosis and treatment.
Collapse
Affiliation(s)
- Damjan Vukovic
- School of Clinical Sciences, Queensland University of Technology, Gardens Point Campus, 2 George St, Brisbane, QLD 4000, Australia.
- Centre for Biomedical Technologies (CBT), Queensland University of Technology, Brisbane, QLD 4000, Australia.
| | - Andrew Wang
- Department of Surgery (Royal Melbourne Hospital), University of Melbourne, Royal Parade, Parkville, VIC 3050, Australia
| | - Maria Antico
- School of Clinical Sciences, Queensland University of Technology, Gardens Point Campus, 2 George St, Brisbane, QLD 4000, Australia
- CSIRO Health and Biosecurity, The Australian eHealth Research Centre, Herston, QLD 4029, Australia
| | - Marian Steffens
- School of Clinical Sciences, Queensland University of Technology, Gardens Point Campus, 2 George St, Brisbane, QLD 4000, Australia
| | - Igor Ruvinov
- School of Clinical Sciences, Queensland University of Technology, Gardens Point Campus, 2 George St, Brisbane, QLD 4000, Australia
| | - Ruud Jg van Sloun
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB, Eindhoven, The Netherlands
| | - David Canty
- Department of Surgery (Royal Melbourne Hospital), University of Melbourne, Royal Parade, Parkville, VIC 3050, Australia
- Department of Medicine and Nursing, Monash University, Wellington Road, Clayton, 3800, Victoria, Australia
| | - Alistair Royse
- Department of Surgery (Royal Melbourne Hospital), University of Melbourne, Royal Parade, Parkville, VIC 3050, Australia
| | - Colin Royse
- Department of Surgery (Royal Melbourne Hospital), University of Melbourne, Royal Parade, Parkville, VIC 3050, Australia
- Outcomes Research Consortium, Cleveland Clinic, Cleveland, Ohio, USA
| | - Kavi Haji
- Department of Surgery (Royal Melbourne Hospital), University of Melbourne, Royal Parade, Parkville, VIC 3050, Australia
| | - Jason Dowling
- CSIRO Health and Biosecurity, The Australian eHealth Research Centre, Herston, QLD 4029, Australia
| | - Girija Chetty
- School of IT & Systems, Faculty of Science and Technology, University of Canberra, 11 Kirinari Street, Bruce, ACT 2617, Australia
| | - Davide Fontanarosa
- School of Clinical Sciences, Queensland University of Technology, Gardens Point Campus, 2 George St, Brisbane, QLD 4000, Australia.
- Centre for Biomedical Technologies (CBT), Queensland University of Technology, Brisbane, QLD 4000, Australia.
| |
Collapse
|
8
|
Ozcelik N, Ozcelik AE, Guner Zirih NM, Selimoglu I, Gumus A. Deep learning for diagnosis of malign pleural effusion on computed tomography images. Clinics (Sao Paulo) 2023; 78:100210. [PMID: 37149920 DOI: 10.1016/j.clinsp.2023.100210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Revised: 04/01/2023] [Accepted: 04/18/2023] [Indexed: 05/09/2023] Open
Abstract
BACKGROUND The pleura is a serous membrane that surrounds the lungs. The visceral surface secretes fluid into the serous cavity and the parietal surface ensures a regular absorption of this fluid. If this balance is disturbed, fluid accumulation occurs in the pleural space called "Pleural Effusion". Today, accurate diagnosis of pleural diseases is becoming more critical, as advances in treatment protocols have contributed positively to prognosis. Our aim is to perform computer-aided numerical analysis of Computed Tomography (CT) images from patients showing pleural effusion images on CT and to examine the prediction of malignant/benign distinction using deep learning by comparing with the cytology results. METHODS The authors classified 408 CT images from 64 patients whose etiology of pleural effusion was investigated using the deep learning method. 378 of the images were used for the training of the system; 15 malignant and 15 benign CT images, which were not included in the training group, were used as the test. RESULTS Among the 30 test images evaluated in the system; 14 of 15 malignant patients and 13 of 15 benign patients were estimated with correct diagnosis (PPD: 93.3%, NPD: 86.67%, Sensitivity: 87.5%, Specificity: 92.86%). CONCLUSION Advances in computer-aided diagnostic analysis of CT images and obtaining a pre-diagnosis of pleural fluid may reduce the need for interventional procedures by guiding physicians about which patients may have malignancies. Thus, it is cost and time-saving in patient management, allowing earlier diagnosis and treatment.
Collapse
Affiliation(s)
- Neslihan Ozcelik
- Recep Tayyip Erdogan University, Faculty of Medicine, Training and Research Hospital, Chest Disease, Rize, Turkey.
| | - Ali Erdem Ozcelik
- Recep Tayyip Erdogan University, Engineering and Architecture Faculty, Department of Landscape Architecture (Geomatics Engineer), Rize, Turkey
| | - Nese Merve Guner Zirih
- Recep Tayyip Erdogan University, Faculty of Medicine, Training and Research Hospital, Chest Disease, Rize, Turkey
| | - Inci Selimoglu
- Recep Tayyip Erdogan University, Faculty of Medicine, Training and Research Hospital, Chest Disease, Rize, Turkey
| | - Aziz Gumus
- Recep Tayyip Erdogan University, Faculty of Medicine, Training and Research Hospital, Chest Disease, Rize, Turkey
| |
Collapse
|
9
|
Demi L, Wolfram F, Klersy C, De Silvestri A, Ferretti VV, Muller M, Miller D, Feletti F, Wełnicki M, Buda N, Skoczylas A, Pomiecko A, Damjanovic D, Olszewski R, Kirkpatrick AW, Breitkreutz R, Mathis G, Soldati G, Smargiassi A, Inchingolo R, Perrone T. New International Guidelines and Consensus on the Use of Lung Ultrasound. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2023; 42:309-344. [PMID: 35993596 PMCID: PMC10086956 DOI: 10.1002/jum.16088] [Citation(s) in RCA: 66] [Impact Index Per Article: 66.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 06/28/2022] [Accepted: 07/31/2022] [Indexed: 05/02/2023]
Abstract
Following the innovations and new discoveries of the last 10 years in the field of lung ultrasound (LUS), a multidisciplinary panel of international LUS experts from six countries and from different fields (clinical and technical) reviewed and updated the original international consensus for point-of-care LUS, dated 2012. As a result, a total of 20 statements have been produced. Each statement is complemented by guidelines and future developments proposals. The statements are furthermore classified based on their nature as technical (5), clinical (11), educational (3), and safety (1) statements.
Collapse
Affiliation(s)
- Libertario Demi
- Department of Information Engineering and Computer ScienceUniversity of TrentoTrentoItaly
| | - Frank Wolfram
- Department of Thoracic and Vascular SurgerySRH Wald‐Klinikum GeraGeraGermany
| | - Catherine Klersy
- Unit of Clinical Epidemiology and BiostatisticsFondazione IRCCS Policlinico S. MatteoPaviaItaly
| | - Annalisa De Silvestri
- Unit of Clinical Epidemiology and BiostatisticsFondazione IRCCS Policlinico S. MatteoPaviaItaly
| | | | - Marie Muller
- Department of Mechanical and Aerospace EngineeringNorth Carolina State UniversityRaleighNorth CarolinaUSA
| | - Douglas Miller
- Department of RadiologyMichigan MedicineAnn ArborMichiganUSA
| | - Francesco Feletti
- Department of Diagnostic ImagingUnit of Radiology of the Hospital of Ravenna, Ausl RomagnaRavennaItaly
- Department of Translational Medicine and for RomagnaUniversità Degli Studi di FerraraFerraraItaly
| | - Marcin Wełnicki
- 3rd Department of Internal Medicine and CardiologyMedical University of WarsawWarsawPoland
| | - Natalia Buda
- Department of Internal Medicine, Connective Tissue Disease and GeriatricsMedical University of GdanskGdanskPoland
| | - Agnieszka Skoczylas
- Geriatrics DepartmentNational Institute of Geriatrics, Rheumatology and RehabilitationWarsawPoland
| | - Andrzej Pomiecko
- Clinic of Pediatrics, Hematology and OncologyUniversity Clinical CenterGdańskPoland
| | - Domagoj Damjanovic
- Heart Center Freiburg University, Department of Cardiovascular Surgery, Faculty of MedicineUniversity of FreiburgFreiburgGermany
| | - Robert Olszewski
- Department of Gerontology, Public Health and DidacticsNational Institute of Geriatrics, Rheumatology and RehabilitationWarsawPoland
| | - Andrew W. Kirkpatrick
- Departments of Critical Care Medicine and SurgeryUniversity of Calgary and the TeleMentored Ultrasound Supported Medical Interventions Research GroupCalgaryCanada
| | - Raoul Breitkreutz
- FOM Hochschule für Oekonomie & Management gGmbHDepartment of Health and SocialEssenGermany
| | - Gebhart Mathis
- Emergency UltrasoundAustrian Society for Ultrasound in Medicine and BiologyViennaAustria
| | - Gino Soldati
- Diagnostic and Interventional Ultrasound UnitValledel Serchio General HospitalLuccaItaly
| | - Andrea Smargiassi
- Pulmonary Medicine Unit, Department of Medical and Surgical SciencesFondazione Policlinico Universitario A. Gemelli IRCCSRomeItaly
- Department of Internal Medicine, IRCCS San Matteo Hospital FoundationUniversity of PaviaPaviaItaly
| | - Riccardo Inchingolo
- Pulmonary Medicine Unit, Department of Medical and Surgical SciencesFondazione Policlinico Universitario A. Gemelli IRCCSRomeItaly
- Department of Internal Medicine, IRCCS San Matteo Hospital FoundationUniversity of PaviaPaviaItaly
| | | |
Collapse
|
10
|
Yang T, Karakus O, Anantrasirichai N, Achim A. Current Advances in Computational Lung Ultrasound Imaging: A Review. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2023; 70:2-15. [PMID: 36355735 DOI: 10.1109/tuffc.2022.3221682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
In the field of biomedical imaging, ultrasonography has become common practice, and used as an important auxiliary diagnostic tool with unique advantages, such as being non-ionizing and often portable. This article reviews the state-of-the-art in medical ultrasound (US) image processing and in particular its applications in the examination of the lungs. First, we briefly introduce the basis of lung US (LUS) examination. We focus on (i) the characteristics of lung ultrasonography and (ii) its ability to detect a variety of diseases through the identification of various artifacts exhibiting on LUS images. We group medical US image computing methods into two categories: 1) model-based methods and 2) data-driven methods. We particularly discuss inverse problem-based methods exploited in US image despeckling, deconvolution, and line artifacts detection for the former, while we exemplify various works based on deep/machine learning (ML), which exploit various network architectures through supervised, weakly supervised, and unsupervised learning for the data-driven approaches.
Collapse
|
11
|
Mento F, Khan U, Faita F, Smargiassi A, Inchingolo R, Perrone T, Demi L. State of the Art in Lung Ultrasound, Shifting from Qualitative to Quantitative Analyses. ULTRASOUND IN MEDICINE & BIOLOGY 2022; 48:2398-2416. [PMID: 36155147 PMCID: PMC9499741 DOI: 10.1016/j.ultrasmedbio.2022.07.007] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 07/12/2022] [Accepted: 07/15/2022] [Indexed: 05/27/2023]
Abstract
Lung ultrasound (LUS) has been increasingly expanding since the 1990s, when the clinical relevance of vertical artifacts was first reported. However, the massive spread of LUS is only recent and is associated with the coronavirus disease 2019 (COVID-19) pandemic, during which semi-quantitative computer-aided techniques were proposed to automatically classify LUS data. In this review, we discuss the state of the art in LUS, from semi-quantitative image analysis approaches to quantitative techniques involving the analysis of radiofrequency data. We also discuss recent in vitro and in silico studies, as well as research on LUS safety. Finally, conclusions are drawn highlighting the potential future of LUS.
Collapse
Affiliation(s)
- Federico Mento
- Department of Information Engineering and Computer Science, University of Trento, Trento, Italy
| | - Umair Khan
- Department of Information Engineering and Computer Science, University of Trento, Trento, Italy
| | - Francesco Faita
- Institute of Clinical Physiology, National Research Council, Pisa, Italy
| | - Andrea Smargiassi
- Department of Cardiovascular and Thoracic Sciences, Pulmonary Medicine Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Riccardo Inchingolo
- Department of Cardiovascular and Thoracic Sciences, Pulmonary Medicine Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | | | - Libertario Demi
- Department of Information Engineering and Computer Science, University of Trento, Trento, Italy.
| |
Collapse
|
12
|
Automatic deep learning-based consolidation/collapse classification in lung ultrasound images for COVID-19 induced pneumonia. Sci Rep 2022; 12:17581. [PMID: 36266463 PMCID: PMC9584232 DOI: 10.1038/s41598-022-22196-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 10/11/2022] [Indexed: 01/13/2023] Open
Abstract
Our automated deep learning-based approach identifies consolidation/collapse in LUS images to aid in the identification of late stages of COVID-19 induced pneumonia, where consolidation/collapse is one of the possible associated pathologies. A common challenge in training such models is that annotating each frame of an ultrasound video requires high labelling effort. This effort in practice becomes prohibitive for large ultrasound datasets. To understand the impact of various degrees of labelling precision, we compare labelling strategies to train fully supervised models (frame-based method, higher labelling effort) and inaccurately supervised models (video-based methods, lower labelling effort), both of which yield binary predictions for LUS videos on a frame-by-frame level. We moreover introduce a novel sampled quaternary method which randomly samples only 10% of the LUS video frames and subsequently assigns (ordinal) categorical labels to all frames in the video based on the fraction of positively annotated samples. This method outperformed the inaccurately supervised video-based method and more surprisingly, the supervised frame-based approach with respect to metrics such as precision-recall area under curve (PR-AUC) and F1 score, despite being a form of inaccurate learning. We argue that our video-based method is more robust with respect to label noise and mitigates overfitting in a manner similar to label smoothing. The algorithm was trained using a ten-fold cross validation, which resulted in a PR-AUC score of 73% and an accuracy of 89%. While the efficacy of our classifier using the sampled quaternary method significantly lowers the labelling effort, it must be verified on a larger consolidation/collapse dataset, our proposed classifier using the sampled quaternary video-based method is clinically comparable with trained experts' performance.
Collapse
|
13
|
Aujla S, Mohammed A, Khan N, Umapathy K. Multi-Level Classification of Lung Pathologies in Neonates using Recurrence Features. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:1531-1535. [PMID: 36085782 DOI: 10.1109/embc48229.2022.9871011] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The use of Lung Ultrasound (LUS) as a tool to diagnose and monitor lung diseases in neonates has increased in urban hospitals. LUS's main advantages compared to chest CT or X-rays is that it is less expensive, more accessible, and does not expose the patient to radiation. Performing LUS on neonates and diagnosing the LUS images require highly trained medical professional and clinicians. While availability of such specialists in general is not an issue in urban areas, there is lack of such personnel in rural and remote communities. Hence, an automated computer-aided screening approach as a first level diagnosis assistance in such scenarios might be of significant value. Many of the image morphologies used by clinicians in diagnosing the LUS have strong recurrence characteristics. Building upon this knowledge, in this paper, we propose a feature extraction method designed to quantify such recurrent features for classification of LUS images into 6 common neonatal lung conditions. These conditions were normal lung, chronic lung disease (CLD), transient tachypnea of the newborn (TTN), pneumothorax (PTX), respiratory distress syndrome (RDS), and consolidation (CON) that could be pneumonia or atelectasis. The proposed method extracts virtual scanlines from the LUS images and converts them into signals. Then using recurrence quantification analysis (RQA), features were extracted and fed to pattern classifiers. Using a simple linear classifier the proposed features can achieve a classification accuracy of 69.3% without clinical features and 77.6% with clinical features. Clinical Relevance- Development of an automated computer-aided screening tool for first level diagnosis assistance in neonatal LUS pathologies. Such a tool will be of significant value in rural and remote medical communities.
Collapse
|
14
|
Abstract
Machine learning (ML) methods are pervading an increasing number of fields of application because of their capacity to effectively solve a wide variety of challenging problems. The employment of ML techniques in ultrasound imaging applications started several years ago but the scientific interest in this issue has increased exponentially in the last few years. The present work reviews the most recent (2019 onwards) implementations of machine learning techniques for two of the most popular ultrasound imaging fields, medical diagnostics and non-destructive evaluation. The former, which covers the major part of the review, was analyzed by classifying studies according to the human organ investigated and the methodology (e.g., detection, segmentation, and/or classification) adopted, while for the latter, some solutions to the detection/classification of material defects or particular patterns are reported. Finally, the main merits of machine learning that emerged from the study analysis are summarized and discussed.
Collapse
|
15
|
De Rosa L, L'Abbate S, Kusmic C, Faita F. Applications of artificial intelligence in lung ultrasound: Review of deep learning methods for COVID-19 fighting. Artif Intell Med Imaging 2022; 3:42-54. [DOI: 10.35711/aimi.v3.i2.42] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Revised: 02/22/2022] [Accepted: 04/26/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND The pandemic outbreak of the novel coronavirus disease (COVID-19) has highlighted the need to combine rapid, non-invasive and widely accessible techniques with the least risk of patient’s cross-infection to achieve a successful early detection and surveillance of the disease. In this regard, the lung ultrasound (LUS) technique has been proved invaluable in both the differential diagnosis and the follow-up of COVID-19 patients, and its potential may be destined to evolve. Recently, indeed, LUS has been empowered through the development of automated image processing techniques.
AIM To provide a systematic review of the application of artificial intelligence (AI) technology in medical LUS analysis of COVID-19 patients using the preferred reporting items of systematic reviews and meta-analysis (PRISMA) guidelines.
METHODS A literature search was performed for relevant studies published from March 2020 - outbreak of the pandemic - to 30 September 2021. Seventeen articles were included in the result synthesis of this paper.
RESULTS As part of the review, we presented the main characteristics related to AI techniques, in particular deep learning (DL), adopted in the selected articles. A survey was carried out on the type of architectures used, availability of the source code, network weights and open access datasets, use of data augmentation, use of the transfer learning strategy, type of input data and training/test datasets, and explainability.
CONCLUSION Finally, this review highlighted the existing challenges, including the lack of large datasets of reliable COVID-19-based LUS images to test the effectiveness of DL methods and the ethical/regulatory issues associated with the adoption of automated systems in real clinical scenarios.
Collapse
Affiliation(s)
- Laura De Rosa
- Institute of Clinical Physiology, Consiglio Nazionale delle Ricerche, Pisa 56124, Italy
| | - Serena L'Abbate
- Institute of Clinical Physiology, Consiglio Nazionale delle Ricerche, Pisa 56124, Italy
- Institute of Life Sciences, Scuola Superiore Sant’Anna, Pisa 56124, Italy
| | - Claudia Kusmic
- Institute of Clinical Physiology, Consiglio Nazionale delle Ricerche, Pisa 56124, Italy
| | - Francesco Faita
- Institute of Clinical Physiology, Consiglio Nazionale delle Ricerche, Pisa 56124, Italy
| |
Collapse
|
16
|
Wang J, Yang X, Zhou B, Sohn JJ, Zhou J, Jacob JT, Higgins KA, Bradley JD, Liu T. Review of Machine Learning in Lung Ultrasound in COVID-19 Pandemic. J Imaging 2022; 8:65. [PMID: 35324620 PMCID: PMC8952297 DOI: 10.3390/jimaging8030065] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2022] [Revised: 03/01/2022] [Accepted: 03/02/2022] [Indexed: 12/25/2022] Open
Abstract
Ultrasound imaging of the lung has played an important role in managing patients with COVID-19-associated pneumonia and acute respiratory distress syndrome (ARDS). During the COVID-19 pandemic, lung ultrasound (LUS) or point-of-care ultrasound (POCUS) has been a popular diagnostic tool due to its unique imaging capability and logistical advantages over chest X-ray and CT. Pneumonia/ARDS is associated with the sonographic appearances of pleural line irregularities and B-line artefacts, which are caused by interstitial thickening and inflammation, and increase in number with severity. Artificial intelligence (AI), particularly machine learning, is increasingly used as a critical tool that assists clinicians in LUS image reading and COVID-19 decision making. We conducted a systematic review from academic databases (PubMed and Google Scholar) and preprints on arXiv or TechRxiv of the state-of-the-art machine learning technologies for LUS images in COVID-19 diagnosis. Openly accessible LUS datasets are listed. Various machine learning architectures have been employed to evaluate LUS and showed high performance. This paper will summarize the current development of AI for COVID-19 management and the outlook for emerging trends of combining AI-based LUS with robotics, telehealth, and other techniques.
Collapse
Affiliation(s)
- Jing Wang
- Department of Radiation Oncology, Emory University, Atlanta, GA 30322, USA; (J.W.); (X.Y.); (B.Z.); (J.Z.); (K.A.H.); (J.D.B.)
| | - Xiaofeng Yang
- Department of Radiation Oncology, Emory University, Atlanta, GA 30322, USA; (J.W.); (X.Y.); (B.Z.); (J.Z.); (K.A.H.); (J.D.B.)
| | - Boran Zhou
- Department of Radiation Oncology, Emory University, Atlanta, GA 30322, USA; (J.W.); (X.Y.); (B.Z.); (J.Z.); (K.A.H.); (J.D.B.)
| | - James J. Sohn
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, VA 23219, USA;
| | - Jun Zhou
- Department of Radiation Oncology, Emory University, Atlanta, GA 30322, USA; (J.W.); (X.Y.); (B.Z.); (J.Z.); (K.A.H.); (J.D.B.)
| | - Jesse T. Jacob
- Division of Infectious Diseases, Department of Medicine, Emory University, Atlanta, GA 30322, USA;
| | - Kristin A. Higgins
- Department of Radiation Oncology, Emory University, Atlanta, GA 30322, USA; (J.W.); (X.Y.); (B.Z.); (J.Z.); (K.A.H.); (J.D.B.)
| | - Jeffrey D. Bradley
- Department of Radiation Oncology, Emory University, Atlanta, GA 30322, USA; (J.W.); (X.Y.); (B.Z.); (J.Z.); (K.A.H.); (J.D.B.)
| | - Tian Liu
- Department of Radiation Oncology, Emory University, Atlanta, GA 30322, USA; (J.W.); (X.Y.); (B.Z.); (J.Z.); (K.A.H.); (J.D.B.)
| |
Collapse
|
17
|
Saeed U, Shah SY, Ahmad J, Imran MA, Abbasi QH, Shah SA. Machine learning empowered COVID-19 patient monitoring using non-contact sensing: An extensive review. J Pharm Anal 2022; 12:193-204. [PMID: 35003825 PMCID: PMC8724017 DOI: 10.1016/j.jpha.2021.12.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Revised: 12/29/2021] [Accepted: 12/30/2021] [Indexed: 12/20/2022] Open
Abstract
The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which caused the coronavirus disease 2019 (COVID-19) pandemic, has affected more than 400 million people worldwide. With the recent rise of new Delta and Omicron variants, the efficacy of the vaccines has become an important question. The goal of various studies has been to limit the spread of the virus by utilizing wireless sensing technologies to prevent human-to-human interactions, particularly for healthcare workers. In this paper, we discuss the current literature on invasive/contact and non-invasive/non-contact technologies (including Wi-Fi, radar, and software-defined radio) that have been effectively used to detect, diagnose, and monitor human activities and COVID-19 related symptoms, such as irregular respiration. In addition, we focused on cutting-edge machine learning algorithms (such as generative adversarial networks, random forest, multilayer perceptron, support vector machine, extremely randomized trees, and k-nearest neighbors) and their essential role in intelligent healthcare systems. Furthermore, this study highlights the limitations related to non-invasive techniques and prospective research directions. This article describes cutting-edge technology (invasive/non-invasive) and its role in the recognition of COVID-19 symptoms. This article summarizes state-of-art machine-learning algorithms and their roles in modern healthcare systems. This article presents the challenges associated with wireless sensing techniques and potential future research directions.
Collapse
Affiliation(s)
- Umer Saeed
- Research Centre for Intelligent Healthcare, Coventry University, Coventry, CV1 5FB, UK
| | - Syed Yaseen Shah
- School of Computing, Engineering and Built Environment, Glasgow Caledonian University, Glasgow, G4 0BA, UK
| | - Jawad Ahmad
- School of Computing, Edinburgh Napier University, Edinburgh, EH11 4BN, UK
| | - Muhammad Ali Imran
- James Watt School of Engineering, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Qammer H Abbasi
- James Watt School of Engineering, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Syed Aziz Shah
- Research Centre for Intelligent Healthcare, Coventry University, Coventry, CV1 5FB, UK
| |
Collapse
|
18
|
Wang Y, Zhang Y, He Q, Liao H, Luo J. Quantitative Analysis of Pleural Line and B-Lines in Lung Ultrasound Images for Severity Assessment of COVID-19 Pneumonia. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:73-83. [PMID: 34428140 PMCID: PMC8905613 DOI: 10.1109/tuffc.2021.3107598] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 08/21/2021] [Indexed: 06/12/2023]
Abstract
Specific patterns of lung ultrasound (LUS) images are used to assess the severity of coronavirus disease 2019 (COVID-19) pneumonia, while such assessment is mainly based on clinicians' qualitative and subjective observations. In this study, we quantitatively analyze the LUS images to assess the severity of COVID-19 pneumonia by characterizing the patterns related to the pleural line (PL) and B-lines (BLs). Twenty-seven patients with COVID-19 pneumonia, including 13 moderate cases, seven severe cases, and seven critical cases, are enrolled. Features related to the PL, including the thickness (TPL) and roughness of the PL (RPL), and the mean (MPLI) and standard deviation (SDPLI) of the PL intensities are extracted from the LUS images. Features related to the BLs, including the number (NBL), accumulated width (AWBL), attenuation coefficient (ACBL), and accumulated intensity (AIBL) of BLs, are also extracted. The correlations of these features with the disease severity are evaluated. The performances of the binary severe/non-severe classification are assessed for each feature and support vector machine (SVM) classifiers with various combinations of features as input. Several features, including the RPL, NBL, AWBL, and AIBL, show significant correlations with disease severity (all ). The classification performance is optimal using the SVM classifier using all the features as input (area under the receiver operating characteristic (ROC) curve = 0.96, sensitivity = 0.93, and specificity = 1). These findings demonstrate that the proposed method may be a promising tool for automatic grading diagnosis and follow-up of patients with COVID-19 pneumonia.
Collapse
Affiliation(s)
- Yuanyuan Wang
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| | - Yao Zhang
- Department of UltrasoundBeijing Ditan HospitalCapital Medical UniversityBeijing100015China
| | - Qiong He
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| | - Hongen Liao
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| | - Jianwen Luo
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| |
Collapse
|
19
|
Barros B, Lacerda P, Albuquerque C, Conci A. Pulmonary COVID-19: Learning Spatiotemporal Features Combining CNN and LSTM Networks for Lung Ultrasound Video Classification. SENSORS (BASEL, SWITZERLAND) 2021; 21:5486. [PMID: 34450928 PMCID: PMC8401701 DOI: 10.3390/s21165486] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Revised: 08/04/2021] [Accepted: 08/05/2021] [Indexed: 12/18/2022]
Abstract
Deep Learning is a very active and important area for building Computer-Aided Diagnosis (CAD) applications. This work aims to present a hybrid model to classify lung ultrasound (LUS) videos captured by convex transducers to diagnose COVID-19. A Convolutional Neural Network (CNN) performed the extraction of spatial features, and the temporal dependence was learned using a Long Short-Term Memory (LSTM). Different types of convolutional architectures were used for feature extraction. The hybrid model (CNN-LSTM) hyperparameters were optimized using the Optuna framework. The best hybrid model was composed of an Xception pre-trained on ImageNet and an LSTM containing 512 units, configured with a dropout rate of 0.4, two fully connected layers containing 1024 neurons each, and a sequence of 20 frames in the input layer (20×2018). The model presented an average accuracy of 93% and sensitivity of 97% for COVID-19, outperforming models based purely on spatial approaches. Furthermore, feature extraction using transfer learning with models pre-trained on ImageNet provided comparable results to models pre-trained on LUS images. The results corroborate with other studies showing that this model for LUS classification can be an important tool in the fight against COVID-19 and other lung diseases.
Collapse
Affiliation(s)
- Bruno Barros
- Institute of Computing, Campus Praia Vermelha, Fluminense Federal University, Niterói 24.210-346, Brazil; (P.L.); (C.A.); (A.C.)
| | | | | | | |
Collapse
|
20
|
Zanca F, Avanzo M, Colgan N, Crijns W, Guidi G, Hernandez-Giron I, Kagadis GC, Diaz O, Zaidi H, Russo P, Toma-Dasu I, Kortesniemi M. Focus issue: Artificial intelligence in medical physics. Phys Med 2021; 83:287-291. [PMID: 34004585 DOI: 10.1016/j.ejmp.2021.05.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Affiliation(s)
- F Zanca
- Palindromo Consulting, Leuven, Belgium
| | - M Avanzo
- Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, Department of Medical Physics, 33081 Aviano, PN, Italy
| | - N Colgan
- School of Physics, National University of Ireland Galway, Galway, Ireland
| | - W Crijns
- Department Oncology, Laboratory of Experimental Radiotherapy, KU Leuven and Department of Radiation Oncology, UZ Leuven, Belgium
| | - G Guidi
- Medical Physics, Az. Ospedaliero-Universitaria di Modena, Modena, Italy
| | - I Hernandez-Giron
- Leiden University Medical Center (LUMC), Radiology Department, Division of Image Processing, Albinusdreef 2, 2333ZA Leiden, The Netherlands
| | - G C Kagadis
- 3DMI Research Group, Department of Medical Physics, School of Medicine, University of Patras, GR 265 04, Greece
| | - O Diaz
- Faculty of Mathematics and Computer Science, University of Barcelona, Barcelona, Spain
| | - H Zaidi
- Geneva University Hospital, Division of Nuclear Medicine and Molecular Imaging, CH-1211 Geneva, Switzerland
| | - P Russo
- Università di Napoli Federico II, Dipartimento di Fisica "Ettore Pancini", I-80126 Naples, Italy
| | - I Toma-Dasu
- Department of Physics, Medical Radiation Physics, Stockholm University, Stockholm, Sweden; Department of Oncology and Pathology, Medical Radiation Physics, Karolinska Institutet, Stockholm, Sweden
| | - M Kortesniemi
- HUS Medical Imaging Center, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| |
Collapse
|