1
|
Daudé P, Ramasawmy R, Javed A, Lederman RJ, Chow K, Campbell-Washburn AE. Inline automatic quality control of 2D phase-contrast flow MRI for subject-specific scan time adaptation. Magn Reson Med 2024; 92:751-760. [PMID: 38469944 PMCID: PMC11142871 DOI: 10.1002/mrm.30083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 02/01/2024] [Accepted: 02/24/2024] [Indexed: 03/13/2024]
Abstract
PURPOSE To develop an inline automatic quality control to achieve consistent diagnostic image quality with subject-specific scan time, and to demonstrate this method for 2D phase-contrast flow MRI to reach a predetermined SNR. METHODS We designed a closed-loop feedback framework between image reconstruction and data acquisition to intermittently check SNR (every 20 s) and automatically stop the acquisition when a target SNR is achieved. A free-breathing 2D pseudo-golden-angle spiral phase-contrast sequence was modified to listen for image-quality messages from the reconstructions. Ten healthy volunteers and 1 patient were imaged at 0.55 T. Target SNR was selected based on retrospective analysis of cardiac output error, and performance of the automatic SNR-driven "stop" was assessed inline. RESULTS SNR calculation and automated segmentation was feasible within 20 s with inline deployment. The SNR-driven acquisition time was 2 min 39 s ± 67 s (aorta) and 3 min ± 80 s (main pulmonary artery) with a min/max acquisition time of 1 min 43 s/4 min 52 s (aorta) and 1 min 43 s/5 min 50 s (main pulmonary artery) across 6 healthy volunteers, while ensuring a diagnostic measurement with relative absolute error in quantitative flow measurement lower than 2.1% (aorta) and 6.3% (main pulmonary artery). CONCLUSION The inline quality control enables subject-specific optimized scan times while ensuring consistent diagnostic image quality. The distribution of automated stopping times across the population revealed the value of a subject-specific scan time.
Collapse
Affiliation(s)
- Pierre Daudé
- Laboratory of Imaging Technology, Cardiovascular Branch, Division of Intramural Research, National Heart, Lung & Blood Institute, NIH, USA
| | - Rajiv Ramasawmy
- Laboratory of Imaging Technology, Cardiovascular Branch, Division of Intramural Research, National Heart, Lung & Blood Institute, NIH, USA
| | - Ahsan Javed
- Laboratory of Imaging Technology, Cardiovascular Branch, Division of Intramural Research, National Heart, Lung & Blood Institute, NIH, USA
| | - Robert J Lederman
- Cardiovascular Branch, Division of Intramural Research, National Heart, Lung & Blood Institute, NIH, USA
| | - Kelvin Chow
- Siemens Healthcare Ltd., Calgary, AB, Canada
| | - Adrienne E. Campbell-Washburn
- Laboratory of Imaging Technology, Cardiovascular Branch, Division of Intramural Research, National Heart, Lung & Blood Institute, NIH, USA
| |
Collapse
|
2
|
Li Q, Zhang X, Zhang J, Huang H, Li L, Guo C, Li W, Guo Y. Deep learning-based hyperspectral technique identifies metastatic lymph nodes in oral squamous cell carcinoma-A pilot study. Oral Dis 2024. [PMID: 39005220 DOI: 10.1111/odi.15067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 05/31/2024] [Accepted: 07/02/2024] [Indexed: 07/16/2024]
Abstract
AIMS To establish a system based on hyperspectral imaging and deep learning for the detection of cancer cells in metastatic lymph nodes. MAIN METHODS The continuous sections of metastatic lymph nodes from 45 oral squamous cell carcinoma (OSCC) patients were collected. An improved ResUNet algorithm was established for deep learning to analyze the spectral curve differences between cancer cells and lymphocytes, and that between tumor tissue and normal tissue. KEY FINDINGS It was found that cancer cells, lymphocytes, and erythrocytes in the metastatic lymph nodes could be distinguished basing hyperspectral image, with overall accuracy (OA) as 87.30% and average accuracy (AA) as 85.46%. Cancerous area could be recognized by hyperspectral image and deep learning, and the average intersection over union (IOU) and accuracy were 0.6253 and 0.7692, respectively. SIGNIFICANCE This study indicated that deep learning-based hyperspectral techniques can identify tumor tissue in OSCC metastatic lymph nodes, achieving high accuracy of pathological diagnosis, high work efficiency, and reducing work burden. But these are preliminary results limited to a small sample.
Collapse
Affiliation(s)
- Qingxiang Li
- Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology, Beijing, China
- National Center for Stomatology, Beijing, China
- National Clinical Research Center for Oral Diseases, Beijing, China
- National Engineering Research Center of Oral Biomaterials and Digital Medical Devices, Beijing, China
| | - Xueyu Zhang
- School of Information and Electronics, Beijing Institute of Technology, Beijing, China
- Beijing Key Laboratory of Fractional Signals and Systems, Beijing, China
| | - Jianyun Zhang
- National Center for Stomatology, Beijing, China
- National Clinical Research Center for Oral Diseases, Beijing, China
- National Engineering Research Center of Oral Biomaterials and Digital Medical Devices, Beijing, China
- Department of Oral Pathology, Peking University School and Hospital of Stomatology, Beijing, China
| | - Hongyuan Huang
- Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology, Beijing, China
- National Center for Stomatology, Beijing, China
- National Clinical Research Center for Oral Diseases, Beijing, China
- National Engineering Research Center of Oral Biomaterials and Digital Medical Devices, Beijing, China
| | - Liangliang Li
- School of Information and Electronics, Beijing Institute of Technology, Beijing, China
- Beijing Key Laboratory of Fractional Signals and Systems, Beijing, China
| | - Chuanbin Guo
- Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology, Beijing, China
- National Center for Stomatology, Beijing, China
- National Clinical Research Center for Oral Diseases, Beijing, China
- National Engineering Research Center of Oral Biomaterials and Digital Medical Devices, Beijing, China
| | - Wei Li
- School of Information and Electronics, Beijing Institute of Technology, Beijing, China
- Beijing Key Laboratory of Fractional Signals and Systems, Beijing, China
| | - Yuxing Guo
- Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology, Beijing, China
- National Center for Stomatology, Beijing, China
- National Clinical Research Center for Oral Diseases, Beijing, China
- National Engineering Research Center of Oral Biomaterials and Digital Medical Devices, Beijing, China
| |
Collapse
|
3
|
Zhang Q, Fotaki A, Ghadimi S, Wang Y, Doneva M, Wetzl J, Delfino JG, O'Regan DP, Prieto C, Epstein FH. Improving the efficiency and accuracy of cardiovascular magnetic resonance with artificial intelligence-review of evidence and proposition of a roadmap to clinical translation. J Cardiovasc Magn Reson 2024; 26:101051. [PMID: 38909656 PMCID: PMC11331970 DOI: 10.1016/j.jocmr.2024.101051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 06/09/2024] [Accepted: 06/18/2024] [Indexed: 06/25/2024] Open
Abstract
BACKGROUND Cardiovascular magnetic resonance (CMR) is an important imaging modality for the assessment of heart disease; however, limitations of CMR include long exam times and high complexity compared to other cardiac imaging modalities. Recently advancements in artificial intelligence (AI) technology have shown great potential to address many CMR limitations. While the developments are remarkable, translation of AI-based methods into real-world CMR clinical practice remains at a nascent stage and much work lies ahead to realize the full potential of AI for CMR. METHODS Herein we review recent cutting-edge and representative examples demonstrating how AI can advance CMR in areas such as exam planning, accelerated image reconstruction, post-processing, quality control, classification and diagnosis. RESULTS These advances can be applied to speed up and simplify essentially every application including cine, strain, late gadolinium enhancement, parametric mapping, 3D whole heart, flow, perfusion and others. AI is a unique technology based on training models using data. Beyond reviewing the literature, this paper discusses important AI-specific issues in the context of CMR, including (1) properties and characteristics of datasets for training and validation, (2) previously published guidelines for reporting CMR AI research, (3) considerations around clinical deployment, (4) responsibilities of clinicians and the need for multi-disciplinary teams in the development and deployment of AI in CMR, (5) industry considerations, and (6) regulatory perspectives. CONCLUSIONS Understanding and consideration of all these factors will contribute to the effective and ethical deployment of AI to improve clinical CMR.
Collapse
Affiliation(s)
- Qiang Zhang
- Oxford Centre for Clinical Magnetic Resonance Research, Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, Oxford, UK; Big Data Institute, University of Oxford, Oxford, UK.
| | - Anastasia Fotaki
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; Royal Brompton Hospital, Guy's and St Thomas' NHS Foundation Trust, London, UK.
| | - Sona Ghadimi
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA.
| | - Yu Wang
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA.
| | | | - Jens Wetzl
- Siemens Healthineers AG, Erlangen, Germany.
| | - Jana G Delfino
- US Food and Drug Administration, Center for Devices and Radiological Health (CDRH), Office of Science and Engineering Laboratories (OSEL), Silver Spring, MD, USA.
| | - Declan P O'Regan
- MRC Laboratory of Medical Sciences, Imperial College London, London, UK.
| | - Claudia Prieto
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile.
| | - Frederick H Epstein
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA.
| |
Collapse
|
4
|
Aung N, Bartoli A, Rauseo E, Cortaredona S, Sanghvi MM, Fournel J, Ghattas B, Khanji MY, Petersen SE, Jacquier A. Left Ventricular Trabeculations at Cardiac MRI: Reference Ranges and Association with Cardiovascular Risk Factors in UK Biobank. Radiology 2024; 311:e232455. [PMID: 38563665 DOI: 10.1148/radiol.232455] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Background The extent of left ventricular (LV) trabeculation and its relationship with cardiovascular (CV) risk factors is unclear. Purpose To apply automated segmentation to UK Biobank cardiac MRI scans to (a) assess the association between individual characteristics and CV risk factors and trabeculated LV mass (LVM) and (b) establish normal reference ranges in a selected group of healthy UK Biobank participants. Materials and Methods In this cross-sectional secondary analysis, prospectively collected data from the UK Biobank (2006 to 2010) were retrospectively analyzed. Automated segmentation of trabeculations was performed using a deep learning algorithm. After excluding individuals with known CV diseases, White adults without CV risk factors (reference group) and those with preexisting CV risk factors (hypertension, hyperlipidemia, diabetes mellitus, or smoking) (exposed group) were compared. Multivariable regression models, adjusted for potential confounders (age, sex, and height), were fitted to evaluate the associations between individual characteristics and CV risk factors and trabeculated LVM. Results Of 43 038 participants (mean age, 64 years ± 8 [SD]; 22 360 women), 28 672 individuals (mean age, 66 years ± 7; 14 918 men) were included in the exposed group, and 7384 individuals (mean age, 60 years ± 7; 4729 women) were included in the reference group. Higher body mass index (BMI) (β = 0.66 [95% CI: 0.63, 0.68]; P < .001), hypertension (β = 0.42 [95% CI: 0.36, 0.48]; P < .001), and higher physical activity level (β = 0.15 [95% CI: 0.12, 0.17]; P < .001) were associated with higher trabeculated LVM. In the reference group, the median trabeculated LVM was 6.3 g (IQR, 4.7-8.5 g) for men and 4.6 g (IQR, 3.4-6.0 g) for women. Median trabeculated LVM decreased with age for men from 6.5 g (IQR, 4.8-8.7 g) at age 45-50 years to 5.9 g (IQR, 4.3-7.8 g) at age 71-80 years (P = .03). Conclusion Higher trabeculated LVM was observed with hypertension, higher BMI, and higher physical activity level. Age- and sex-specific reference ranges of trabeculated LVM in a healthy middle-aged White population were established. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Kawel-Boehm in this issue.
Collapse
Affiliation(s)
- Nay Aung
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Axel Bartoli
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Elisa Rauseo
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Sebastien Cortaredona
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Mihir M Sanghvi
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Joris Fournel
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Badih Ghattas
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Mohammed Y Khanji
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Steffen E Petersen
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| | - Alexis Jacquier
- From the Centre for Advanced Cardiovascular Imaging, William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, England (N.A., E.R., M.M.S., M.Y.K., S.E.P.); Department of Radiology, Hôpital de la Timone, AP-HM, 264 rue Saint-Pierre, 13385 Marseille CEDEX 05, France (A.B., A.J.); Center for Magnetic Resonance in Biology and Medicine, UMR CNRS 7339, Aix-Marseille University, Marseille, France (A.B., J.F., A.J.); Institut de Recherche pour le Developpement, VITROME, Aix-Marseille University, Marseille, France (S.C.); Aix-Marseille School of Economics, Aix-Marseille University, Marseille, France (B.G.); Newham University Hospital, Barts Health NHS Trust, London, England (M.Y.K.); Health Data Research UK, London, England (S.E.P.); and Alan Turing Institute, London, England (S.E.P.)
| |
Collapse
|
5
|
Machado I, Puyol-Anton E, Hammernik K, Cruz G, Ugurlu D, Olakorede I, Oksuz I, Ruijsink B, Castelo-Branco M, Young A, Prieto C, Schnabel J, King A. A Deep Learning-Based Integrated Framework for Quality-Aware Undersampled Cine Cardiac MRI Reconstruction and Analysis. IEEE Trans Biomed Eng 2024; 71:855-865. [PMID: 37782583 DOI: 10.1109/tbme.2023.3321431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/04/2023]
Abstract
Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this article, we present a fully-automated, quality-controlled integrated framework for reconstruction, segmentation and downstream analysis of undersampled cine CMR data. The framework produces high quality reconstructions and segmentations, leading to undersampling factors that are optimised on a scan-by-scan basis. This results in reduced scan times and automated analysis, enabling robust and accurate estimation of functional biomarkers. To demonstrate the feasibility of the proposed approach, we perform simulations of radial k-space acquisitions using in-vivo cine CMR data from 270 subjects from the UK Biobank (with synthetic phase) and in-vivo cine CMR data from 16 healthy subjects (with real phase). The results demonstrate that the optimal undersampling factor varies for different subjects by approximately 1 to 2 seconds per slice. We show that our method can produce quality-controlled images in a mean scan time reduced from 12 to 4 seconds per slice, and that image quality is sufficient to allow clinically relevant parameters to be automatically estimated to lie within 5% mean absolute difference.
Collapse
|
6
|
Zhang X, Li Q, Li W, Guo Y, Zhang J, Guo C, Chang K, Lovell NH. FD-Net: Feature Distillation Network for Oral Squamous Cell Carcinoma Lymph Node Segmentation in Hyperspectral Imagery. IEEE J Biomed Health Inform 2024; 28:1552-1563. [PMID: 38446656 DOI: 10.1109/jbhi.2024.3350245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/08/2024]
Abstract
Oral squamous cell carcinoma (OSCC) has the characteristics of early regional lymph node metastasis. OSCC patients often have poor prognoses and low survival rates due to cervical lymph metastases. Therefore, it is necessary to rely on a reasonable screening method to quickly judge the cervical lymph metastastic condition of OSCC patients and develop appropriate treatment plans. In this study, the widely used pathological sections with hematoxylin-eosin (H&E) staining are taken as the target, and combined with the advantages of hyperspectral imaging technology, a novel diagnostic method for identifying OSCC lymph node metastases is proposed. The method consists of a learning stage and a decision-making stage, focusing on cancer and non-cancer nuclei, gradually completing the lesions' segmentation from coarse to fine, and achieving high accuracy. In the learning stage, the proposed feature distillation-Net (FD-Net) network is developed to segment the cancerous and non-cancerous nuclei. In the decision-making stage, the segmentation results are post-processed, and the lesions are effectively distinguished based on the prior. Experimental results demonstrate that the proposed FD-Net is very competitive in the OSCC hyperspectral medical image segmentation task. The proposed FD-Net method performs best on the seven segmentation evaluation indicators: MIoU, OA, AA, SE, CSI, GDR, and DICE. Among these seven evaluation indicators, the proposed FD-Net method is 1.75%, 1.27%, 0.35%, 1.9%, 0.88%, 4.45%, and 1.98% higher than the DeepLab V3 method, which ranks second in performance, respectively. In addition, the proposed diagnosis method of OSCC lymph node metastasis can effectively assist pathologists in disease screening and reduce the workload of pathologists.
Collapse
|
7
|
Chen R, Liu M, Chen W, Wang Y, Meijering E. Deep learning in mesoscale brain image analysis: A review. Comput Biol Med 2023; 167:107617. [PMID: 37918261 DOI: 10.1016/j.compbiomed.2023.107617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 10/06/2023] [Accepted: 10/23/2023] [Indexed: 11/04/2023]
Abstract
Mesoscale microscopy images of the brain contain a wealth of information which can help us understand the working mechanisms of the brain. However, it is a challenging task to process and analyze these data because of the large size of the images, their high noise levels, the complex morphology of the brain from the cellular to the regional and anatomical levels, the inhomogeneous distribution of fluorescent labels in the cells and tissues, and imaging artifacts. Due to their impressive ability to extract relevant information from images, deep learning algorithms are widely applied to microscopy images of the brain to address these challenges and they perform superiorly in a wide range of microscopy image processing and analysis tasks. This article reviews the applications of deep learning algorithms in brain mesoscale microscopy image processing and analysis, including image synthesis, image segmentation, object detection, and neuron reconstruction and analysis. We also discuss the difficulties of each task and possible directions for further research.
Collapse
Affiliation(s)
- Runze Chen
- College of Electrical and Information Engineering, National Engineering Laboratory for Robot Visual Perception and Control Technology, Hunan University, Changsha, 410082, China
| | - Min Liu
- College of Electrical and Information Engineering, National Engineering Laboratory for Robot Visual Perception and Control Technology, Hunan University, Changsha, 410082, China; Research Institute of Hunan University in Chongqing, Chongqing, 401135, China.
| | - Weixun Chen
- College of Electrical and Information Engineering, National Engineering Laboratory for Robot Visual Perception and Control Technology, Hunan University, Changsha, 410082, China
| | - Yaonan Wang
- College of Electrical and Information Engineering, National Engineering Laboratory for Robot Visual Perception and Control Technology, Hunan University, Changsha, 410082, China
| | - Erik Meijering
- School of Computer Science and Engineering, University of New South Wales, Sydney 2052, New South Wales, Australia
| |
Collapse
|
8
|
Jin L, Ma Z, Li H, Gao F, Gao P, Yang N, Li D, Li M, Geng D. Interobserver Agreement in Automatic Segmentation Annotation of Prostate Magnetic Resonance Imaging. Bioengineering (Basel) 2023; 10:1340. [PMID: 38135930 PMCID: PMC10740636 DOI: 10.3390/bioengineering10121340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 11/10/2023] [Accepted: 11/17/2023] [Indexed: 12/24/2023] Open
Abstract
We aimed to compare the performance and interobserver agreement of radiologists manually segmenting images or those assisted by automatic segmentation. We further aimed to reduce interobserver variability and improve the consistency of radiomics features. This retrospective study included 327 patients diagnosed with prostate cancer from September 2016 to June 2018; images from 228 patients were used for automatic segmentation construction, and images from the remaining 99 were used for testing. First, four radiologists with varying experience levels retrospectively segmented 99 axial prostate images manually using T2-weighted fat-suppressed magnetic resonance imaging. Automatic segmentation was performed after 2 weeks. The Pyradiomics software package v3.1.0 was used to extract the texture features. The Dice coefficient and intraclass correlation coefficient (ICC) were used to evaluate segmentation performance and the interobserver consistency of prostate radiomics. The Wilcoxon rank sum test was used to compare the paired samples, with the significance level set at p < 0.05. The Dice coefficient was used to accurately measure the spatial overlap of manually delineated images. In all the 99 prostate segmentation result columns, the manual and automatic segmentation results of the senior group were significantly better than those of the junior group (p < 0.05). Automatic segmentation was more consistent than manual segmentation (p < 0.05), and the average ICC reached >0.85. The automatic segmentation annotation performance of junior radiologists was similar to that of senior radiologists performing manual segmentation. The ICC of radiomics features increased to excellent consistency (0.925 [0.888~0.950]). Automatic segmentation annotation provided better results than manual segmentation by radiologists. Our findings indicate that automatic segmentation annotation helps reduce variability in the perception and interpretation between radiologists with different experience levels and ensures the stability of radiomics features.
Collapse
Affiliation(s)
- Liang Jin
- Radiology Department, Huashan Hospital, Affiliated with Fudan University, Shanghai 200040, China; (L.J.); (H.L.)
- Radiology Department, Huadong Hospital, Affiliated with Fudan University, Shanghai 200040, China; (Z.M.); (F.G.); (P.G.); (N.Y.); (D.L.)
| | - Zhuangxuan Ma
- Radiology Department, Huadong Hospital, Affiliated with Fudan University, Shanghai 200040, China; (Z.M.); (F.G.); (P.G.); (N.Y.); (D.L.)
| | - Haiqing Li
- Radiology Department, Huashan Hospital, Affiliated with Fudan University, Shanghai 200040, China; (L.J.); (H.L.)
| | - Feng Gao
- Radiology Department, Huadong Hospital, Affiliated with Fudan University, Shanghai 200040, China; (Z.M.); (F.G.); (P.G.); (N.Y.); (D.L.)
| | - Pan Gao
- Radiology Department, Huadong Hospital, Affiliated with Fudan University, Shanghai 200040, China; (Z.M.); (F.G.); (P.G.); (N.Y.); (D.L.)
| | - Nan Yang
- Radiology Department, Huadong Hospital, Affiliated with Fudan University, Shanghai 200040, China; (Z.M.); (F.G.); (P.G.); (N.Y.); (D.L.)
| | - Dechun Li
- Radiology Department, Huadong Hospital, Affiliated with Fudan University, Shanghai 200040, China; (Z.M.); (F.G.); (P.G.); (N.Y.); (D.L.)
| | - Ming Li
- Radiology Department, Huadong Hospital, Affiliated with Fudan University, Shanghai 200040, China; (Z.M.); (F.G.); (P.G.); (N.Y.); (D.L.)
- Institute of Functional and Molecular Medical Imaging, Shanghai 200040, China
| | - Daoying Geng
- Radiology Department, Huashan Hospital, Affiliated with Fudan University, Shanghai 200040, China; (L.J.); (H.L.)
- Institute of Functional and Molecular Medical Imaging, Shanghai 200040, China
| |
Collapse
|
9
|
Mariscal-Harana J, Asher C, Vergani V, Rizvi M, Keehn L, Kim RJ, Judd RM, Petersen SE, Razavi R, King AP, Ruijsink B, Puyol-Antón E. An artificial intelligence tool for automated analysis of large-scale unstructured clinical cine cardiac magnetic resonance databases. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2023; 4:370-383. [PMID: 37794871 PMCID: PMC10545512 DOI: 10.1093/ehjdh/ztad044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 06/05/2023] [Accepted: 07/12/2023] [Indexed: 10/06/2023]
Abstract
Aims Artificial intelligence (AI) techniques have been proposed for automating analysis of short-axis (SAX) cine cardiac magnetic resonance (CMR), but no CMR analysis tool exists to automatically analyse large (unstructured) clinical CMR datasets. We develop and validate a robust AI tool for start-to-end automatic quantification of cardiac function from SAX cine CMR in large clinical databases. Methods and results Our pipeline for processing and analysing CMR databases includes automated steps to identify the correct data, robust image pre-processing, an AI algorithm for biventricular segmentation of SAX CMR and estimation of functional biomarkers, and automated post-analysis quality control to detect and correct errors. The segmentation algorithm was trained on 2793 CMR scans from two NHS hospitals and validated on additional cases from this dataset (n = 414) and five external datasets (n = 6888), including scans of patients with a range of diseases acquired at 12 different centres using CMR scanners from all major vendors. Median absolute errors in cardiac biomarkers were within the range of inter-observer variability: <8.4 mL (left ventricle volume), <9.2 mL (right ventricle volume), <13.3 g (left ventricular mass), and <5.9% (ejection fraction) across all datasets. Stratification of cases according to phenotypes of cardiac disease and scanner vendors showed good performance across all groups. Conclusion We show that our proposed tool, which combines image pre-processing steps, a domain-generalizable AI algorithm trained on a large-scale multi-domain CMR dataset and quality control steps, allows robust analysis of (clinical or research) databases from multiple centres, vendors, and cardiac diseases. This enables translation of our tool for use in fully automated processing of large multi-centre databases.
Collapse
Affiliation(s)
- Jorge Mariscal-Harana
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| | - Clint Asher
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
| | - Vittoria Vergani
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| | - Maleeha Rizvi
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
| | - Louise Keehn
- Department of Clinical Pharmacology, King’s College London British Heart Foundation Centre, St Thomas’ Hospital, London, Westminster Bridge Road, London SE1 7EH, UK
| | - Raymond J Kim
- Division of Cardiology, Department of Medicine, Duke University, 40 Duke Medicine Circle, Durham, NC 27710, USA
| | - Robert M Judd
- Division of Cardiology, Department of Medicine, Duke University, 40 Duke Medicine Circle, Durham, NC 27710, USA
| | - Steffen E Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London EC1M 6BQ, UK
- Barts Heart Centre, St Bartholomew’s Hospital, Barts Health NHS Trust, W Smithfield, London EC1A 7BE, UK
- Health Data Research UK, Gibbs Building, 215 Euston Rd., London NW1 2BE, UK
- Alan Turing Institute, 96 Euston Rd., London NW1 2DB, UK
| | - Reza Razavi
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
| | - Andrew P King
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| | - Bram Ruijsink
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
- Department of Cardiology, Division Heart and Lungs, University Medical Center Utrecht, Utrecht University, 3584 CX Utrecht, the Netherlands
| | - Esther Puyol-Antón
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| |
Collapse
|
10
|
Liu Q, Lu Q, Chai Y, Tao Z, Wu Q, Jiang M, Pu J. Radiomics-Based Quality Control System for Automatic Cardiac Segmentation: A Feasibility Study. Bioengineering (Basel) 2023; 10:791. [PMID: 37508818 PMCID: PMC10376472 DOI: 10.3390/bioengineering10070791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 06/19/2023] [Accepted: 06/28/2023] [Indexed: 07/30/2023] Open
Abstract
PURPOSE In the past decade, there has been a rapid increase in the development of automatic cardiac segmentation methods. However, the automatic quality control (QC) of these segmentation methods has received less attention. This study aims to address this gap by developing an automatic pipeline that incorporates DL-based cardiac segmentation and radiomics-based quality control. METHODS In the DL-based localization and segmentation part, the entire heart was first located and cropped. Then, the cropped images were further utilized for the segmentation of the right ventricle cavity (RVC), myocardium (MYO), and left ventricle cavity (LVC). As for the radiomics-based QC part, a training radiomics dataset was created with segmentation tasks of various quality. This dataset was used for feature extraction, selection, and QC model development. The model performance was then evaluated using both internal and external testing datasets. RESULTS In the internal testing dataset, the segmentation model demonstrated a great performance with a dice similarity coefficient (DSC) of 0.954 for whole heart segmentations. Images were then appropriately cropped to 160 × 160 pixels. The models also performed well for cardiac substructure segmentations. The DSC values were 0.863, 0.872, and 0.940 for RVC, MYO, and LVC for 2D masks and 0.928, 0.886, and 0.962 for RVC, MYO, and LVC for 3D masks with an attention-UNet. After feature selection with the radiomics dataset, we developed a series of models to predict the automatic segmentation quality and its DSC value for the RVC, MYO, and LVC structures. The mean absolute values for our best prediction models were 0.060, 0.032, and 0.021 for 2D segmentations and 0.027, 0.017, and 0.011 for 3D segmentations, respectively. Additionally, the radiomics-based classification models demonstrated a high negative detection rate of >0.85 in all 2D groups. In the external dataset, models showed similar results. CONCLUSIONS We developed a pipeline including cardiac substructure segmentation and QC at both the slice (2D) and subject (3D) levels. Our results demonstrate that the radiomics method possesses great potential for the automatic QC of cardiac segmentation.
Collapse
Affiliation(s)
- Qiming Liu
- Department of Cardiology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200120, China
| | - Qifan Lu
- Department of Cardiology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200120, China
| | - Yezi Chai
- Department of Cardiology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200120, China
| | - Zhengyu Tao
- Department of Cardiology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200120, China
| | - Qizhen Wu
- Department of Cardiology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200120, China
| | - Meng Jiang
- Department of Cardiology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200120, China
| | - Jun Pu
- Department of Cardiology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200120, China
| |
Collapse
|
11
|
Wang J, Zhao H, Liang W, Wang S, Zhang Y. Cross-convolutional transformer for automated multi-organs segmentation in a variety of medical images. Phys Med Biol 2023; 68. [PMID: 36623323 DOI: 10.1088/1361-6560/acb19a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2022] [Accepted: 01/09/2023] [Indexed: 01/11/2023]
Abstract
Objective.It is a huge challenge for multi-organs segmentation in various medical images based on a consistent algorithm with the development of deep learning methods. We therefore develop a deep learning method based on cross-convolutional transformer for these automated- segmentation to obtain better generalization and accuracy.Approach.We propose a cross-convolutional transformer network (C2Former) to solve the segmentation problem. Specifically, we first redesign a novel cross-convolutional self-attention mechanism in terms of the algorithm to integrate local and global contexts and model long-distance and short-distance dependencies to enhance the semantic feature understanding of images. Then multi-scale feature edge fusion module is proposed to combine the image edge features, which effectively form multi-scale feature streams and establish reliable relational connections in the global context. Finally, we use three different modalities, imaging three different anatomical regions to train and test multi organs and evaluate segmentation performance.Main results.We use the evaluation metrics of Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95) for each dataset. Experiments showed the average DSC of 83.22% and HD95 of 17.55 mm on the Synapse dataset (CT images of abdominal multi-organ), the average DSC of 91.42% and HD95 of 1.06 mm on the ACDC dataset (MRI of cardiac substructures) and the average DSC of 86.78% and HD95 of 16.85 mm on the ISIC 2017 dataset (skin cancer images). In each dataset, our proposed method consistently outperforms the compared networks.Significance.The proposed deep learning network provides a generalized and accurate solution method for multi-organ segmentation in the three different datasets. It has the potential to be applied to a variety of medical datasets for structural segmentation.
Collapse
Affiliation(s)
- Jing Wang
- School of Information Science and Engineering Department, Shandong University, 72 Binghai Road, Jimo, Qingdao, Shandong, People's Republic of China
| | - Haiyue Zhao
- Shandong Youth University of Political Science, No.31699 Jing Shi East Road, Li Xia District, Jinan, Shandong, People's Republic of China
| | - Wei Liang
- Department of ecological environment of Shandong, No.3377 Jing Shi Road, Jinan, People's Republic of China
| | - Shuyu Wang
- Shandong Youth University of Political Science, No.31699 Jing Shi East Road, Li Xia District, Jinan, Shandong, People's Republic of China
| | - Yan Zhang
- Shandong Mental Health Center, No.49 Wen Hua Dong Road, Li Xia District, Jinan, Shandong, People's Republic of China
| |
Collapse
|
12
|
Cerebral Angiography under Artificial Intelligence Algorithm in the Design of Nursing Cooperation Plan for Intracranial Aneurysm Patients in Craniotomy Clipping. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:2182931. [PMID: 35860187 PMCID: PMC9293491 DOI: 10.1155/2022/2182931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 06/19/2022] [Accepted: 06/21/2022] [Indexed: 11/18/2022]
Abstract
This research was to investigate the value of indocyanine green angiography (ICGA) based on maximum interclass variance (Otsu) method in the nursing plan of intracranial aneurysm clipping (ICAC) for intracranial aneurysm patients. An Otsu algorithm was selected to optimize the original images with the optimal threshold. In addition, the algorithm was applied to ICGA images of 86 patients with intracranial aneurysms, who were randomly divided into an experimental group (using ICGA + ICAC+ perioperative nursing) and a control group (ICAC + conventional nursing), to observe the clinical indicators, treatment, complications, nursing satisfaction, and quality of life of patients in two groups. The results showed that the mean square error (MSE), structural similarity (SSIM), and shape error (SE) were 3.71, 0.84, and 0.47, respectively. The length of hospital stay in the experimental group (19.9 ± 3.5 days) was significantly shorter than that in the control group (23.2 ± 3.0 days), the rate of excellent treatment was significantly higher than that in the control group, and the incidence of complications was lower. WHOQOL-BREF scores of the two groups after nursing intervention were higher than before, and the score in the experimental group was higher than the control group. In addition, the nursing satisfaction was also significantly higher in the experimental group, and the difference was statistically significant (P < 0.05). In conclusion, ICGA based on the Otsu method could effectively evaluate the cerebrovascular morphology during craniotomy and ICAP and improve the surgical efficacy. Combined with perioperative nursing intervention, it could greatly reduce the incidence of postoperative complications, improve the treatment effect and quality of life, and enhance the long-term prognosis.
Collapse
|
13
|
From Accuracy to Reliability and Robustness in Cardiac Magnetic Resonance Image Segmentation: A Review. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12083936] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Since the rise of deep learning (DL) in the mid-2010s, cardiac magnetic resonance (CMR) image segmentation has achieved state-of-the-art performance. Despite achieving inter-observer variability in terms of different accuracy performance measures, visual inspections reveal errors in most segmentation results, indicating a lack of reliability and robustness of DL segmentation models, which can be critical if a model was to be deployed into clinical practice. In this work, we aim to bring attention to reliability and robustness, two unmet needs of cardiac image segmentation methods, which are hampering their translation into practice. To this end, we first study the performance accuracy evolution of CMR segmentation, illustrate the improvements brought by DL algorithms and highlight the symptoms of performance stagnation. Afterwards, we provide formal definitions of reliability and robustness. Based on the two definitions, we identify the factors that limit the reliability and robustness of state-of-the-art deep learning CMR segmentation techniques. Finally, we give an overview of the current set of works that focus on improving the reliability and robustness of CMR segmentation, and we categorize them into two families of methods: quality control methods and model improvement techniques. The first category corresponds to simpler strategies that only aim to flag situations where a model may be incurring poor reliability or robustness. The second one, instead, directly tackles the problem by bringing improvements into different aspects of the CMR segmentation model development process. We aim to bring the attention of more researchers towards these emerging trends regarding the development of reliable and robust CMR segmentation frameworks, which can guarantee the safe use of DL in clinical routines and studies.
Collapse
|
14
|
Tang P, Yang P, Nie D, Wu X, Zhou J, Wang Y. Unified medical image segmentation by learning from uncertainty in an end-to-end manner. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.108215] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|