1
|
Henriksen EL, Carlsen JF, Vejborg IMM, Nielsen MB, Lauridsen CA. The efficacy of using computer-aided detection (CAD) for detection of breast cancer in mammography screening: a systematic review. Acta Radiol 2019; 60:13-18. [PMID: 29665706 DOI: 10.1177/0284185118770917] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Early detection of breast cancer (BC) is crucial in lowering the mortality. PURPOSE To present an overview of studies concerning computer-aided detection (CAD) in screening mammography for early detection of BC and compare diagnostic accuracy and recall rates (RR) of single reading (SR) with SR + CAD and double reading (DR) with SR + CAD. MATERIAL AND METHODS PRISMA guidelines were used as a review protocol. Articles on clinical trials concerning CAD for detection of BC in a screening population were included. The literature search resulted in 1522 records. A total of 1491 records were excluded by abstract and 18 were excluded by full text reading. A total of 13 articles were included. RESULTS All but two studies from the SR vs. SR + CAD group showed an increased sensitivity and/or cancer detection rate (CDR) when adding CAD. The DR vs. SR + CAD group showed no significant differences in sensitivity and CDR. Adding CAD to SR increased the RR and decreased the specificity in all but one study. For the DR vs. SR + CAD group only one study reported a significant difference in RR. CONCLUSION All but two studies showed an increase in RR, sensitivity and CDR when adding CAD to SR. Compared to DR no statistically significant differences in sensitivity or CDR were reported. Additional studies based on organized population-based screening programs, with longer follow-up time, high-volume readers, and digital mammography are needed to evaluate the efficacy of CAD.
Collapse
Affiliation(s)
- Emilie L Henriksen
- Department of Diagnostic Radiology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Department of technology, Faculty of Health and Technology, Metropolitan University College, Copenhagen, Denmark
| | - Jonathan F Carlsen
- Department of Diagnostic Radiology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
| | - Ilse MM Vejborg
- Department of Diagnostic Radiology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
| | - Michael B Nielsen
- Department of Diagnostic Radiology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
| | - Carsten A Lauridsen
- Department of Diagnostic Radiology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Department of technology, Faculty of Health and Technology, Metropolitan University College, Copenhagen, Denmark
| |
Collapse
|
2
|
|
3
|
Jung H, Kim B, Lee I, Yoo M, Lee J, Ham S, Woo O, Kang J. Detection of masses in mammograms using a one-stage object detector based on a deep convolutional neural network. PLoS One 2018; 13:e0203355. [PMID: 30226841 PMCID: PMC6143189 DOI: 10.1371/journal.pone.0203355] [Citation(s) in RCA: 44] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2018] [Accepted: 08/20/2018] [Indexed: 12/27/2022] Open
Abstract
Several computer aided diagnosis (CAD) systems have been developed for mammography. They are widely used in certain countries such as the U.S. where mammography studies are conducted more frequently; however, they are not yet globally employed for clinical use due to their inconsistent performance, which can be attributed to their reliance on hand-crafted features. It is difficult to use hand-crafted features for mammogram images that vary due to factors such as the breast density of patients and differences in imaging devices. To address these problems, several studies have leveraged a deep convolutional neural network that does not require hand-crafted features. Among the recent object detectors, RetinaNet is particularly promising as it is a simpler one-stage object detector that is fast and efficient while achieving state-of-the-art performance. RetinaNet has been proven to perform conventional object detection tasks but has not been tested on detecting masses in mammograms. Thus, we propose a mass detection model based on RetinaNet. To validate its performance in diverse use cases, we construct several experimental setups using the public dataset INbreast and the in-house dataset GURO. In addition to training and testing on the same dataset (i.e., training and testing on INbreast), we evaluate our mass detection model in setups using additional training data (i.e., training on INbreast + GURO and testing on INbreast). We also evaluate our model in setups using pre-trained weights (i.e., using weights pre-trained on GURO, training and testing on INbreast). In all the experiments, our mass detection model achieves comparable or better performance than more complex state-of-the-art models including the two-stage object detector. Also, the results show that using the weights pre-trained on datasets achieves similar performance as directly using datasets in the training phase. Therefore, we make our mass detection model's weights pre-trained on both GURO and INbreast publicly available. We expect that researchers who train RetinaNet on their in-house dataset for the mass detection task can use our pre-trained weights to leverage the features extracted from the datasets.
Collapse
Affiliation(s)
- Hwejin Jung
- Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
| | - Bumsoo Kim
- Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
| | - Inyeop Lee
- Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
| | - Minhwan Yoo
- Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
| | - Junhyun Lee
- Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
| | - Sooyoun Ham
- Department of Radiology, Kangbuk Samsung Medical Center, Seoul, Republic of Korea
| | - Okhee Woo
- Department of Radiology, Korea University Guro Hospital, Seoul, Republic of Korea
| | - Jaewoo Kang
- Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
- Interdisciplinary Graduate Program in Bioinformatics, Korea University, Seoul, Republic of Korea
| |
Collapse
|
4
|
Kooi T, Karssemeijer N. Classifying symmetrical differences and temporal change for the detection of malignant masses in mammography using deep neural networks. J Med Imaging (Bellingham) 2017; 4:044501. [PMID: 29021992 PMCID: PMC5633751 DOI: 10.1117/1.jmi.4.4.044501] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2017] [Accepted: 09/12/2017] [Indexed: 01/27/2023] Open
Abstract
We investigate the addition of symmetry and temporal context information to a deep convolutional neural network (CNN) with the purpose of detecting malignant soft tissue lesions in mammography. We employ a simple linear mapping that takes the location of a mass candidate and maps it to either the contralateral or prior mammogram, and regions of interest (ROIs) are extracted around each location. Two different architectures are subsequently explored: (1) a fusion model employing two datastreams where both ROIs are fed to the network during training and testing and (2) a stagewise approach where a single ROI CNN is trained on the primary image and subsequently used as a feature extractor for both primary and contralateral or prior ROIs. A "shallow" gradient boosted tree classifier is then trained on the concatenation of these features and used to classify the joint representation. The baseline yielded an AUC of 0.87 with confidence interval [0.853, 0.893]. For the analysis of symmetrical differences, the first architecture where both primary and contralateral patches are presented during training obtained an AUC of 0.895 with confidence interval [0.877, 0.913], and the second architecture where a new classifier is retrained on the concatenation an AUC of 0.88 with confidence interval [0.859, 0.9]. We found a significant difference between the first architecture and the baseline at high specificity with [Formula: see text]. When using the same architectures to analyze temporal change, we yielded an AUC of 0.884 with confidence interval [0.865, 0.902] for the first architecture and an AUC of 0.879 with confidence interval [0.858, 0.898] in the second setting. Although improvements for temporal analysis were consistent, they were not found to be significant. The results show our proposed method is promising and we suspect performance can greatly be improved when more temporal data become available.
Collapse
Affiliation(s)
- Thijs Kooi
- RadboudUMC Nijmegen, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| | - Nico Karssemeijer
- RadboudUMC Nijmegen, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| |
Collapse
|
5
|
Large scale deep learning for computer aided detection of mammographic lesions. Med Image Anal 2016; 35:303-312. [PMID: 27497072 DOI: 10.1016/j.media.2016.07.007] [Citation(s) in RCA: 441] [Impact Index Per Article: 55.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2016] [Revised: 07/12/2016] [Accepted: 07/20/2016] [Indexed: 12/15/2022]
Abstract
Recent advances in machine learning yielded new techniques to train deep neural networks, which resulted in highly successful applications in many pattern recognition tasks such as object detection and speech recognition. In this paper we provide a head-to-head comparison between a state-of-the art in mammography CAD system, relying on a manually designed feature set and a Convolutional Neural Network (CNN), aiming for a system that can ultimately read mammograms independently. Both systems are trained on a large data set of around 45,000 images and results show the CNN outperforms the traditional CAD system at low sensitivity and performs comparable at high sensitivity. We subsequently investigate to what extent features such as location and patient information and commonly used manual features can still complement the network and see improvements at high specificity over the CNN especially with location and context features, which contain information not available to the CNN. Additionally, a reader study was performed, where the network was compared to certified screening radiologists on a patch level and we found no significant difference between the network and the readers.
Collapse
|
6
|
Evans DG, Astley S, Stavrinos P, Harkness E, Donnelly LS, Dawe S, Jacob I, Harvie M, Cuzick J, Brentnall A, Wilson M, Harrison F, Payne K, Howell A. Improvement in risk prediction, early detection and prevention of breast cancer in the NHS Breast Screening Programme and family history clinics: a dual cohort study. PROGRAMME GRANTS FOR APPLIED RESEARCH 2016. [DOI: 10.3310/pgfar04110] [Citation(s) in RCA: 52] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
BackgroundIn the UK, women are invited for 3-yearly mammography screening, through the NHS Breast Screening Programme (NHSBSP), from the ages of 47–50 years to the ages of 69–73 years. Women with family histories of breast cancer can, from the age of 40 years, obtain enhanced surveillance and, in exceptionally high-risk cases, magnetic resonance imaging. However, no NHSBSP risk assessment is undertaken. Risk prediction models are able to categorise women by risk using known risk factors, although accurate individual risk prediction remains elusive. The identification of mammographic breast density (MD) and common genetic risk variants [single nucleotide polymorphisms (SNPs)] has presaged the improved precision of risk models.ObjectivesTo (1) identify the best performing model to assess breast cancer risk in family history clinic (FHC) and population settings; (2) use information from MD/SNPs to improve risk prediction; (3) assess the acceptability and feasibility of offering risk assessment in the NHSBSP; and (4) identify the incremental costs and benefits of risk stratified screening in a preliminary cost-effectiveness analysis.DesignTwo cohort studies assessing breast cancer incidence.SettingHigh-risk FHC and the NHSBSP Greater Manchester, UK.ParticipantsA total of 10,000 women aged 20–79 years [Family History Risk Study (FH-Risk); UK Clinical Research Network identification number (UKCRN-ID) 8611] and 53,000 women from the NHSBSP [aged 46–73 years; Predicting the Risk of Cancer At Screening (PROCAS) study; UKCRN-ID 8080].InterventionsQuestionnaires collected standard risk information, and mammograms were assessed for breast density by a number of techniques. All FH-Risk and 10,000 PROCAS participants participated in deoxyribonucleic acid (DNA) studies. The risk prediction models Manual method, Tyrer–Cuzick (TC), BOADICEA (Breast and Ovarian Analysis of Disease Incidence and Carrier Estimation Algorithm) and Gail were used to assess risk, with modelling based on MD and SNPs. A preliminary model-based cost-effectiveness analysis of risk stratified screening was conducted.Main outcome measuresBreast cancer incidence.Data sourcesThe NHSBSP; cancer registration.ResultsA total of 446 women developed incident breast cancers in FH-Risk in 97,958 years of follow-up. All risk models accurately stratified women into risk categories. TC had better risk precision than Gail, and BOADICEA accurately predicted risk in the 6268 single probands. The Manual model was also accurate in the whole cohort. In PROCAS, TC had better risk precision than Gail [area under the curve (AUC) 0.58 vs. 0.54], identifying 547 prospective breast cancers. The addition of SNPs in the FH-Risk case–control study improved risk precision but was not useful inBRCA1(breast cancer 1 gene) families. Risk modelling of SNPs in PROCAS showed an incremental improvement from using SNP18 used in PROCAS to SNP67. MD measured by visual assessment score provided better risk stratification than automatic measures, despite wide intra- and inter-reader variability. Using a MD-adjusted TC model in PROCAS improved risk stratification (AUC = 0.6) and identified significantly higher rates (4.7 per 10,000 vs. 1.3 per 10,000;p < 0.001) of high-stage cancers in women with above-average breast cancer risks. It is not possible to provide estimates of the incremental costs and benefits of risk stratified screening because of lack of data inputs for key parameters in the model-based cost-effectiveness analysis.ConclusionsRisk precision can be improved by using DNA and MD, and can potentially be used to stratify NHSBSP screening. It may also identify those at greater risk of high-stage cancers for enhanced screening. The cost-effectiveness of risk stratified screening is currently associated with extensive uncertainty. Additional research is needed to identify data needed for key inputs into model-based cost-effectiveness analyses to identify the impact on health-care resource use and patient benefits.Future workA pilot of real-time NHSBSP risk prediction to identify women for chemoprevention and enhanced screening is required.FundingThe National Institute for Health Research Programme Grants for Applied Research programme. The DNA saliva collection for SNP analysis for PROCAS was funded by the Genesis Breast Cancer Prevention Appeal.
Collapse
Affiliation(s)
- D Gareth Evans
- Department of Genomic Medicine, Institute of Human Development, Manchester Academic Health Science Centre (MAHSC), Central Manchester University Hospitals NHS Foundation Trust, Manchester, UK
| | - Susan Astley
- Institute of Population Health, Centre for Imaging Sciences, University of Manchester, Manchester, UK
| | - Paula Stavrinos
- The Nightingale Centre and Genesis Prevention Centre, University Hospital of South Manchester, Manchester, UK
| | - Elaine Harkness
- Institute of Population Health, Centre for Imaging Sciences, University of Manchester, Manchester, UK
| | - Louise S Donnelly
- The Nightingale Centre and Genesis Prevention Centre, University Hospital of South Manchester, Manchester, UK
| | - Sarah Dawe
- The Nightingale Centre and Genesis Prevention Centre, University Hospital of South Manchester, Manchester, UK
| | - Ian Jacob
- Department of Health Economics, University of Manchester, Manchester, UK
| | - Michelle Harvie
- The Nightingale Centre and Genesis Prevention Centre, University Hospital of South Manchester, Manchester, UK
| | - Jack Cuzick
- Wolfson Institute of Preventive Medicine, Queen Mary University of London, London, UK
| | - Adam Brentnall
- Wolfson Institute of Preventive Medicine, Queen Mary University of London, London, UK
| | - Mary Wilson
- The Nightingale Centre and Genesis Prevention Centre, University Hospital of South Manchester, Manchester, UK
| | | | - Katherine Payne
- Department of Health Economics, University of Manchester, Manchester, UK
| | - Anthony Howell
- Institute of Population Health, Centre for Imaging Sciences, University of Manchester, Manchester, UK
- The Nightingale Centre and Genesis Prevention Centre, University Hospital of South Manchester, Manchester, UK
| |
Collapse
|
7
|
Moran S, Warren-Forward H. The diagnostic accuracy of radiographers assessing screening mammograms: A systematic review. Radiography (Lond) 2016. [DOI: 10.1016/j.radi.2015.09.008] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
8
|
Hussain M. False-positive reduction in mammography using multiscale spatial Weber law descriptor and support vector machines. Neural Comput Appl 2013; 25:83-93. [PMID: 24954976 PMCID: PMC4055841 DOI: 10.1007/s00521-013-1450-7] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2012] [Accepted: 06/28/2013] [Indexed: 11/26/2022]
Abstract
In a CAD system for the detection of masses, segmentation of mammograms yields regions of interest (ROIs), which are not only true masses but also suspicious normal tissues that result in false positives. We introduce a new method for false-positive reduction in this paper. The key idea of our approach is to exploit the textural properties of mammograms and for texture description, to use Weber law descriptor (WLD), which outperforms state-of-the-art best texture descriptors. The basic WLD is a holistic descriptor by its construction because it integrates the local information content into a single histogram, which does not take into account the spatial locality of micropatterns. We extend it into a multiscale spatial WLD (MSWLD) that better characterizes the texture micro structures of masses by incorporating the spatial locality and scale of microstructures. The dimension of the feature space generated by MSWLD becomes high; it is reduced by selecting features based on their significance. Finally, support vector machines are employed to classify ROIs as true masses or normal parenchyma. The proposed approach is evaluated using 1024 ROIs taken from digital database for screening mammography and an accuracy of Az = 0.99 ± 0.003 (area under receiver operating characteristic curve) is obtained. A comparison reveals that the proposed method has significant improvement over the state-of-the-art best methods for false-positive reduction problem.
Collapse
Affiliation(s)
- Muhammad Hussain
- Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| |
Collapse
|
9
|
Povyakalo AA, Alberdi E, Strigini L, Ayton P. How to discriminate between computer-aided and computer-hindered decisions: a case study in mammography. Med Decis Making 2013; 33:98-107. [PMID: 23300205 DOI: 10.1177/0272989x12465490] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Computer aids can affect decisions in complex ways, potentially even making them worse; common assessment methods may miss these effects. We developed a method for estimating the quality of decisions, as well as how computer aids affect it, and applied it to computer-aided detection (CAD) of cancer, reanalyzing data from a published study where 50 professionals ("readers") interpreted 180 mammograms, both with and without computer support. METHOD We used stepwise regression to estimate how CAD affected the probability of a reader making a correct screening decision on a patient with cancer (sensitivity), thereby taking into account the effects of the difficulty of the cancer (proportion of readers who missed it) and the reader's discriminating ability (Youden's determinant). Using regression estimates, we obtained thresholds for classifying a posteriori the cases (by difficulty) and the readers (by discriminating ability). RESULTS Use of CAD was associated with a 0.016 increase in sensitivity (95% confidence interval [CI], 0.003-0.028) for the 44 least discriminating radiologists for 45 relatively easy, mostly CAD-detected cancers. However, for the 6 most discriminating radiologists, with CAD, sensitivity decreased by 0.145 (95% CI, 0.034-0.257) for the 15 relatively difficult cancers. CONCLUSIONS Our exploratory analysis method reveals unexpected effects. It indicates that, despite the original study detecting no significant average effect, CAD helped the less discriminating readers but hindered the more discriminating readers. Such differential effects, although subtle, may be clinically significant and important for improving both computer algorithms and protocols for their use. They should be assessed when evaluating CAD and similar warning systems.
Collapse
Affiliation(s)
- Andrey A Povyakalo
- Centre for Software Reliability, City University London, Northampton Square, London, UK (AAP, EA, LS)
| | - Eugenio Alberdi
- Centre for Software Reliability, City University London, Northampton Square, London, UK (AAP, EA, LS)
| | - Lorenzo Strigini
- Centre for Software Reliability, City University London, Northampton Square, London, UK (AAP, EA, LS)
| | - Peter Ayton
- Psychology Department, City University London, Northampton Square, London, UK (PA)
| |
Collapse
|
10
|
Nguyen M, Truong Q, Nguyen D, Nguyen T, Nguyen V. An Alternative Approach to Reduce Massive False Positives in Mammograms Using Block Variance of Local Coefficients Features and Support Vector Machine. ACTA ACUST UNITED AC 2013. [DOI: 10.1016/j.procs.2013.09.293] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
11
|
Azavedo E, Zackrisson S, Mejàre I, Heibert Arnlind M. Is single reading with computer-aided detection (CAD) as good as double reading in mammography screening? A systematic review. BMC Med Imaging 2012; 12:22. [PMID: 22827803 PMCID: PMC3464719 DOI: 10.1186/1471-2342-12-22] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2012] [Accepted: 06/23/2012] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND In accordance with European guidelines, mammography screening comprises independent readings by two breast radiologists (double reading). CAD (computer-aided detection) has been suggested to complement or replace one of the two readers (single reading + CAD).The aim of this systematic review is to address the following question: Is the reading of mammographic x-ray images by a single breast radiologist together with CAD at least as accurate as double reading? METHODS The electronic literature search included the databases Pub Med, EMBASE and The Cochrane Library. Two independent reviewers assessed abstracts and full-text articles. RESULTS 1049 abstracts were identified, of which 996 were excluded with reference to inclusion and exclusion criteria; 53 full-text articles were assessed for eligibility. Finally, four articles were included in the qualitative analysis, and one in a GRADE synthesis. CONCLUSIONS The scientific evidence is insufficient to determine whether the accuracy of single reading + CAD is at least equivalent to that obtained in standard practice, i.e. double reading where two breast radiologists independently read the mammographic images.
Collapse
Affiliation(s)
- Edward Azavedo
- Department of Diagnostic Radiology, Karolinska Institutet, Stockholm, Sweden
- LIME/MMC, Karolinska Institutet, Stockholm, Sweden
| | - Sophia Zackrisson
- Department of Clinical Sciences in Malmö, Diagnostic Radiology, Lund University, Skåne University Hospital Malmö, Malmö, SE-205 02, Sweden
| | - Ingegerd Mejàre
- Swedish Council on Health Technology Assessment (SBU), Stockholm, Sweden
| | - Marianne Heibert Arnlind
- Swedish Council on Health Technology Assessment (SBU), Stockholm, Sweden
- LIME/MMC, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
12
|
Clinically missed cancer: how effectively can radiologists use computer-aided detection? AJR Am J Roentgenol 2012; 198:708-16. [PMID: 22358014 DOI: 10.2214/ajr.11.6423] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
OBJECTIVE The purpose of this study was to determine the effectiveness with which radiologists can use computer-aided detection (CADe) to detect cancer missed at screening. MATERIALS AND METHODS An observer study was performed to measure the ability of radiologists to detect breast cancer on mammograms with and without CADe. The images in the study were from 300 analog mammographic examinations. In 234 cases the mammograms were read clinically as normal and free of cancer for at least 2 subsequent years. In the other 66 cases, cancers were missed clinically. In 256 cases, current and previous mammograms were available. Eight radiologists read the dataset and recorded a BI-RADS assessment, the location of the lesion, and their level of confidence that the patient should be recalled for diagnostic workup for each suspicious lesion. Jackknife alternative free-response receiver operating characteristic analysis was used. RESULTS The jackknife alternative free-response receiver operating characteristic figure of merit was 0.641 without aid and 0.659 with aid (p = 0.06; 95% CI, -0.001 to 0.036). The sensitivity increased 9.9% (95% CI, 3.4-19%) and the callback rate 12.1% (95% CI, 7.3-20%) with CADe. Both increases were statistically significant (p < 0.001). Radiologists on average ignored 71% of correct computer prompts. CONCLUSION Use of CADe can increase radiologist sensitivity 10% with a comparable increase in recall rate. There is potential for CADe to have a bigger clinical impact because radiologists failed to recognize a correct computer prompt in 71% of missed cancer cases [corrected].
Collapse
|
13
|
Guerriero C, Gillan MGC, Cairns J, Wallis MG, Gilbert FJ. Is computer aided detection (CAD) cost effective in screening mammography? A model based on the CADET II study. BMC Health Serv Res 2011; 11:11. [PMID: 21241473 PMCID: PMC3032650 DOI: 10.1186/1472-6963-11-11] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2010] [Accepted: 01/17/2011] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Single reading with computer aided detection (CAD) is an alternative to double reading for detecting cancer in screening mammograms. The aim of this study is to investigate whether the use of a single reader with CAD is more cost-effective than double reading. METHODS Based on data from the CADET II study, the cost-effectiveness of single reading with CAD versus double reading was measured in terms of cost per cancer detected. Cost (Pound (£), year 2007/08) of single reading with CAD versus double reading was estimated assuming a health and social service perspective and a 7 year time horizon. As the equipment cost varies according to the unit size a separate analysis was conducted for high, average and low volume screening units. One-way sensitivity analyses were performed by varying the reading time, equipment and assessment cost, recall rate and reader qualification. RESULTS CAD is cost increasing for all sizes of screening unit. The introduction of CAD is cost-increasing compared to double reading because the cost of CAD equipment, staff training and the higher assessment cost associated with CAD are greater than the saving in reading costs. The introduction of single reading with CAD, in place of double reading, would produce an additional cost of £227 and £253 per 1,000 women screened in high and average volume units respectively. In low volume screening units, the high cost of purchasing the equipment will results in an additional cost of £590 per 1,000 women screened.One-way sensitivity analysis showed that the factors having the greatest effect on the cost-effectiveness of CAD with single reading compared with double reading were the reading time and the reader's professional qualification (radiologist versus advanced practitioner). CONCLUSIONS Without improvements in CAD effectiveness (e.g. a decrease in the recall rate) CAD is unlikely to be a cost effective alternative to double reading for mammography screening in UK. This study provides updated estimates of CAD costs in a full-field digital system and assessment cost for women who are re-called after initial screening. However, the model is highly sensitive to various parameters e.g. reading time, reader qualification, and equipment cost.
Collapse
Affiliation(s)
- Carla Guerriero
- Health Service Research and Policy Department, London School of Hygiene and Tropical Medicine, London, UK.
| | | | | | | | | |
Collapse
|
14
|
Näppi JJ. CADe prompts and observer performance a game of confidence. Acad Radiol 2010; 17:945-7. [PMID: 20599154 DOI: 10.1016/j.acra.2010.05.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2010] [Revised: 05/21/2010] [Accepted: 05/23/2010] [Indexed: 11/26/2022]
|
15
|
Samulski M, Hupse R, Boetes C, Mus RDM, den Heeten GJ, Karssemeijer N. Using computer-aided detection in mammography as a decision support. Eur Radiol 2010; 20:2323-30. [PMID: 20532890 PMCID: PMC2940044 DOI: 10.1007/s00330-010-1821-8] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2010] [Revised: 03/23/2010] [Accepted: 04/20/2010] [Indexed: 11/21/2022]
Abstract
Objective: To evaluate an interactive computer-aided detection (CAD) system for reading mammograms to improve decision making. Methods: A dedicated mammographic workstation has been developed in which readers can probe image locations for the presence of CAD information. If present, CAD findings are displayed with the computed malignancy rating. A reader study was conducted in which four screening radiologists and five non-radiologists participated to study the effect of this system on detection performance. The participants read 120 cases of which 40 cases had a malignant mass that was missed at the original screening. The readers read each mammogram both with and without CAD in separate sessions. Each reader reported localized findings and assigned a malignancy score per finding. Mean sensitivity was computed in an interval of false-positive fractions less than 10%. Results: Mean sensitivity was 25.1% in the sessions without CAD and 34.8% in the CAD-assisted sessions. The increase in detection performance was significant (p = 0.012). Average reading time was 84.7 ± 61.5 s/case in the unaided sessions and was not significantly higher when interactive CAD was used (85.9 ± 57.8 s/case). Conclusion: Interactive use of CAD in mammography may be more effective than traditional CAD for improving mass detection without affecting reading time.
Collapse
Affiliation(s)
- Maurice Samulski
- Department of Radiology, Radboud University Nijmegen Medical Centre, Geert Grooteplein 10, 6500 HB, Nijmegen, The Netherlands.
| | | | | | | | | | | |
Collapse
|
16
|
Sánchez Gómez S. Sistemas de lectura asistida por ordenador en mamografía. RADIOLOGIA 2010; 52 Suppl 1:14-7. [DOI: 10.1016/j.rx.2009.01.022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2009] [Accepted: 11/20/2009] [Indexed: 11/25/2022]
|
17
|
Cawson JN, Nickson C, Amos A, Hill G, Whan AB, Kavanagh AM. Invasive breast cancers detected by screening mammography: a detailed comparison of computer-aided detection-assisted single reading and double reading. J Med Imaging Radiat Oncol 2010; 53:442-9. [PMID: 19788479 DOI: 10.1111/j.1754-9485.2009.02100.x] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
To compare double reading plus arbitration for discordance, (currently best practice, (BP)) with computer-aided-detection (CAD)-assisted single reading (CAD-R) for detection of invasive cancers detected within BreastScreen Australia. Secondarily, to examine characteristics of cancers detected/rejected using each method. Mammograms of 157 randomly selected double-read invasive cancers were mixed 1:9 with normal cancers (total 1569), all detected in a BreastScreen service. Cancers were detected by two readers or one reader (C2 and C1 cancers, ratio 70:30%) in the program. The 1569 film-screen mammograms were read by two radiologists (reader A (RA) and reader B(RB)), with findings recorded before and after CAD. Discordant findings with BP were resolved by arbitration. We compared CAD-assisted reading (CAD-RA, CAD-RB) with BP, and CAD and arbitration contribution to findings. We correlated cancer size, sensitivity and mammographic density with detection methods. BP sensitivity 90.4% compared with CAD-RA sensitivity 86.6% (P = 0.12) and CAD-RB 94.3% (P = 0.14). CAD-RB specificity was less than BP (P = 0.01). CAD sensitivity was 93%, but readers rejected most positive CAD prompts. After CAD, reader's sensitivity increased 1.9% and specificity dropped 0.2% and 0.8%. Arbitration decreased specificity 4.7%. Receiving operator curves analysis demonstrated BP accuracy better than CAD-RA, borderline significance (P = 0.07), but not CAD-RB. Secondarily, cancer size was similar for BP and CAD-R. Cancers recalled after arbitration (P = 0.01) and CAD-R (P = 0.10) were smaller. No difference in cancer size or sensitivity between reading methods was found with increasing breast density. CAD-R and BP sensitivity and cancer detection size were not significantly different. CAD-R specificity was significantly lower for one reader.
Collapse
Affiliation(s)
- J N Cawson
- St Vincent's BreastScreen, St Vincent's Hospital, Fitzroy, Victoria, Australia.
| | | | | | | | | | | |
Collapse
|
18
|
Lladó X, Oliver A, Freixenet J, Martí R, Martí J. A textural approach for mass false positive reduction in mammography. Comput Med Imaging Graph 2009; 33:415-22. [PMID: 19406614 DOI: 10.1016/j.compmedimag.2009.03.007] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2008] [Revised: 03/25/2009] [Accepted: 03/26/2009] [Indexed: 10/20/2022]
|
19
|
GPCALMA: Implementation in Italian hospitals of a computer aided detection system for breast lesions by mammography examination. Phys Med 2009; 25:58-72. [DOI: 10.1016/j.ejmp.2008.05.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/03/2008] [Revised: 03/31/2008] [Accepted: 05/02/2008] [Indexed: 11/18/2022] Open
|
20
|
Jinshan Tang, Rangayyan R, Jun Xu, El Naqa I, Yongyi Yang. Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances. ACTA ACUST UNITED AC 2009; 13:236-51. [DOI: 10.1109/titb.2008.2009441] [Citation(s) in RCA: 375] [Impact Index Per Article: 25.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
21
|
Gilbert FJ, Astley SM, Boggis CR, McGee MA, Griffiths PM, Duffy SW, Agbaje OF, Gillan MG, Wilson M, Jain AK, Barr N, Beetles UM, Griffiths MA, Johnson J, Roberts RM, Deans HE, Duncan KA, Iyengar G. Variable size computer-aided detection prompts and mammography film reader decisions. Breast Cancer Res 2008; 10:R72. [PMID: 18724867 PMCID: PMC2575546 DOI: 10.1186/bcr2137] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2008] [Revised: 07/21/2008] [Accepted: 08/25/2008] [Indexed: 11/12/2022] Open
Abstract
Introduction The purpose of the present study was to investigate the effect of computer-aided detection (CAD) prompts on reader behaviour in a large sample of breast screening mammograms by analysing the relationship of the presence and size of prompts to the recall decision. Methods Local research ethics committee approval was obtained; informed consent was not required. Mammograms were obtained from women attending routine mammography at two breast screening centres in 1996. Films, previously double read, were re-read by a different reader using CAD. The study material included 315 cancer cases comprising all screen-detected cancer cases, all subsequent interval cancers and 861 normal cases randomly selected from 10,267 cases. Ground truth data were used to assess the efficacy of CAD prompting. Associations between prompt attributes and tumour features or reader recall decisions were assessed by chi-squared tests. Results There was a highly significant relationship between prompting and a decision to recall for cancer cases and for a random sample of normal cases (P < 0.001). Sixty-four per cent of all cases contained at least one CAD prompt. In cancer cases, larger prompts were more likely to be recalled (P = 0.02) for masses but there was no such association for calcifications (P = 0.9). In a random sample of 861 normal cases, larger prompts were more likely to be recalled (P = 0.02) for both mass and calcification prompts. Significant associations were observed with prompting and breast density (p = 0.009) for cancer cases but not for normal cases (P = 0.05). Conclusions For both normal cases and cancer cases, prompted mammograms were more likely to be recalled and the prompt size was also associated with a recall decision.
Collapse
Affiliation(s)
- Fiona J Gilbert
- Division of Applied Medicine, School of Medicine & Dentistry, University of Aberdeen, Lilian Sutton Building, Foresterhill, Aberdeen AB25 2ZD, UK.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
22
|
Scotland GS, McNamee P, Philip S, Fleming AD, Goatman KA, Prescott GJ, Fonseca S, Sharp PF, Olson JA. Cost-effectiveness of implementing automated grading within the national screening programme for diabetic retinopathy in Scotland. Br J Ophthalmol 2007; 91:1518-23. [PMID: 17585001 PMCID: PMC2095413 DOI: 10.1136/bjo.2007.120972] [Citation(s) in RCA: 62] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/18/2007] [Indexed: 11/04/2022]
Abstract
AIMS National screening programmes for diabetic retinopathy using digital photography and multi-level manual grading systems are currently being implemented in the UK. Here, we assess the cost-effectiveness of replacing first level manual grading in the National Screening Programme in Scotland with an automated system developed to assess image quality and detect the presence of any retinopathy. METHODS A decision tree model was developed and populated using sensitivity/specificity and cost data based on a study of 6722 patients in the Grampian region. Costs to the NHS, and the number of appropriate screening outcomes and true referable cases detected in 1 year were assessed. RESULTS For the diabetic population of Scotland (approximately 160,000), with prevalence of referable retinopathy at 4% (6400 true cases), the automated strategy would be expected to identify 5560 cases (86.9%) and the manual strategy 5610 cases (87.7%). However, the automated system led to savings in grading and quality assurance costs to the NHS of 201,600 pounds per year. The additional cost per additional referable case detected (manual vs automated) totalled 4088 pounds and the additional cost per additional appropriate screening outcome (manual vs automated) was 1990 pounds. CONCLUSIONS Given that automated grading is less costly and of similar effectiveness, it is likely to be considered a cost-effective alternative to manual grading.
Collapse
Affiliation(s)
- G S Scotland
- Health Economics Research Unit, University of Aberdeen, Foresterhill, Aberdeen AB25 2ZD.
| | | | | | | | | | | | | | | | | |
Collapse
|
23
|
van den Biggelaar FJHM, Nelemans PJ, Flobbe K. Performance of radiographers in mammogram interpretation: a systematic review. Breast 2007; 17:85-90. [PMID: 17764941 DOI: 10.1016/j.breast.2007.07.035] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2007] [Revised: 07/23/2007] [Accepted: 07/23/2007] [Indexed: 10/22/2022] Open
Abstract
Radiologists may be relieved from work that could be performed by radiographers. This systematic literature review focuses on the performance of radiographers (also referring to technologists and physician assistants) compared with radiologists in the interpretation of mammograms; the effect of training; and the question whether there are any studies evaluating the effects of involving radiographers in the interpretation of diagnostic mammograms in daily clinical practice on the sensitivity and specificity of cancer detection in breast imaging. Six studies met the inclusion criteria (primary aim of the study has to be the evaluation of the performance of radiographers, sensitivity and specificity have to be reported or calculable and there has to be a sufficient gold standard). The results showed that, in a screening setting, radiographers scored higher false positive rates with a similar sensitivity in the detection of malignancies, compared with radiologists. Furthermore, results suggested that training could improve their performance. No studies were reported assessing the performance of radiographers interpreting diagnostic mammograms in a consecutive patient population in a daily clinical setting. This indicates a need for a well-designed diagnostic study using an adequate gold standard, in order to evaluate the feasibility of deploying radiographers in the interpretation of diagnostic mammograms in a clinical setting.
Collapse
Affiliation(s)
- F J H M van den Biggelaar
- Department of Radiology, Maastricht University Hospital, PO Box 5800, 6202 AZ Maastricht, The Netherlands.
| | | | | |
Collapse
|
24
|
Nishikawa RM. Current status and future directions of computer-aided diagnosis in mammography. Comput Med Imaging Graph 2007; 31:224-35. [PMID: 17386998 DOI: 10.1016/j.compmedimag.2007.02.009] [Citation(s) in RCA: 128] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
The concept of computer-aided detection (CADe) was introduced more than 50 years ago; however, only in the last 20 years there have been serious and successful attempts at developing CADe for mammography. CADe schemes have high sensitivity, but poor specificity compared to radiologists. CADe has been shown to help radiologists find more cancers both in observer studies and in clinical evaluations. Clinically, CADe increases the number of cancers detected by approximately 10%, which is comparable to double reading by two radiologists.
Collapse
Affiliation(s)
- Robert M Nishikawa
- Carl J. Vyborny Translational Laboratory for Breast Imaging Research, Department of Radiology and Committee on Medical Physics, The University of Chicago, 5841 S. Maryland Avenue, MC-2026, Chicago, IL 60637-1463, USA.
| |
Collapse
|
25
|
Griebsch I, Brown J, Boggis C, Dixon A, Dixon M, Easton D, Eeles R, Evans DG, Gilbert FJ, Hawnaur J, Kessar P, Lakhani SR, Moss SM, Nerurkar A, Padhani AR, Pointon LJ, Potterton J, Thompson D, Turnbull LW, Walker LG, Warren R, Leach MO. Cost-effectiveness of screening with contrast enhanced magnetic resonance imaging vs X-ray mammography of women at a high familial risk of breast cancer. Br J Cancer 2006; 95:801-10. [PMID: 17016484 PMCID: PMC2360541 DOI: 10.1038/sj.bjc.6603356] [Citation(s) in RCA: 94] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
Abstract
Contrast enhanced magnetic resonance imaging (CE MRI) is the most sensitive tool for screening women who are at high familial risk of breast cancer. Our aim in this study was to assess the cost-effectiveness of X-ray mammography (XRM), CE MRI or both strategies combined. In total, 649 women were enrolled in the MARIBS study and screened with both CE MRI and mammography resulting in 1881 screens and 1–7 individual annual screening events. Women aged 35–49 years at high risk of breast cancer, either because they have a strong family history of breast cancer or are tested carriers of a BRCA1, BRCA2 or TP53 mutation or are at a 50% risk of having inherited such a mutation, were recruited from 22 centres and offered annual MRI and XRM for between 2 and 7 years. Information on the number and type of further investigations was collected and specifically calculated unit costs were used to calculate the incremental cost per cancer detected. The numbers of cancer detected was 13 for mammography, 27 for CE MRI and 33 for mammography and CE MRI combined. In the subgroup of BRCA1 (BRCA2) mutation carriers or of women having a first degree relative with a mutation in BRCA1 (BRCA2) corresponding numbers were 3 (6), 12 (7) and 12 (11), respectively. For all women, the incremental cost per cancer detected with CE MRI and mammography combined was £28 284 compared to mammography. When only BRCA1 or the BRCA2 groups were considered, this cost would be reduced to £11 731 (CE MRI vs mammography) and £15 302 (CE MRI and mammography vs mammography). Results were most sensitive to the unit cost estimate for a CE MRI screening test. Contrast-enhanced MRI might be a cost-effective screening modality for women at high risk, particularly for the BRCA1 and BRCA2 subgroups. Further work is needed to assess the impact of screening on mortality and health-related quality of life.
Collapse
Affiliation(s)
- I Griebsch
- MRC Health Services Research Collaboration, Department of Social Medicine, University of Bristol, Bristol, UK
| | - J Brown
- MRC Health Services Research Collaboration, Department of Social Medicine, University of Bristol, Bristol, UK
| | - C Boggis
- Nightingale Centre, Withington Hospital, Manchester, UK
| | - A Dixon
- Addenbrooke's Hospital, Cambridge, UK
| | - M Dixon
- Western General Hospital, Edinburgh, UK
| | - D Easton
- CRC Genetic Epidemiology Unit, Cambridge, UK
| | - R Eeles
- MARIBS Study Office, Section Magnetic Resonance, The Institute of Cancer Research & the Royal Marsden NHS Trust, Downs Road, Sutton, Sussey SM2 5PT, UK
| | - D G Evans
- Regional Genetics Service, Manchester, UK
| | - F J Gilbert
- Department of Radiology, University of Aberdeen, Aberdeen, UK
| | - J Hawnaur
- Department of Clinical Radiology, Manchester Royal Infirmary, Manchester, UK
| | - P Kessar
- MARIBS Study Office, Section Magnetic Resonance, The Institute of Cancer Research & the Royal Marsden NHS Trust, Downs Road, Sutton, Sussey SM2 5PT, UK
| | - S R Lakhani
- Discipline of Molecular & Cellular Pathology, School of Medicine, University of Queensland Mayne Medical School, Australia
| | - S M Moss
- MARIBS Study Office, Section Magnetic Resonance, The Institute of Cancer Research & the Royal Marsden NHS Trust, Downs Road, Sutton, Sussey SM2 5PT, UK
| | | | - A R Padhani
- The Paul Strickland Scanner Centre, Mount Vernon Hospital, Middlesex, UK
| | - L J Pointon
- MARIBS Study Office, Section Magnetic Resonance, The Institute of Cancer Research & the Royal Marsden NHS Trust, Downs Road, Sutton, Sussey SM2 5PT, UK
| | - J Potterton
- MRI Unit, Royal Victoria Infirmary, Newcastle-upon-Tyne, UK
| | - D Thompson
- CRC Genetic Epidemiology Unit, Cambridge, UK
| | - L W Turnbull
- Centre for Magnetic Resonance Investigations, Hull Royal Infirmary, Hull, UK
| | - L G Walker
- Institute of Rehabilitation, University of Hull, Hull, UK
| | - R Warren
- Addenbrooke's Hospital, Cambridge, UK
| | - M O Leach
- MARIBS Study Office, Section Magnetic Resonance, The Institute of Cancer Research & the Royal Marsden NHS Trust, Downs Road, Sutton, Sussey SM2 5PT, UK
- E-mail:
| |
Collapse
|
26
|
Kallergi M. Computer-aided detection, in its present form, is not an effective aid for screening mammography. Med Phys 2006; 33:812-4. [PMID: 16696455 DOI: 10.1118/1.2168063] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Affiliation(s)
- Maria Kallergi
- H. Lee Moffitt Cancer Center, Tampa, Florida 33612, USA.
| |
Collapse
|
27
|
Malich A, Fischer DR, Böttcher J. CAD for mammography: the technique, results, current role and further developments. Eur Radiol 2006; 16:1449-60. [PMID: 16416275 DOI: 10.1007/s00330-005-0089-x] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2005] [Revised: 10/27/2005] [Accepted: 11/18/2005] [Indexed: 01/01/2023]
Abstract
CAD systems, developed to assist the radiologist in the detection of suspicious lesions on mammograms, are currently controversially discussed. The highly sensitive detection of malignant structures including priors by CAD is linked with a low specific performance and a high rate of falsely positive markings. This causes controversial results regarding the effect of CAD systems for the diagnosing radiologist. This review aims to give an overview of the current literature, to state the currently discussed controversial results of CAD and to give an outlook on the next developments, which are not limited to senology, but include many other applications of CAD systems in radiology.
Collapse
Affiliation(s)
- Ansgar Malich
- Institute of Diagnostic Radiology, Suedharz-Krankenhaus Nordhausen, R.-Koch-Str. 39, 99374, Nordhausen, Germany.
| | | | | |
Collapse
|