1
|
Mundt M, Hong Y, Pliushch I, Ramesh V. A wholistic view of continual learning with deep neural networks: Forgotten lessons and the bridge to active and open world learning. Neural Netw 2023; 160:306-336. [PMID: 36724547 DOI: 10.1016/j.neunet.2023.01.014] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 10/31/2022] [Accepted: 01/16/2023] [Indexed: 01/21/2023]
Abstract
Current deep learning methods are regarded as favorable if they empirically perform well on dedicated test sets. This mentality is seamlessly reflected in the resurfacing area of continual learning, where consecutively arriving data is investigated. The core challenge is framed as protecting previously acquired representations from being catastrophically forgotten. However, comparison of individual methods is nevertheless performed in isolation from the real world by monitoring accumulated benchmark test set performance. The closed world assumption remains predominant, i.e. models are evaluated on data that is guaranteed to originate from the same distribution as used for training. This poses a massive challenge as neural networks are well known to provide overconfident false predictions on unknown and corrupted instances. In this work we critically survey the literature and argue that notable lessons from open set recognition, identifying unknown examples outside of the observed set, and the adjacent field of active learning, querying data to maximize the expected performance gain, are frequently overlooked in the deep learning era. Hence, we propose a consolidated view to bridge continual learning, active learning and open set recognition in deep neural networks. Finally, the established synergies are supported empirically, showing joint improvement in alleviating catastrophic forgetting, querying data, selecting task orders, while exhibiting robust open world application.
Collapse
Affiliation(s)
- Martin Mundt
- Department of Computer Science, Goethe University, Theodor-W.-Adorno-Platz 1, 60323 Frankfurt, Germany; Department of Computer Science, TU Darmstadt, Karolinenplatz 5, 64289 Darmstadt, Germany.
| | - Yongwon Hong
- Department of Computer Science, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, 03722 Seoul, Republic of Korea.
| | - Iuliia Pliushch
- Department of Computer Science, Goethe University, Theodor-W.-Adorno-Platz 1, 60323 Frankfurt, Germany.
| | - Visvanathan Ramesh
- Department of Computer Science, Goethe University, Theodor-W.-Adorno-Platz 1, 60323 Frankfurt, Germany.
| |
Collapse
|
2
|
Geng C, Huang SJ, Chen S. Recent Advances in Open Set Recognition: A Survey. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2021; 43:3614-3631. [PMID: 32191881 DOI: 10.1109/tpami.2020.2981604] [Citation(s) in RCA: 78] [Impact Index Per Article: 26.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
In real-world recognition/classification tasks, limited by various objective factors, it is usually difficult to collect training samples to exhaust all classes when training a recognizer or classifier. A more realistic scenario is open set recognition (OSR), where incomplete knowledge of the world exists at training time, and unknown classes can be submitted to an algorithm during testing, requiring the classifiers to not only accurately classify the seen classes, but also effectively deal with unseen ones. This paper provides a comprehensive survey of existing open set recognition techniques covering various aspects ranging from related definitions, representations of models, datasets, evaluation criteria, and algorithm comparisons. Furthermore, we briefly analyze the relationships between OSR and its related tasks including zero-shot, one-shot (few-shot) recognition/learning techniques, classification with reject option, and so forth. Additionally, we also review the open world recognition which can be seen as a natural extension of OSR. Importantly, we highlight the limitations of existing approaches and point out some promising subsequent research directions in this field.
Collapse
|
3
|
Gray C, Goodman P, Cullen P, Badger SA, O'Malley K, O'Donohoe MK, McDonnell CO. Screening for Peripheral Arterial Disease and Carotid Artery Disease in Patients With Abdominal Aortic Aneurysm. Angiology 2015; 67:346-9. [DOI: 10.1177/0003319715590299] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Screening for concomitant atherosclerotic disease is important in cardiovascular risk reduction. This study assessed the prevalence of carotid artery disease (CAD) and peripheral arterial disease (PAD) in patients with known abdominal aortic aneurysms (AAAs). All patients with AAA attending the vascular laboratory between the January 1, 2007, and December 31, 2009, were eligible for a carotid ultrasound and measurement of ankle brachial indices. A total of 389 (305 males) patients were identified on the AAA surveillance program with a mean (±standard deviation) age of 76 (±8) years. The mean age of the males was 75.4 (±7.8) years, and the mean age of the females was 77 (±11) years. A total of 332 patients were assessed for CAD, and 101 (30.4%) of those were found to have significant disease. A total of 289 patients were assessed for PAD of which 131 (45.3%) were found to have PAD at rest, and 289 patients were assessed for both and 59 (20.4%) patients had significant CAD + PAD. Patients with AAAs are at high risk of other atherosclerotic disorders, and, therefore, they should receive intensive medical optimization.
Collapse
Affiliation(s)
- Cleona Gray
- Department of Vascular Surgery, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Patrick Goodman
- School of Physics, Dublin Institute of Technology, Dublin, Ireland
| | - Paul Cullen
- Department of Vascular Surgery, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Stephen A. Badger
- Department of Vascular Surgery, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Kevin O'Malley
- Department of Vascular Surgery, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Martin K. O'Donohoe
- Department of Vascular Surgery, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Ciaran O. McDonnell
- Department of Vascular Surgery, Mater Misericordiae University Hospital, Dublin, Ireland
| |
Collapse
|
4
|
Avgerinos ED, Go C, Ling J, Makaroun MS, Chaer RA. Survival and Long-Term Cardiovascular Outcomes after Carotid Endarterectomy in Patients with Chronic Renal Insufficiency. Ann Vasc Surg 2015; 29:15-21. [DOI: 10.1016/j.avsg.2014.07.029] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2014] [Revised: 07/10/2014] [Accepted: 07/27/2014] [Indexed: 11/15/2022]
|
5
|
Bryant CE, Pugh ND, Coleman DP, Morris RJ, Williams PT, Humphries KN. Comparison of Doppler ultrasound velocity parameters in the determination of internal carotid artery stenosis. ULTRASOUND 2013. [DOI: 10.1177/1742271x13496680] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This study aims to compare the evidence base and practical results of the Joint Recommendations for Reporting Carotid Ultrasound Investigations in UK, published in 2009, and existing carotid scan protocols based on the Society of Radiologists in Ultrasound 2003 Consensus. A prospective sequential evaluation of the 2009 recommendations was performed at the University Hospital of Wales, Cardiff. Additional measurements in line with the recommendations were made during carotid scans. The grading of internal carotid artery stenosis using the 2003 and 2009 UK recommendations, and recommended measures of PSV, PSV ratio and St Mary’s ratio were compared. In comparison to PSV classification, PSV ratio produced lower stenosis classification in 29% and 24% of cases in the 50–69% and 70–89% stenosis bands respectively. St Mary’s ratio produced poor classification agreement across all bands, particularly the 50%–69% stenosis band. Agreement of two measures is recommended for diagnostic confidence; however, in the 50%–69% and 70%–89% stenosis bands, agreement of two measures only occurred in 70% of scans. This evaluation suggests that the use of three measurements in the 2009 recommendations complicates rather than aids diagnosis, especially in the 50%–69% and 70%–89% stenosis bands, and does not provide significant improvement over the 2003 guidelines. No evidence was found to support the combined use of the three measures.
Collapse
Affiliation(s)
- CE Bryant
- Department of Medical Physics and Clinical Engineering, University Hospital of Wales, Cardiff, UK
| | - ND Pugh
- Department of Medical Physics and Clinical Engineering, University Hospital of Wales, Cardiff, UK
| | - DP Coleman
- Department of Medical Physics and Clinical Engineering, University Hospital of Wales, Cardiff, UK
| | - RJ Morris
- Department of Medical Physics and Clinical Engineering, University Hospital of Wales, Cardiff, UK
| | - PT Williams
- Department of Medical Physics and Clinical Engineering, University Hospital of Wales, Cardiff, UK
| | - KN Humphries
- School of Engineering, Cardiff University, Cardiff, UK
| |
Collapse
|
6
|
Ritter JC, Tyrrell MR. The current management of carotid atherosclerotic disease: who, when and how? Interact Cardiovasc Thorac Surg 2013; 16:339-46. [PMID: 23197661 PMCID: PMC3568792 DOI: 10.1093/icvts/ivs453] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2012] [Revised: 08/30/2012] [Accepted: 09/07/2012] [Indexed: 11/14/2022] Open
Abstract
Ischaemic stroke represents a major health hazard in the western world, which has a severe impact on society and the health-care system. Roughly, 10% of all first ischaemic strokes can be attributed to significant atherosclerotic disease of the carotid arteries. Correct management of these lesions is essential in the prevention and treatment of carotid disease-related ischaemic events. The close relationship between diagnosis and medical and surgical management makes it necessary that all involved physicians and surgeons have profound knowledge of management strategies beyond their specific speciality. Continuous improvement in pharmacological therapy and operative techniques as well as frequently changing guidelines represent a constant challenge for the individual health-care professional. This review gives a thorough outline of the up-to-date evidence-based management of carotid artery disease and discusses its current controversies.
Collapse
Affiliation(s)
- Jens C Ritter
- Department of Vascular Surgery, King's Health Partners, Kings College Hospital, London, UK.
| | | |
Collapse
|
7
|
Avgerinos ED, Kadoglou NPE, Moulakakis KG, Giannakopoulos TG, Liapis CD. Current role of biomarkers in carotid disease: a systematic review. Int J Stroke 2011; 6:337-45. [PMID: 21745345 DOI: 10.1111/j.1747-4949.2011.00623.x] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
BACKGROUND AND PURPOSE Accumulating evidence suggests that carotid plaque vulnerability can be used as a determinant of ischemic stroke risk stratification and carotid intervention. Novel markers of high-risk carotid plaque in patients are needed. SUMMARY OF REVIEW Advances in cellular and molecular pathophysiology, the demand for accurately predicting carotid risk, and choosing the optimal prevention strategy are stimulating great interest in the development of novel surrogate markers. Biomarkers in cardiovascular disease are expected to predict the natural history, clinical outcomes, and the efficacy of disease-modifying interventions. We aimed to review the literature regarding clinical data on novel serum biomarkers related to ischemic cerebrovascular events associated with carotid artery disease. We provide background information on the biomarkers related to all aspects of carotid disease: natural history, carotid intervention strategies for symptomatic and asymptomatic patients, perioperative risk prediction, and their therapeutic implications. CONCLUSION At present, heterogeneous data support evidence that biological markers can help existing practices to more accurately assess patients at risk for stroke. Randomized-controlled trials for carotid artery disease and carotid intervention, incorporating biomarkers, are needed.
Collapse
Affiliation(s)
- Efthimios D Avgerinos
- Department of Vascular Surgery, Attikon University Hospital, Medical School, Athens, Greece
| | | | | | | | | |
Collapse
|
8
|
Ashrafian H, Darzi A, Athanasiou T. Bariatric surgery - can we afford to do it or deny doing it? Frontline Gastroenterol 2011; 2:82-89. [PMID: 23814666 PMCID: PMC3695555 DOI: 10.1136/fg.2010.002618] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/24/2011] [Indexed: 02/04/2023] Open
|
9
|
Harris JP. Carotid intervention: and so it goes, guidelines and timing. ANZ J Surg 2010; 80:386-7. [PMID: 20618186 DOI: 10.1111/j.1445-2197.2010.05303.x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- John P Harris
- Division of Surgery, Royal Prince Alfred Hospital, University of Sydney, New South Wales 2006, Australia
| |
Collapse
|