Avoiding Catastrophic Forgetting

Development and Validation of Adaptable Skin Cancer Classification System Using Dynamically Expandable Representation

OBJECTIVES

Skin cancer is a prevalent type of malignancy, necessitating efficient diagnostic tools. This study aimed to develop an automated skin lesion classification model using the dynamically expandable representation (DER) incremental learning algorithm. This algorithm adapts to new data and expands its classification capabilities, with the goal of creating a scalable and efficient system for diagnosing skin cancer.

METHODS

The DER model with incremental learning was applied to the HAM10000 and ISIC 2019 datasets. Validation involved two steps: initially, training and evaluating the HAM10000 dataset against a fixed ResNet-50; subsequently, performing external validation of the trained model using the ISIC 2019 dataset. The model's performance was assessed using precision, recall, the F1-score, and area under the precision-recall curve.

RESULTS

The developed skin lesion classification model demonstrated high accuracy and reliability across various types of skin lesions, achieving a weighted-average precision, recall, and F1-score of 0.918, 0.808, and 0.847, respectively. The model's discrimination performance was reflected in an average area under the curve (AUC) value of 0.943. Further external validation with the ISIC 2019 dataset confirmed the model's effectiveness, as shown by an AUC of 0.911.

CONCLUSIONS

This study presents an optimized skin lesion classification model based on the DER algorithm, which shows high performance in disease classification with the potential to expand its classification range. The model demonstrated robust results in external validation, indicating its adaptability to new disease classes.

Sleep prevents catastrophic forgetting in spiking neural networks by forming a joint synaptic weight representation

Artificial neural networks overwrite previously learned tasks when trained sequentially, a phenomenon known as catastrophic forgetting. In contrast, the brain learns continuously, and typically learns best when new training is interleaved with periods of sleep for memory consolidation. Here we used spiking network to study mechanisms behind catastrophic forgetting and the role of sleep in preventing it. The network could be trained to learn a complex foraging task but exhibited catastrophic forgetting when trained sequentially on different tasks. In synaptic weight space, new task training moved the synaptic weight configuration away from the manifold representing old task leading to forgetting. Interleaving new task training with periods of off-line reactivation, mimicking biological sleep, mitigated catastrophic forgetting by constraining the network synaptic weight state to the previously learned manifold, while allowing the weight configuration to converge towards the intersection of the manifolds representing old and new tasks. The study reveals a possible strategy of synaptic weights dynamics the brain applies during sleep to prevent forgetting and optimize learning.

Continuous learning of spiking networks trained with local rules

Artificial neural networks (ANNs) experience catastrophic forgetting (CF) during sequential learning. In contrast, the brain can learn continuously without any signs of catastrophic forgetting. Spiking neural networks (SNNs) are the next generation of ANNs with many features borrowed from biological neural networks. Thus, SNNs potentially promise better resilience to CF. In this paper, we study the susceptibility of SNNs to CF and test several biologically inspired methods for mitigating catastrophic forgetting. SNNs are trained with biologically plausible local training rules based on spike-timing-dependent plasticity (STDP). Local training prohibits the direct use of CF prevention methods based on gradients of a global loss function. We developed and tested the method to determine the importance of synapses (weights) based on stochastic Langevin dynamics without the need for the gradients. Several other methods of catastrophic forgetting prevention adapted from analog neural networks were tested as well. The experiments were performed on freely available datasets in the SpykeTorch environment.

Can sleep protect memories from catastrophic forgetting?

Continual learning remains an unsolved problem in artificial neural networks. The brain has evolved mechanisms to prevent catastrophic forgetting of old knowledge during new training. Building upon data suggesting the importance of sleep in learning and memory, we tested a hypothesis that sleep protects old memories from being forgotten after new learning. In the thalamocortical model, training a new memory interfered with previously learned old memories leading to degradation and forgetting of the old memory traces. Simulating sleep after new learning reversed the damage and enhanced old and new memories. We found that when a new memory competed for previously allocated neuronal/synaptic resources, sleep replay changed the synaptic footprint of the old memory to allow overlapping neuronal populations to store multiple memories. Our study predicts that memory storage is dynamic, and sleep enables continual learning by combining consolidation of new memory traces with reconsolidation of old memory traces to minimize interference.

The hippocampal sharp wave-ripple in memory retrieval for immediate use and consolidation

Various cognitive functions have long been known to require the hippocampus. Recently, progress has been made in identifying the hippocampal neural activity patterns that implement these functions. One such pattern is the sharp wave-ripple (SWR), an event associated with highly synchronous neural firing in the hippocampus and modulation of neural activity in distributed brain regions. Hippocampal spiking during SWRs can represent past or potential future experience, and SWR-related interventions can alter subsequent memory performance. These findings and others suggest that SWRs support both memory consolidation and memory retrieval for processes such as decision-making. In addition, studies have identified distinct types of SWR based on representational content, behavioural state and physiological features. These various findings regarding SWRs suggest that different SWR types correspond to different cognitive functions, such as retrieval and consolidation. Here, we introduce another possibility - that a single SWR may support more than one cognitive function. Taking into account classic psychological theories and recent molecular results that suggest that retrieval and consolidation share mechanisms, we propose that the SWR mediates the retrieval of stored representations that can be utilized immediately by downstream circuits in decision-making, planning, recollection and/or imagination while simultaneously initiating memory consolidation processes.

Tracing the path of forgetting in rule abstraction and exemplar retrieval

People often forget acquired knowledge over time such as names of former classmates. Which knowledge people can access, however, may modify the judgement process and affect judgement accuracy. Specifically, we hypothesised that judgements based on retrieving past exemplars from long-term memory may be more vulnerable to forgetting than remembering rules that relate the cues to the criterion. Experiment 1 systematically tracked the individual course of forgetting from initial learning to later tests (immediate, 1 day, and 1 week) in a linear judgement task facilitating rule-based strategies and a multiplicative judgement task facilitating exemplar-based strategies. Practising the acquired judgement strategy in repeated tests helped participants to consistently apply the learnt judgement strategy and retain a high judgement accuracy even after a week. Yet, whereas a long retention interval did not affect judgements in the linear task, a long retention interval impaired judgements in the multiplicative task. If practice was restricted as in Experiment 2, judgement accuracy suffered in both tasks. In addition, after a week without practice, participants tried to reconstruct their judgements by applying rules in the multiplicative task. These results emphasise that the extent to which decision makers can still retrieve previously learned knowledge limits their ability to make accurate judgements and that the preferred strategies change over time if the opportunity for practice is limited.

Computational models of memory consolidation and long-term synaptic plasticity during sleep

The brain stores memories by persistently changing the connectivity between neurons. Sleep is known to be critical for these changes to endure. Research on the neurobiology of sleep and the mechanisms of long-term synaptic plasticity has provided data in support of various theories of how brain activity during sleep affects long-term synaptic plasticity. The experimental findings - and therefore the theories - are apparently quite contradictory, with some evidence pointing to a role of sleep in the forgetting of irrelevant memories, whereas other results indicate that sleep supports the reinforcement of the most valuable recollections. A unified theoretical framework is in need. Computational modeling and simulation provide grounds for the quantitative testing and comparison of theoretical predictions and observed data, and might serve as a strategy to organize the rather complicated and diverse pool of data and methodologies used in sleep research. This review article outlines the emerging progress in the computational modeling and simulation of the main theories on the role of sleep in memory consolidation.