SenseCam: A new tool for memory rehabilitation?

The formation of episodic autobiographical memory is predicted by mental imagery, self-reference, and anticipated details

Introduction

Despite the ecological nature of episodic memory (EM) and the importance of consolidation in its functioning, studies tackling both subjects are still scarce. Therefore, the present study aims at establishing predictions of the future of newly encoded information in EM in an ecological paradigm.

Methods

Participants recorded two personal events per day with a SenseCam portable camera, for 10 days, and characterized the events with different subjective scales (emotional valence and intensity, self-concept and self-relevance, perspective and anticipated details at a month, mental images…). They then performed a surprise free recall at 5 days and 1 month after encoding. Machine learning algorithms were used to predict the future of events (episodic or forgotten) in memory at 1 month.

Results

The best algorithm showed an accuracy of 78%, suggesting that such a prediction is reliably possible. Variables that best differentiated between episodic and forgotten memories at 1 month were mental imagery, self-reference, and prospection (anticipated details) at encoding and the first free recall.

Discussion

These results may establish the basis for the development of episodic autobiographical memory during daily experiences.

Improving autobiographical memory in schizophrenia using wearable cameras: A single-case experimental study

Autobiographical memory (AM) impairments influence both sense of identity and social functioning of patients with schizophrenia. However, cognitive remediation methods addressing these difficulties do not sufficiently consider the heterogeneity of this disorder and frequently face methodological limitations. The aim of the present study was to evaluate the efficacy of a method using a wearable camera (NarrativeClip®), through an alternating treatments design across two types of AM training. In parallel, repeated measures were used to appreciate the efficacy, specificity, and generalizability of the programme's benefits. Three patients were invited to wear the camera during 24 personal events. Ten of these events memories were trained by visual cueing (wearable camera condition), 10 others by verbal cueing (written diary condition) and 4 were not trained (control condition). Using pictures collected by the wearable camera seemed particularly relevant, since it promoted more detailed recalls than the diary method, from the first training session and until the end of a one-year follow-up. In addition, the repeated measures performed revealed (1) the efficacy (improvement in AM capacities after participating in the programme), (2) specificity (persistence of working memory deficits), and (3) generalizability (improvement in measures of episodic memory) of our cognitive remediation programme's effects.

Social-Ecological Measurement of Daily Life: How Relationally Focused Ambulatory Assessment can Advance Clinical Intervention Science

Individuals’ daily behaviors and social interactions play a central role in the diagnosis and treatment of psychological disorders. Despite this, observational ambulatory assessment methods—research methods that allow for direct and passive assessment of individuals’ momentary activities and interactions—have a remarkably scant history in the clinical science field. Prior discussions of ambulatory assessment methods in clinical science have focused on subjective methods (e.g., ecological momentary assessment) and physiological methods (e.g., wearable heart rate monitoring). Comparatively less attention has been dedicated to ambulatory assessment methods that collect objective, relational data about individuals’ social behaviors and their interactions with their momentary environmental contexts. Drawing on extant social-ecological measurement frameworks, this article first provides a conceptual and psychometric rationale for the integration of daily relational data into clinical science research. Next, the nascent research applying such methods to clinical science is reviewed, and priorities for further research organized by the NIH Stage Model for Clinical Science Research are recommended. These data can provide unique information about the social contexts of diverse patient populations; identify social-ecological targets for transdiagnostic, precision, and culturally responsive interventions; and contribute novel data about the effectiveness of established interventions at creating behavioral and relational change.

Using Wearable Cameras to Investigate Health-Related Daily Life Experiences: A Literature Review of Precautions and Risks in Empirical Studies

Automated, wearable cameras can benefit health-related research by capturing accurate and objective information about individuals' daily experiences. However, wearable cameras present unique privacy- and confidentiality-related risks due to the possibility of the images capturing identifying or sensitive information from participants and third parties. Although best practice guidelines for ethical research with wearable cameras have been published, limited information exists on the risks of studies using wearable cameras. The aim of this literature review was to survey risks related to using wearable cameras, and precautions taken to reduce those risks, as reported in empirical research. Forty-five publications, comprising 36 independent studies, were reviewed, and findings revealed that participants' primary concerns with using wearable cameras included physical inconvenience and discomfort in certain situations (e.g., public settings). None of the studies reviewed reported any serious adverse events. Although it is possible that reported findings do not include all risks experienced by participants in research with wearable cameras, our findings suggest a low level of risk to participants. However, it is important that investigators adopt recommended precautions, which can promote autonomy and reduce risks, including participant discomfort.

Lifelogging as a rehabilitation tool in patients with amnesia: A narrative literature review on the effect of lifelogging on memory loss

Visual lifelogging is the procedure that enables individuals to visually record daily life activities by means of small wearable cameras, which can be worn around the neck or on the clothing. Lifelogging devices automatically take pictures or videos after pre-set time intervals or after dynamic input changes. Although some studies have shown effectivity of reviewing lifelogging images in brain-damaged individuals with forms of amnesia as a rehabilitation tool, systematic endeavours to overview this literature is yet missing. The aim of this narrative literature review was to review all the available case-studies, experimental studies and group studies in brain-damaged individuals applying lifelogging devices in a clinical context. The included studies showed efficacy for both subjective and objective measures of memory. In mild to severe amnesia, reviewing images recorded by the lifelogging device was beneficial to subjective and objective measures of memory. Lifelogging is demonstrated to have a great potential in helping people who are suffering from memory loss. It can offer an excellent alternative to currently more frequently used memory rehabilitation techniques and can be applied more in clinical settings.

Memory for spatio-temporal contextual details during the retrieval of naturalistic episodes

Episodic memory entails the storage of events together with their spatio-temporal context and retrieval comprises the subjective experience of a link between the person who remembers and the episode itself. We used an encoding procedure with mobile-phones to generate experimentally-controlled episodes in the real world: object-images were sent to the participants' phone, with encoding durations up to 3 weeks. In other groups of participants, the same objects were encoded during the exploration of a virtual town (45 min) or using a standard laboratory paradigm, with pairs of object/place-images presented in a sequence of unrelated trials (15 min). At retrieval, we tested subjective memory for the objects (remember/familiar) and memory for the context (place and time). We found that accurate and confident context-memory increased the likelihood of "remember" responses, in all encoding contexts. We also tested the participants' ability to judge the temporal-order of the encoded episodes. Using a model of temporal similarity, we demonstrate scale-invariant properties of order-retrieval, but also highlight the contribution of non-chronological factors. We conclude that the mechanisms governing episodic memory retrieval can operate across a wide range of spatio-temporal contexts and that the multi-dimensional nature of the episodic traces contributes to the subjective experience of retrieval.

Using a wearable camera to support everyday memory following brain injury: a single-case study

Background:

Wearable cameras have been shown to improve memory in people with hippocampal amnesia and Alzheimer's disease. It is not known whether this benefit extends to people with amnesia of complex or uncertain origin.

Method:

This case study examined the effect of wearable camera use on memory and occupational performance in a patient with memory loss and complex mental health problems following a severe neurological incident. With the help of his occupational therapist (OT), Mr A used a wearable camera to record a series of eight personally significant events over a 6-week period. During visits from his OT, Mr A was asked to report what he could remember about the events, both before (baseline) and during the review of time-lapsed photographs captured automatically by the camera.

Results:

The results showed striking improvements in recall while reviewing the photographs, relative to baseline recall, but the additional details recalled during review did not appear to be maintained at later tests, after several days. Across the study period, there were moderate increases in occupational performance, measured using the Canadian Occupational Performance Measure. However, after the study period ended, Mr A ceased to use the wearable camera due to technological difficulty.

Conclusion:

There was a clear benefit of wearable camera use, but the real-world impact of the technology was limited by the complexity of the system. The results of the study are discussed alongside novel clinical insights and suggestions for developing wearable camera support systems that can be used independently by people with memory problems.

A Review of Accelerated Long-Term Forgetting in Epilepsy

Accelerated long-term forgetting (ALF) is a memory disorder that manifests by a distinct pattern of normal memory for up to an hour after learning, but an increased rate of forgetting during the subsequent hours and days. The topic of ALF has gained much attention in group studies with epilepsy patients and the phenomenon has been shown to have contradictory associations with seizures, epileptiform activity, imaging data, sleep, and antiepileptic medication. The aim of this review was to explore how clinical and imaging data could help determine the topographic and physiological substrate of ALF, and what is the possible use of this information in the clinical setting. We have reviewed 51 group studies in English to provide a synthesis of the existing findings concerning ALF in epilepsy. Analysis of recently reported data among patients with temporal lobe epilepsy, transient epileptic amnesia, and generalized and extratemporal epilepsies provided further indication that ALF is likely a disorder of late memory consolidation. The spatial substrate of ALF might be located along the parts of the hippocampal-neocortical network and novel studies reveal the increasingly possible importance of damage in extrahippocampal sites. Further research is needed to explore the mechanisms of cellular impairment in ALF and to develop effective methods of care for patients with the disorder.

Selective Content Removal for Egocentric Wearable Camera in Nutritional Studies

Automatic Ingestion Monitor v2 (AIM-2) is an egocentric camera and sensor that aids monitoring of individual diet and eating behavior by capturing still images throughout the day and using sensor data to detect eating. The images may be used to recognize foods being eaten, eating environment, and other behaviors and daily activities. At the same time, captured images may carry privacy concerning content such as (1) people in social eating and/or bystanders (i.e., bystander privacy); (2) sensitive documents that may appear on a computer screen in the view of AIM-2 (i.e., context privacy). In this paper, we propose a novel approach based on automatic, image redaction for privacy protection by selective content removal by semantic segmentation using a deep learning neural network. The proposed method reported a bystander privacy removal with precision of 0.87 and recall of 0.94 and reported context privacy removal by precision and recall of 0.97 and 0.98. The results of the study showed that selective content removal using deep learning neural network is a much more desirable approach to address privacy concerns for an egocentric wearable camera for nutritional studies.

The Effects of Exposure to Recent Autobiographical Events on Declarative Memory in Amnestic Mild Cognitive Impairment: A Preliminary Pilot Study

BACKGROUND

Individuals with amnestic Mild Cognitive Impairment (aMCI) are at heightened risk of developing Alzheimer's dementia. In recent years, much attention has been given to the search for new interventions to slow down the progression of cognitive decline of these patients. Wearable digital camera devices are one form of new technology that captures images of one's life events, so they constitute a promising method to be used as a means to stimulate recent autobiographical memory.

OBJECTIVE

This preliminary study investigates the ability of a new cognitive intervention based on exposure to recent autobiographical memory captured by wearable cameras to improve episodic memory in patients with aMCI.

METHODS

Seventeen subjects wore a wearable camera while they went about their daily activities. The images captured were converted into eight different 3-minute films containing the most relevant information of each event. The intervention involved eight individualized weekly sessions during which patients were exposed to a different autobiographical event each week. Besides, several specific questions were formulated within each session. Clinical questionnaires assessing cognitive reserve, premorbid intelligence, depression, and anxiety were administered at baseline. Measures of objective episodic memory were applied at baseline and at post-treatment.

RESULTS

Significant improvements were observed at post-treatment in memory measures, and significant associations were found between memory change scores and age and cognitive reserve. Anyway, these associations did not reach statistical significance after adjusting for multiple comparisons.

CONCLUSION

The present study provides preliminary evidence that aMCI patients may benefit from a cognitive intervention program based on re-experiencing recent autobiographical events. However, future studies incorporating a control group will be needed to confirm these preliminary findings.

The dynamics of memory retrieval for internal mentation

Daily life situations often require people to remember internal mentation, such as their future plans or interpretations of events. Little is known, however, about the principles that govern memory for thoughts experienced during real-world events. In particular, it remains unknown whether factors that structure the retrieval of external stimuli also apply to thought recall, and whether some thought features affect their accessibility in memory. To examine these questions, we asked participants to undertake a walk on a university campus while wearing a lifelogging camera. They then received unexpected recall tasks about the thoughts they experienced during the walk, rated the phenomenological features of retrieved thoughts, and indicated the moment when they were experienced. Results showed that thought retrieval demonstrates primacy, recency, and temporal contiguity effects, and is also influenced by event boundaries. In addition, thoughts that involved planning and that were recurrent during the walk were more accessible in memory. Together, these results shed new light on the principles that govern memory for internal mentation and suggest that at least partially similar processes structure the retrieval of thoughts and stimuli from the external environment.