Melanoma in the Blink of an Eye: Pathologists' Rapid Detection, Classification, and Localization of Skin Abnormalities

Eye tracking in digital pathology: A comprehensive literature review

Eye tracking has been used for decades in attempt to understand the cognitive processes of individuals. From memory access to problem-solving to decision-making, such insight has the potential to improve workflows and the education of students to become experts in relevant fields. Until recently, the traditional use of microscopes in pathology made eye tracking exceptionally difficult. However, the digital revolution of pathology from conventional microscopes to digital whole slide images allows for new research to be conducted and information to be learned with regards to pathologist visual search patterns and learning experiences. This has the promise to make pathology education more efficient and engaging, ultimately creating stronger and more proficient generations of pathologists to come. The goal of this review on eye tracking in pathology is to characterize and compare the visual search patterns of pathologists. The PubMed and Web of Science databases were searched using 'pathology' AND 'eye tracking' synonyms. A total of 22 relevant full-text articles published up to and including 2023 were identified and included in this review. Thematic analysis was conducted to organize each study into one or more of the 10 themes identified to characterize the visual search patterns of pathologists: (1) effect of experience, (2) fixations, (3) zooming, (4) panning, (5) saccades, (6) pupil diameter, (7) interpretation time, (8) strategies, (9) machine learning, and (10) education. Expert pathologists were found to have higher diagnostic accuracy, fewer fixations, and shorter interpretation times than pathologists with less experience. Further, literature on eye tracking in pathology indicates that there are several visual strategies for diagnostic interpretation of digital pathology images, but no evidence of a superior strategy exists. The educational implications of eye tracking in pathology have also been explored but the effect of teaching novices how to search as an expert remains unclear. In this article, the main challenges and prospects of eye tracking in pathology are briefly discussed along with their implications to the field.

Impact of the adjunction of a short video to an original article for the recognition of newly described tumor entities in pathology: An interventional prospective study

CONTEXT

Merkel cell carcinoma diagnosis is often based on microscopic examination by pathologists. While histopathologic diagnosis primarily hinges on conscious and analytical cognition, the pathologist's decision-making process is also influenced by a rapid "gist" or "gestalt" approach. In this study, using cases of Merkel cell carcinoma as a model, we aim to assess how pathologists' viewing short videos containing conceptual clues and visual aids, in conjunction with reading an original article as a reference, may enhance their diagnostic performance.

METHOD

Sixteen pathologists were included in the present work. After participants had read the original article, their ability to distinguish Merkel cell polyomavirus (MCPyV)+ and MCPyV- Merkel cell carcinoma cases was evaluated on a first preliminary series of 20 cases. Following this test, the participants watched the video and then evaluated a second "experimental" series of 20 independent cases.

RESULTS

After reading the original article, for each case, a median number of 12 participants (75%, Q1-Q3: 10-13) classified the specimen in the correct category (92 incorrect answers in the whole series). An important interobserver variability was observed in this setting (Kappa coefficient = 0.465). By contrast, following the video, all cases were correctly classified by most of the participants, with only 12 incorrect answers on the whole series and excellent interobserver reproducibility (Kappa coefficient = 0.846).

CONCLUSION

Our study demonstrated that providing a short video together with an original article may enhance pathologists' performance in diagnosing Merkel cell carcinoma.

Gaze cueing improves pattern recognition of histology learners

Experts perceive and evaluate domain-specific visual information with high accuracy. In doing so, they exhibit eye movements referred to as "expert gaze" to rapidly focus on task-relevant areas. Using eye tracking, it is possible to record these implicit gaze patterns and present them to histology novice learners during training. This article presents a comprehensive evaluation of such expert gaze cueing on pattern recognition of medical students in histology. For this purpose, 53 students were randomized into two groups over eight histology sessions. The control group was presented with an instructional histology video featuring voice commentary. The gaze cueing group was presented the same video, but with an additional overlay of a live recording of the expert's eye movements. Afterward, students' pattern recognition was assessed through 20 image-based tasks (5 retention, 15 transfer) and their cognitive load with the Paas scale. Results showed that gaze cueing significantly outperformed the control group (p = 0.007; d = 0.40). This effect was evident for both, retention (p = 0.003) and transfer tasks (p = 0.046), and generalized across different histological contexts. The cognitive load was similar in both groups. In conclusion, gaze cueing helps histology novice learners to develop their pattern recognition skills, offering a promising method for histology education. Histology educators could benefit from this instructional strategy to provide new forms of attentional guidance to learners in visually complex learning environments.

Multiple expressions of "expert" abnormality gist in novices following perceptual learning

With a brief half-second presentation, a medical expert can determine at above chance levels whether a medical scan she sees is abnormal based on a first impression arising from an initial global image process, termed "gist." The nature of gist processing is debated but this debate stems from results in medical experts who have years of perceptual experience. The aim of the present study was to determine if gist processing for medical images occurs in naïve (non-medically trained) participants who received a brief perceptual training and to tease apart the nature of that gist signal. We trained 20 naïve participants on a brief perceptual-adaptive training of histology images. After training, naïve observers were able to obtain abnormality detection and abnormality categorization above chance, from a brief 500 ms masked presentation of a histology image, hence showing "gist." The global signal demonstrated in perceptually trained naïve participants demonstrated multiple dissociable components, with some of these components relating to how rapidly naïve participants learned a normal template during perceptual learning. We suggest that multiple gist signals are present when experts view medical images derived from the tens of thousands of images that they are exposed to throughout their training and careers. We also suggest that a directed learning of a normal template may produce better abnormality detection and identification in radiologists and pathologists.

The Oddity Detection in Diverse Scenes (ODDS) database: Validated real-world scenes for studying anomaly detection

Many applied screening tasks (e.g., medical image or baggage screening) involve challenging searches for which standard laboratory search is rarely equivalent. For example, whereas laboratory search frequently requires observers to look for precisely defined targets among isolated, non-overlapping images randomly arrayed on clean backgrounds, medical images present unspecified targets in noisy, yet spatially regular scenes. Those unspecified targets are typically oddities, elements that do not belong. To develop a closer laboratory analogue to this, we created a database of scenes containing subtle, ill-specified "oddity" targets. These scenes have similar perceptual densities and spatial regularities to those found in expert search tasks, and each includes 16 variants of the unedited scene wherein an oddity (a subtle deformation of the scene) is hidden. In Experiment 1, eight volunteers searched thousands of scene variants for an oddity. Regardless of their search accuracy, they were then shown the highlighted anomaly and rated its subtlety. Subtlety ratings reliably predicted search performance (accuracy and response times) and did so better than image statistics. In Experiment 2, we conducted a conceptual replication in which a larger group of naïve searchers scanned subsets of the scene variants. Prior subtlety ratings reliably predicted search outcomes. Whereas medical image targets are difficult for naïve searchers to detect, our database contains thousands of interior and exterior scenes that vary in difficulty, but are nevertheless searchable by novices. In this way, the stimuli will be useful for studying visual search as it typically occurs in expert domains: Ill-specified search for anomalies in noisy displays.