The need for improved dermoscopy training in residency: a survey of US dermatology residents and program directors

Implementation of a dermatoscopy curriculum during residency at Augsburg University Hospital in Germany

BACKGROUND AND OBJECTIVES

To date, there is no structured program for dermatoscopy training during residency in Germany. Whether and how much dermatoscopy training is acquired is left to the initiative of each resident, although dermatoscopy is one of the core competencies of dermatological training and daily practice. The aim of the study was to establish a structured dermatoscopy curriculum during residency at the University Hospital Augsburg.

PATIENTS AND METHODS

An online platform with dermatoscopy modules was created, accessible regardless of time and place. Practical skills were acquired under the personal guidance of a dermatoscopy expert. Participants were tested on their level of knowledge before and after completing the modules. Test scores on management decisions and correct dermatoscopic diagnosis were analyzed.

RESULTS

Results of 28 participants showed improvements in management decisions from pre- to posttest (74.0% vs. 89.4%) and in dermatoscopic accuracy (65.0% vs. 85.6%). Pre- vs. posttest differences in test score (7.05/10 vs. 8.94/10 points) and correct diagnosis were significant (p < 0.001).

CONCLUSIONS

The dermatoscopy curriculum increases the number of correct management decisions and dermatoscopy diagnoses. This will result in more skin cancers being detected, and fewer benign lesions being excised. The curriculum can be offered to other dermatology training centers and medical professionals.

Implementierung eines Dermatoskopie-Curriculums in der Facharztausbildung am Universitätsklinikum Augsburg

Hintergrund und Ziele

Bislang gibt es in Deutschland kein strukturiertes Programm für die Dermatoskopieausbildung während der Facharztausbildung. Es bleibt der Initiative des einzelnen Assistenzarztes überlassen, ob und in welchem Umfang er sich in der Dermatoskopie weiterbildet, obwohl die Dermatoskopie zu den Kernkompetenzen der dermatologischen Ausbildung und der täglichen Praxis gehört. Ziel der Studie war die Etablierung eines strukturierten Dermatoskopie‐Curriculums während der dermatologischen Facharztausbildung am Universitätsklinikum Augsburg.

Patienten und Methodik

Es wurde eine Online‐Plattform mit Dermatoskopie‐Modulen geschaffen, auf die von überall und jederzeit zugegriffen werden kann. Praktische Fertigkeiten wurden unter individueller Anleitung eines Dermatoskopie‐Experten erworben. Die Teilnehmer wurden vor und nach Abschluss der Module auf ihren Wissensstand getestet. Die Testergebnisse zum therapeutischen Management und zur korrekten dermatoskopischen Diagnose wurden analysiert.

Ergebnisse

Die Ergebnisse der 28 Teilnehmer verbesserten sich vom Eingangs‐ zum Abschlusstest bei der Managemententscheidung (74,0% vs. 89,4%) und bei der dermatoskopischen Genauigkeit (65,0% vs. 85,6%). Die Unterschiede zwischen Eingangs‐ und Abschlusstest bei der Gesamtpunktzahl (7,05/10 vs. 8,94/10 Punkte) und bei der richtigen Diagnose waren signifikant (p < 0,001).

Schlussfolgerungen

Das Dermatoskopie‐Curriculum verbessert die Managemententscheidungen und die dermatoskopische Diagnostik der Teilnehmer. Das wird dazu führen, dass mehr Hautkrebsfälle erkannt werden und weniger gutartige Läsionen reseziert werden müssen. Das Curriculum kann anderen dermatologischen Ausbildungszentren und Gesundheitsberufen angeboten werden.

Dermoscopy Training in Family Medicine Residencies: A CERA Survey of Program Directors

BACKGROUND AND OBJECTIVES

Diagnosing skin disorders is a core skill in family medicine residency. Accurate diagnosis of skin cancers has a significant impact on patient health. Dermoscopy improves a physician's accuracy in diagnosing skin cancers. We aimed to quantify the current state of dermoscopy use and training in family medicine residencies.

METHODS

We included questions on dermoscopy training in the 2021 Council of Academic Family Medicine Educational Research Alliance (CERA) survey of family medicine residency program directors. The survey asked about access to a dermatoscope, the presence of faculty with experience using dermoscopy, the amount of dermoscopy didactic time, and the amount of hands-on dermoscopy training.

RESULTS

Of 631 programs, 275 program directors (43.58% response rate) responded. Half of the responding programs (50.2%) had access to a dermatoscope, and 54.2% had a faculty member with experience using dermoscopy. However, only 6.8% of residents had 4 or more hours of didactics on dermoscopy over their entire training. Only 16.2% had 4 or more hours of hands-on dermoscopy use. Over half (58.9%) of programs planned to add more dermoscopy training. We did not find any correlations between the program's size/type/location and dermoscopy training opportunities.

CONCLUSIONS

Despite reasonable access to a dermatoscope and the presence of at least one faculty member with dermoscopy experience, most family medicine residency programs provided limited dermoscopy training opportunities. Research is needed to better understand how to facilitate dermoscopy training in family medicine residencies.

Agreement Between Experts and an Untrained Crowd for Identifying Dermoscopic Features Using a Gamified App: Reader Feasibility Study

BACKGROUND

Dermoscopy is commonly used for the evaluation of pigmented lesions, but agreement between experts for identification of dermoscopic structures is known to be relatively poor. Expert labeling of medical data is a bottleneck in the development of machine learning (ML) tools, and crowdsourcing has been demonstrated as a cost- and time-efficient method for the annotation of medical images.

OBJECTIVE

The aim of this study is to demonstrate that crowdsourcing can be used to label basic dermoscopic structures from images of pigmented lesions with similar reliability to a group of experts.

METHODS

First, we obtained labels of 248 images of melanocytic lesions with 31 dermoscopic "subfeatures" labeled by 20 dermoscopy experts. These were then collapsed into 6 dermoscopic "superfeatures" based on structural similarity, due to low interrater reliability (IRR): dots, globules, lines, network structures, regression structures, and vessels. These images were then used as the gold standard for the crowd study. The commercial platform DiagnosUs was used to obtain annotations from a nonexpert crowd for the presence or absence of the 6 superfeatures in each of the 248 images. We replicated this methodology with a group of 7 dermatologists to allow direct comparison with the nonexpert crowd. The Cohen κ value was used to measure agreement across raters.

RESULTS

In total, we obtained 139,731 ratings of the 6 dermoscopic superfeatures from the crowd. There was relatively lower agreement for the identification of dots and globules (the median κ values were 0.526 and 0.395, respectively), whereas network structures and vessels showed the highest agreement (the median κ values were 0.581 and 0.798, respectively). This pattern was also seen among the expert raters, who had median κ values of 0.483 and 0.517 for dots and globules, respectively, and 0.758 and 0.790 for network structures and vessels. The median κ values between nonexperts and thresholded average-expert readers were 0.709 for dots, 0.719 for globules, 0.714 for lines, 0.838 for network structures, 0.818 for regression structures, and 0.728 for vessels.

CONCLUSIONS

This study confirmed that IRR for different dermoscopic features varied among a group of experts; a similar pattern was observed in a nonexpert crowd. There was good or excellent agreement for each of the 6 superfeatures between the crowd and the experts, highlighting the similar reliability of the crowd for labeling dermoscopic images. This confirms the feasibility and dependability of using crowdsourcing as a scalable solution to annotate large sets of dermoscopic images, with several potential clinical and educational applications, including the development of novel, explainable ML tools.

Training dermatology residents in dermatoscopy: A case control lecture series assessment

Lack of standardized dermatoscopy training limits confidence and accuracy. We assessed the effect of a dermatoscopy lecture series on the diagnostic accuracy of dermatology residents' biopsies. Additionally, we evaluated resident comfort with and knowledge of dermatoscopy before and after the curriculum. Twelve dermatology residents were enrolled in a 5-month dedicated dermatoscopy curriculum. To assess knowledge of and comfort with dermatoscopy, residents were given a 50-question assessment and 21-question survey before and after the curriculum. Change in diagnostic accuracy was assessed by comparing the suspected clinical diagnosis to the final histopathologic diagnosis of lesions biopsied by residents before and after the course. Upon completion of the curriculum, residents felt significantly more comfortable performing dermatoscopy (P = .002) and using dermatoscopy to identify melanocytic nevi (P = .037) and melanomas (invasive and in situ) (P = .012). Postgraduate year 2 residents also showed significantly improved diagnostic accuracy after the training course (odds ratio, 1.33; 95% confidence interval, 1.06-1.67; P = .013). Our study was limited by a small sample size of 12 residents from a single academic institution. A formal dermatoscopy course can effectively improve dermatology residents' knowledge, confidence, and diagnostic accuracy when using dermatoscopy.

Dermoscopic Photographs Impact Confidence and Management of Remotely Triaged Skin Lesions

Introduction

Improving remote triage is crucial given expansions in tele-dermatology and with limited in-person care during COVID-19. In addition to clinical pictures, dermoscopic images may provide utility for triage.

Objectives

To determine if dermoscopic images enhance confidence, triage accuracy, and triage prioritization for tele-dermatology.

Methods

In this preliminary parallel convergent mixed-methods study, a cohort of dermatologists and residents assessed skin lesions using clinical and dermoscopic images. For each case, participants viewed a clinical image and determined diagnostic category, management, urgency, and decision-making confidence. They subsequently viewed the associated dermoscopy and answered the same questions. A moderated focus group discussion followed to explore perceptions on the role of dermoscopy in tele-dermatology.

Results

Dermoscopy improved recognition of malignancies by 23% and significantly reduced triage urgency measures for non-malignant lesions. Participants endorsed specific utilities of tele-dermoscopy, such as for evaluating pigmented lesions, with limitations including poor image quality.

Conclusions

Dermoscopic images may be useful when remotely triaging skin lesions. Standardized imaging protocols are needed.

Assessing exposure to dermoscopy in plastic surgery training programs

BACKGROUND

Dermoscopy is a noninvasive tool that improves the diagnostic accuracy of melanoma and other cutaneous malignancies; yet, it is not widely used by plastic surgeons, who commonly manage skin lesions. Thus, the purpose of this study was to explore current practice patterns and knowledge of dermoscopy among plastic surgeons and postgraduate plastic surgery trainees. Additionally, interest to establish a formal dermoscopy curriculum as part of plastic surgery residency training was evaluated.

METHODS

An online electronic questionnaire was developed and distributed through email to practicing plastic surgeons and plastic surgery trainees at two Canadian universities.

RESULTS

Of the 59 potential participants, 27 (46%) responded. While the majority of participants were familiar with dermoscopy (n = 26; 96%), only one respondent reported using dermoscopy in clinical practice. However, all respondents reported exposure to melanoma clinically (n = 26; one participant did not provide a response). A lack of training, along with lack of access to dermatoscopes, were the most frequently cited reasons for not using dermoscopy. Knowledge scores with regard to dermoscopic features were also low; coupled with a noted propensity toward diagnostic or excisional biopsy, whichcould raise the benign to malignant ratio. Overall, 89% (n = 24) of respondents expressed interest in dermoscopy training in plastic surgery postgraduate training.

CONCLUSIONS

Few responding plastic surgeons or plastic surgery residents currently use dermoscopy in training or practice but are interested in formal dermoscopy training in residency.

Dermoscopy Proficiency Expectations for US Dermatology Resident Physicians: Results of a Modified Delphi Survey of Pigmented Lesion Experts

Importance

Dermoscopy education in US dermatology residency programs varies widely, and there is currently no existing expert consensus identifying what is most important for resident physicians to know.

Objectives

To identify consensus-based learning constructs representing an appropriate foundational proficiency in dermoscopic image interpretation for dermatology resident physicians, including dermoscopic diagnoses, associated features, and representative teaching images. Defining these foundational proficiency learning constructs will facilitate further skill development in dermoscopic image interpretation to help residents achieve clinical proficiency.

Design, Setting, and Participants

A 2-phase modified Delphi surveying technique was used to identify resident learning constructs in 3 sequential sets of surveys-diagnoses, features, and images. Expert panelists were recruited through an email distributed to the 32 members of the Pigmented Lesion Subcommittee of the Melanoma Prevention Working Group. Twenty-six (81%) opted to participate. Surveys were distributed using RedCAP software.

Main Outcomes and Measures

Consensus on diagnoses, associated dermoscopic features, and representative teaching images reflective of a foundational proficiency in dermoscopic image interpretation for US dermatology resident physicians.

Results

Twenty-six pigmented lesion and dermoscopy specialists completed 8 rounds of surveys, with 100% (26/26) response rate in all rounds. A final list of 32 diagnoses and 116 associated dermoscopic features was generated. Three hundred seventy-eight representative teaching images reached consensus with panelists.

Conclusions and Relevance

Consensus achieved in this modified Delphi process identified common dermoscopic diagnoses, associated features, and representative teaching images reflective of a foundational proficiency in dermoscopic image interpretation for dermatology residency training. This list of validated objectives provides a consensus-based foundation of key learning points in dermoscopy to help resident physicians achieve clinical proficiency in dermoscopic image interpretation.

Validation of a Novel Cutaneous Neoplasm Diagnostic Self-Efficacy Instrument (CNDSEI) for Evaluating User-Perceived Confidence With Dermoscopy

Background

Accurate medical image interpretation is an essential proficiency for multiple medical specialties, including dermatologists and primary care providers. A dermatoscope, a ×10-×20 magnifying lens paired with a light source, enables enhanced visualization of skin cancer structures beyond standard visual inspection. Skilled interpretation of dermoscopic images improves diagnostic accuracy for skin cancer.

Objective

Design and validation of Cutaneous Neoplasm Diagnostic Self-Efficacy Instrument (CNDSEI)-a new tool to assess dermatology residents' confidence in dermoscopic diagnosis of skin tumors.

Methods

In the 2018-2019 academic year, the authors administered the CNDSEI and the Long Dermoscopy Assessment (LDA), to measure dermoscopic image interpretation accuracy, to residents in 9 dermatology residency programs prior to dermoscopy educational intervention exposure. The authors conducted CNDSEI item analysis with inspection of response distribution histograms, assessed internal reliability using Cronbach's coefficient alpha (α) and construct validity by comparing baseline CNDSEI and LDA results for corresponding lesions with one-way analysis of variance (ANOVA).

Results

At baseline, residents respectively demonstrated significantly higher and lower CNDSEI scores for correctly and incorrectly diagnosed lesions on the LDA (P = 0.001). The internal consistency reliability of CNDSEI responses for the majority (13/15) of the lesion types was excellent (α ≥ 0.9) or good (0.8≥ α <0.9).

Conclusions

The CNDSEI pilot established that the tool reliably measures user dermoscopic image interpretation confidence and that self-efficacy correlates with diagnostic accuracy. Precise alignment of medical image diagnostic performance and the self-efficacy instrument content offers opportunity for construct validation of novel medical image interpretation self-efficacy instruments.

A practical review of dermoscopy for pediatric dermatology part I: Melanocytic growths

The value of dermoscopy in the detection of skin cancer is well established. Less is published on the utility of dermoscopy in the evaluation of pediatric skin disease. Our review (in two parts) aims to serve as an update on pediatric dermoscopy and to provide readers with a practical application for the use of dermoscopy in pediatric dermatology clinics. In part I, we propose a dermoscopy algorithm for pediatric skin disease and melanocytic growths, and in part II, we address vascular growths, common skin infections, and inflammatory conditions for which dermoscopy is valuable.

Reliable test of clinicians' mastery in skin cancer diagnostics

Differentiating between benign and malignant skin lesions can be very difficult and should only be done by sufficiently trained and skilled clinicians. To our knowledge there are no validated tests for reliable assessments of clinicians' ability to perform skin cancer diagnostics. To develop and gather validity evidence for a test in skin cancer diagnostics, a multiple-choice questionnaire (MCQ) was developed based on informal interviews with seven content experts from five skin cancer centers in Denmark. Validity evidence for the test was gathered from May until July 2019 using Messick's validity framework (content, response process, internal structure, relationship to other variables and consequences). Item content was revised through a Delphi-like review process and then piloted on 36 medical students and 136 doctors using a standardized response process. Results enabled an analysis of the internal structure and relationship to other variables of the test. Finally, the contrasting groups method was used to investigate the test's consequences (pass-fail standard). The initial 90-item MCQ was reduced to 40 items during the Delphi-like review process. Item analysis revealed that 25 of the 40 selected items were level I-III quality items with a high internal consistency (Cronbach's α = 0.83) and highly significant (P ≤ 0.0001) differences in test scores between participants with different occupations or levels of experience. A pass-fail standard of 12 (48%) correct answers was established using the contrasting groups' method. The skin cancer diagnostics MCQ developed in this study can be used for reliable assessments of clinicians' competencies.

Using content-based image retrieval of dermoscopic images for interpretation and education: A pilot study

BACKGROUND

Dermoscopic content-based image retrieval (CBIR) systems provide a set of visually similar dermoscopic (magnified and illuminated) skin images with a pathology-confirmed diagnosis for a given dermoscopic query image of a skin lesion. Although recent advances in machine learning have spurred novel CBIR algorithms, we have few insights into how end users interact with CBIRs and to what extent CBIRs can be useful for education and image interpretation.

MATERIALS AND METHODS

We developed an interactive user interface for a CBIR system with dermoscopic images as a decision support tool and investigated users' interactions and decisions with the system. We performed a pilot experiment with 14 non-medically trained users for a given set of annotated dermoscopic images.

RESULTS

Our pilot showed that the number of correct classifications and users' confidence levels significantly increased with the CBIR interface compared with a non-CBIR interface, although the timing also increased significantly. The users found the CBIR interface of high educational value, engaging and easy to use.

CONCLUSION

Overall, users became more accurate, found the CBIR approach provided a useful decision aid, and had educational value for learning about skin conditions.