The Experience of 3D Total-Body Photography to Monitor Nevi: Results From an Australian General Population-Based Cohort Study

Monitoring of Pigmented Skin Lesions Using 3D Whole Body Imaging

BACKGROUND AND OBJECTIVES

Advanced artificial intelligence and machine learning have great potential to redefine how skin lesions are detected, mapped, tracked and documented. Here, we propose a 3D whole-body imaging system known as 3DSkin-mapper to enable automated detection, evaluation and mapping of skin lesions.

METHODS

A modular camera rig arranged in a cylindrical configuration was designed to automatically capture images of the entire skin surface of a subject synchronously from multiple angles. Based on the images, we developed algorithms for 3D model reconstruction, data processing and skin lesion detection and tracking based on deep convolutional neural networks. We also introduced a customised, user-friendly, and adaptable interface that enables individuals to interactively visualise, manipulate, and annotate the images. The interface includes built-in features such as mapping 2D skin lesions onto the corresponding 3D model.

RESULTS

The proposed system is developed for skin lesion screening, the focus of this paper is to introduce the system instead of clinical study. Using synthetic and real images we demonstrate the effectiveness of the proposed system by providing multiple views of a target skin lesion, enabling further 3D geometry analysis and longitudinal tracking. Skin lesions are identified as outliers which deserve more attention from a skin cancer physician. Our detector leverages expert annotated labels to learn representations of skin lesions, while capturing the effects of anatomical variability. It takes only a few seconds to capture the entire skin surface, and about half an hour to process and analyse the images.

CONCLUSIONS

Our experiments show that the proposed system allows fast and easy whole body 3D imaging. It can be used by dermatological clinics to conduct skin screening, detect and track skin lesions over time, identify suspicious lesions, and document pigmented lesions. The system can potentially save clinicians time and effort significantly. The 3D imaging and analysis has the potential to change the paradigm of whole body photography with many applications in skin diseases, including inflammatory and pigmentary disorders. With reduced time requirements for recording and documenting high-quality skin information, doctors could spend more time providing better-quality treatment based on more detailed and accurate information.

Consumer views of melanoma early detection using 3D total-body photography: cross-sectional survey

BACKGROUND

Three-dimensional (3D) total-body photography is a recent advance in melanoma early detection that can aid in monitoring and identifying new and changing skin lesions over time.

METHODS

A cross-sectional survey of adults living in metropolitan and rural areas of Australia was conducted to assess perceptions of 3D total-body photography. Participants completed a survey detailing their previous use of skin cancer photography, personal skin checking history, perceptions of 3D total-body photography, and willingness to pay. Participants were also asked to describe the potential barriers and facilitators of 3D total-body photography in their own words.

RESULTS

A total of 1056 participants completed the survey, with 739 (70%) from metropolitan areas of Australia and 317 (30%) from rural areas. Most participants (95%, n = 1004/1056) indicated they would consider using 3D total-body photography if it became commercially available at their regular medical practice. Most participants indicated 3D total-body photography would be effective to identify suspicious skin spots (94%, n = 995/1056), monitor lesion changes (94%, n = 997/1056), and reduce skin cancer related anxiety (90%, n = 950/1055). In open-ended feedback, participants (87%, n = 918/1056) identified perceived benefits, including more comprehensive screenings, earlier detection, and less human error. Participants (84%, n = 889/1056) also identified potential barriers to 3D total-body photography, including cost, accessibility and availability, trust in the technology, and digital security concerns.

CONCLUSIONS

Participant feedback indicated a high level of acceptance and confidence in the technology. To facilitate clinical translation, addressing consumer-identified barriers to 3D total-body photography will be vital.

Consumer perceptions on privacy and confidentiality in dermatology for 3D total-body imaging

As 3D total-body photography for the early detection of melanoma is not yet widely used in clinical practice, we do not have a full understanding of patient's concerns about use, privacy and confidentiality, and if their concerns differ depending on the use-case. We conducted a virtual consumer forum to assess patients concerns about privacy and confidentiality in dermatology imaging for research, artificial intelligence development and for their own clinical care.