Skin strata delineation in reflectance confocal microscopy images using recurrent convolutional networks with attention

Biofabrication Strategies for Oral Soft Tissue Regeneration

Gingival recession, a prevalent condition affecting the gum tissues, is characterized by the exposure of tooth root surfaces due to the displacement of the gingival margin. This review explores conventional treatments, highlighting their limitations and the quest for innovative alternatives. Importantly, it emphasizes the critical considerations in gingival tissue engineering leveraging on cells, biomaterials, and signaling factors. Successful tissue-engineered gingival constructs hinge on strategic choices such as cell sources, scaffold design, mechanical properties, and growth factor delivery. Unveiling advancements in recent biofabrication technologies like 3D bioprinting, electrospinning, and microfluidic organ-on-chip systems, this review elucidates their precise control over cell arrangement, biomaterials, and signaling cues. These technologies empower the recapitulation of microphysiological features, enabling the development of gingival constructs that closely emulate the anatomical, physiological, and functional characteristics of native gingival tissues. The review explores diverse engineering strategies aiming at the biofabrication of realistic tissue-engineered gingival grafts. Further, the parallels between the skin and gingival tissues are highlighted, exploring the potential transfer of biofabrication approaches from skin tissue regeneration to gingival tissue engineering. To conclude, the exploration of innovative biofabrication technologies for gingival tissues and inspiration drawn from skin tissue engineering look forward to a transformative era in regenerative dentistry with improved clinical outcomes.

Artificial intelligence and skin cancer

Artificial intelligence is poised to rapidly reshape many fields, including that of skin cancer screening and diagnosis, both as a disruptive and assistive technology. Together with the collection and availability of large medical data sets, artificial intelligence will become a powerful tool that can be leveraged by physicians in their diagnoses and treatment plans for patients. This comprehensive review focuses on current progress toward AI applications for patients, primary care providers, dermatologists, and dermatopathologists, explores the diverse applications of image and molecular processing for skin cancer, and highlights AI's potential for patient self-screening and improving diagnostic accuracy for non-dermatologists. We additionally delve into the challenges and barriers to clinical implementation, paths forward for implementation and areas of active research.

Miniature line-scanned dual-axis confocal microscope for versatile clinical use

A miniature optical-sectioning fluorescence microscope with high sensitivity and resolution would enable non-invasive and real-time tissue inspection, with potential use cases including early disease detection and intraoperative guidance. Previously, we developed a miniature MEMS-based dual-axis confocal (DAC) microscope that enabled video-rate optically sectioned in vivo microscopy of human tissues. However, the device's clinical utility was limited due to a small field of view, a non-adjustable working distance, and a lack of a sterilization strategy. In our latest design, we have made improvements to achieve a 2x increase in the field of view (600 × 300 µm) and an adjustable working distance range of 150 µm over a wide range of excitation/emission wavelengths (488-750 nm), all while maintaining a high frame rate of 15 frames per second (fps). Furthermore, the device is designed to image through a disposable sterile plastic drape for convenient clinical use. We rigorously characterize the performance of the device and show example images of ex vivo tissues to demonstrate the optical performance of our new design, including fixed mouse skin and human prostate, as well as fresh mouse kidney, mouse intestine, and human head and neck surgical specimens with corresponding H&E histology. These improvements will facilitate clinical testing and translation.

Computer-Aided Diagnosis of Melanoma Subtypes Using Reflectance Confocal Images

Lentigo maligna (LM) is an early form of pre-invasive melanoma that predominantly affects sun-exposed areas such as the face. LM is highly treatable when identified early but has an ill-defined clinical border and a high rate of recurrence. Atypical intraepidermal melanocytic proliferation (AIMP), also known as atypical melanocytic hyperplasia (AMH), is a histological description that indicates melanocytic proliferation with uncertain malignant potential. Clinically and histologically, AIMP can be difficult to distinguish from LM, and indeed AIMP may, in some cases, progress to LM. The early diagnosis and distinction of LM from AIMP are important since LM requires a definitive treatment. Reflectance confocal microscopy (RCM) is an imaging technique often used to investigate these lesions non-invasively, without biopsy. However, RCM equipment is often not readily available, nor is the associated expertise for RCM image interpretation easy to find. Here, we implemented a machine learning classifier using popular convolutional neural network (CNN) architectures and demonstrated that it could correctly classify lesions between LM and AIMP on biopsy-confirmed RCM image stacks. We identified local z-projection (LZP) as a recent fast approach for projecting a 3D image into 2D while preserving information and achieved high-accuracy machine classification with minimal computational requirements.

In vivo tumor immune microenvironment phenotypes correlate with inflammation and vasculature to predict immunotherapy response

Response to immunotherapies can be variable and unpredictable. Pathology-based phenotyping of tumors into ‘hot’ and ‘cold’ is static, relying solely on T-cell infiltration in single-time single-site biopsies, resulting in suboptimal treatment response prediction. Dynamic vascular events (tumor angiogenesis, leukocyte trafficking) within tumor immune microenvironment (TiME) also influence anti-tumor immunity and treatment response. Here, we report dynamic cellular-level TiME phenotyping in vivo that combines inflammation profiles with vascular features through non-invasive reflectance confocal microscopic imaging. In skin cancer patients, we demonstrate three main TiME phenotypes that correlate with gene and protein expression, and response to toll-like receptor agonist immune-therapy. Notably, phenotypes with high inflammation associate with immunostimulatory signatures and those with high vasculature with angiogenic and endothelial anergy signatures. Moreover, phenotypes with high inflammation and low vasculature demonstrate the best treatment response. This non-invasive in vivo phenotyping approach integrating dynamic vasculature with inflammation serves as a reliable predictor of response to topical immune-therapy in patients.

Standard assessment of immune infiltration of biopsies is not sufficient to accurately predict response to immunotherapy. Here, the authors show that reflectance confocal microscopy can be used to quantify dynamic vasculature and inflammatory features to better predict treatment response in skin cancers.

Automating reflectance confocal microscopy image analysis for dermatological research: a review

SIGNIFICANCE

Reflectance confocal microscopy (RCM) is a noninvasive, in vivo technology that offers near histopathological resolution at the cellular level. It is useful in the study of phenomena for which obtaining a biopsy is impractical or would cause unnecessary tissue damage and trauma to the patient.

AIM

This review covers the use of RCM in the study of skin and the use of machine learning to automate information extraction. It has two goals: (1) an overview of information provided by RCM on skin structure and how it changes over time in response to stimuli and in disease and (2) an overview of machine learning approaches developed to automate the extraction of key morphological features from RCM images.

APPROACH

A PubMed search was conducted with additional literature obtained from references lists.

RESULTS

The application of RCM as an in vivo tool in dermatological research and the biologically relevant information derived from it are presented. Algorithms for image classification to epidermal layers, delineation of the dermal-epidermal junction, classification of skin lesions, and demarcation of individual cells within an image, all important factors in the makeup of the skin barrier, were reviewed. Application of image analysis methods in RCM is hindered by low image quality due to noise and/or poor contrast. Use of supervised machine learning is limited by time-consuming manual labeling of RCM images.

CONCLUSIONS

RCM has great potential in the study of skin structures. The use of artificial intelligence could enable an easier, more reproducible, precise, and rigorous study of RCM images for the understanding of skin structures, skin barrier, and skin inflammation and lesions. Although several attempts have been made, further work is still needed to provide a definite gold standard and overcome issues related to image quality, limited labeled datasets, and lack of phenotype variability in available databases.

In vivo microscopy as an adjunctive tool to guide detection, diagnosis, and treatment

SIGNIFICANCE

There have been numerous academic and commercial efforts to develop high-resolution in vivo microscopes for a variety of clinical use cases, including early disease detection and surgical guidance. While many high-profile studies, commercialized products, and publications have resulted from these efforts, mainstream clinical adoption has been relatively slow other than for a few clinical applications (e.g., dermatology).

AIM

Here, our goals are threefold: (1) to introduce and motivate the need for in vivo microscopy (IVM) as an adjunctive tool for clinical detection, diagnosis, and treatment, (2) to discuss the key translational challenges facing the field, and (3) to propose best practices and recommendations to facilitate clinical adoption.

APPROACH

We will provide concrete examples from various clinical domains, such as dermatology, oral/gastrointestinal oncology, and neurosurgery, to reinforce our observations and recommendations.

RESULTS

While the incremental improvement and optimization of IVM technologies should and will continue to occur, future translational efforts would benefit from the following: (1) integrating clinical and industry partners upfront to define and maintain a compelling value proposition, (2) identifying multimodal/multiscale imaging workflows, which are necessary for success in most clinical scenarios, and (3) developing effective artificial intelligence tools for clinical decision support, tempered by a realization that complete adoption of such tools will be slow.

CONCLUSIONS

The convergence of imaging modalities, academic-industry-clinician partnerships, and new computational capabilities has the potential to catalyze rapid progress and adoption of IVM in the next few decades.