Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy

A Dual-Modal, Label-Free Raman Imaging Method for Rapid Virtual Staining of Large-Area Breast Cancer Tissue Sections

As one of the most common cancers, accurate, rapid, and simple histopathological diagnosis is very important for breast cancer. Raman imaging is a powerful technique for label-free analysis of tissue composition and histopathology, but it suffers from slow speed when applied to large-area tissue sections. In this study, we propose a dual-modal Raman imaging method that combines Raman mapping data with microscopy bright-field images to achieve virtual staining of breast cancer tissue sections. We validate our method on various breast tissue sections with different morphologies and biomarker expressions and compare it with the golden standard of histopathological methods. The results demonstrate that our method can effectively distinguish various types and components of tissues, and provide staining images comparable to stained tissue sections. Moreover, our method can improve imaging speed by up to 65 times compared to general spontaneous Raman imaging methods. It is simple, fast, and suitable for clinical applications.

SLE diagnosis research based on SERS combined with a multi-modal fusion method

As artificial intelligence technology gains widespread adoption in biomedicine, the exploration of integrating biofluidic Raman spectroscopy for enhanced disease diagnosis opens up new prospects for the practical application of Raman spectroscopy in clinical settings. However, for systemic lupus erythematosus (SLE), origin Raman spectral data (ORS) have relatively weak signals, making it challenging to obtain ideal classification results. Although the surface enhancement technique can enhance the scattering signal of Raman spectroscopic data, the sensitivity of the SERS substrate to airborne impurities and the inhomogeneous distribution of hotspots degrade part of the signal. To fully utilize both kinds of data, this paper proposes a two-branch residual-attention network (DBRAN) fusion technique, which allows the ORS to complement the degraded portion and thus improve the model's classification accuracy. The features are extracted using the residual module, which retains the original features while extracting the deep features. At the same time, the study incorporates the attention module in both the upper and lower branches to handle the weight allocation of the two modal features more efficiently. The experimental results demonstrate that both the low-level fusion method and the intermediate-level fusion method can significantly improve the diagnostic accuracy of SLE disease classification compared with a single modality, in which the intermediate-level fusion of DBRAN achieves 100% classification accuracy, sensitivity, and specificity. The accuracy is improved by 10% and 7% compared with the ORS unimodal and the SERS unimodal modalities, respectively. The experiment, by fusing the multimodal spectral, realized rapid diagnosis of SLE disease by fusing multimodal spectral data, which provides a reference idea in the field of Raman spectroscopy and can be further promoted to clinical practical applications in the future.

Computer Vision-Radiomics & Pathognomics

The role of computer vision in extracting radiographic (radiomics) and histopathologic (pathognomics) features is an extension of molecular biomarkers that have been foundational to our understanding across the spectrum of head and neck disorders. Especially within head and neck cancers, machine learning and deep learning applications have yielded advances in the characterization of tumor features, nodal features, and various outcomes. This review aims to overview the landscape of radiomic and pathognomic applications, informing future work to address gaps. Novel methodologies will be needed to potentially engineer ways of integrating multidimensional data inputs to examine disease features to guide prognosis comprehensively and ultimately clinical management.

Rapid and Precise Diagnosis of Retroperitoneal Liposarcoma with Deep-Learned Label-Free Molecular Microscopy

The retroperitoneal liposarcoma (RLPS) is a rare malignancy whose only curative therapy is surgical resection. However, well-differentiated liposarcomas (WDLPSs), one of its most common types, can hardly be distinguished from normal fat during operation without an effective margin assessment method, jeopardizing the prognosis severely with a high recurrence risk. Here, we combined dual label-free nonlinear optical modalities, stimulated Raman scattering (SRS) microscopy and second harmonic generation (SHG) microscopy, to image two predominant tissue biomolecules, lipids and collagen fibers, in 35 RLPSs and 34 normal fat samples collected from 35 patients. The produced dual-modal tissue images were used for RLPS diagnosis based on deep learning. Dramatically decreasing lipids and increasing collagen fibers during tumor progression were reflected. A ResNeXt101-based model achieved 94.7% overall accuracy and 0.987 mean area under the ROC curve (AUC) in differentiating among normal fat, WDLPSs, and dedifferentiated liposarcomas (DDLPSs). In particular, WDLPSs were detected with 94.1% precision and 84.6% sensitivity superior to existing methods. The ablation experiment showed that such performance was attributed to both SRS and SHG microscopies, which increased the sensitivity of recognizing WDLPS by 16.0 and 3.6%, respectively. Furthermore, we utilized this model on RLPS margins to identify the tumor infiltration. Our method holds great potential for accurate intraoperative liposarcoma detection.

Fast Real-Time Brain Tumor Detection Based on Stimulated Raman Histology and Self-Supervised Deep Learning Model

In intraoperative brain cancer procedures, real-time diagnosis is essential for ensuring safe and effective care. The prevailing workflow, which relies on histological staining with hematoxylin and eosin (H&E) for tissue processing, is resource-intensive, time-consuming, and requires considerable labor. Recently, an innovative approach combining stimulated Raman histology (SRH) and deep convolutional neural networks (CNN) has emerged, creating a new avenue for real-time cancer diagnosis during surgery. While this approach exhibits potential, there exists an opportunity for refinement in the domain of feature extraction. In this study, we employ coherent Raman scattering imaging method and a self-supervised deep learning model (VQVAE2) to enhance the speed of SRH image acquisition and feature representation, thereby enhancing the capability of automated real-time bedside diagnosis. Specifically, we propose the VQSRS network, which integrates vector quantization with a proxy task based on patch annotation for analysis of brain tumor subtypes. Training on images collected from the SRS microscopy system, our VQSRS demonstrates a significant speed enhancement over traditional techniques (e.g., 20-30 min). Comparative studies in dimensionality reduction clustering confirm the diagnostic capacity of VQSRS rivals that of CNN. By learning a hierarchical structure of recognizable histological features, VQSRS classifies major tissue pathological categories in brain tumors. Additionally, an external semantic segmentation method is applied for identifying tumor-infiltrated regions in SRH images. Collectively, these findings indicate that this automated real-time prediction technique holds the potential to streamline intraoperative cancer diagnosis, providing assistance to pathologists in simplifying the process.

Nanoplastics Detected in Commercial Sea Salt

People of all ages consume salt every day, but is it really just salt? Plastic nanoparticles [nanoplastics (NPs)] pose an increasing environmental threat and have begun to contaminate everyday salt in consumer goods. Herein, we developed a combined surface enhanced Raman scattering (SERS) and stimulated Raman scattering (SRS) approach that can realize the filtration, enrichment, and detection of NPs in commercial salt. The Au-loaded (50 nm) anodic alumina oxide substrate was used as the SERS substrate to explore the potential types of NP contaminants in salts. SRS was used to conduct imaging and quantify the presence of the NPs. SRS detection was successfully established through standard plastics, and NPs were identified through the match of the hydrocarbon group of the nanoparticles. Simultaneously, the NPs were quantified based on the high spatial resolution and rapid imaging of the SRS imaging platform. NPs in sea salts produced in Asia, Australasia, Europe, and the Atlantic were studied. We estimate that, depending on the location, an average person could be ingesting as many as 6 million NPs per year through the consumption of sea salt alone. The potential health hazards associated with NP ingestion should not be underestimated.

A practical online prediction platform to predict the survival status of laryngeal squamous cell carcinoma after 5 years

OBJECTIVE

Currently, there are few practical tools for predicting the prognosis of laryngeal squamous cell carcinoma (LSCC). This study aims to establish a model and a convenient online prediction platform to predict whether LSCC patients will survive 5 years after diagnosis, providing a reference for further evaluation of patient prognosis.

METHODS

This is a retrospective study based on data collected from two centers. Center 1 included 117 LSCC patients with survival prognosis data, and center 2 included 33 patients, totaling 150 patients. All data were divided into independent training sets (60 %) and testing sets (40 %). Eight machine learning (ML) algorithms were used to establish models with 11 clinical parameters as input features. The accuracy, sensitivity, specificity, and receiver operating characteristic curve (ROC) of the testing set were used to evaluate the models, and the best model was selected. The model was then developed into a website-based 5-year survival status prediction platform for LSCC. In addition, we also used the SHapley Additive exPlanations (SHAP) tool to conduct interpretability analysis on the parameters of the model.

RESULTS

The LSCC 5-year survival status prediction model using the support vector machine (SVM) algorithm achieved the best results, with accuracy, sensitivity, specificity, and area under the ROC curve (AUC) of 85.0 %, 87.5 %, 75.0 %, and 81.2 % respectively. The online platform for predicting the 5-year survival status of LSCC based on this model was successfully established. The SHAP analysis shows that the clinical stage is the most important feature of the model.

CONCLUSION

This study successfully established a ML model and a practical online prediction platform to predict the survival status of laryngeal cancer patients after 5 years, which may help clinicians to better evaluate the prognosis of LSCC.

LEVEL OF EVIDENCE: 3

[Intraoperative stimulated Raman histology for personalized brain tumor surgery]

BACKGROUND

In brain tumor surgery a personalized surgical approach is crucial to achieve a maximum safe tumor resection. The extent of resection decisively depends on the histological diagnosis. Stimulated Raman histology (SRH), a fiber laser-based optical imaging method, offers the possibility for evaluation of an intraoperative diagnosis in a few minutes.

OBJECTIVE

To provide an overview on the applications of SRH in neurosurgery and transference of the technique to other surgical disciplines.

METHODS

Description of the technique and review of the current literature on SRH.

RESULTS

The SRH technique was successfully used in multiple neuro-oncological tumor entities. Initial pilot projects showed the potential for analysis of extracranial tumors.

CONCLUSION

The use of SRH provides a near real-time diagnosis with high diagnostic accuracy and provides further developmental potential to improve personalized tumor surgery.

Current Trends of Raman Spectroscopy in Clinic Settings: Opportunities and Challenges

Early clinical diagnosis, effective intraoperative guidance, and an accurate prognosis can lead to timely and effective medical treatment. The current conventional clinical methods have several limitations. Therefore, there is a need to develop faster and more reliable clinical detection, treatment, and monitoring methods to enhance their clinical applications. Raman spectroscopy is noninvasive and provides highly specific information about the molecular structure and biochemical composition of analytes in a rapid and accurate manner. It has a wide range of applications in biomedicine, materials, and clinical settings. This review primarily focuses on the application of Raman spectroscopy in clinical medicine. The advantages and limitations of Raman spectroscopy over traditional clinical methods are discussed. In addition, the advantages of combining Raman spectroscopy with machine learning, nanoparticles, and probes are demonstrated, thereby extending its applicability to different clinical phases. Examples of the clinical applications of Raman spectroscopy over the last 3 years are also integrated. Finally, various prospective approaches based on Raman spectroscopy in clinical studies are surveyed, and current challenges are discussed.

Deep UV-excited fluorescence microscopy installed with CycleGAN-assisted image translation enhances precise detection of lymph node metastasis towards rapid intraoperative diagnosis

Rapid and precise intraoperative diagnosing systems are required for improving surgical outcomes and patient prognosis. Because of the poor quality and time-intensive process of the prevalent frozen section procedure, various intraoperative diagnostic imaging systems have been explored. Microscopy with ultraviolet surface excitation (MUSE) is an inexpensive, maintenance-free, and rapid imaging technique that yields images like thin-sectioned samples without sectioning. However, pathologists find it nearly impossible to assign diagnostic labels to MUSE images of unfixed specimens; thus, AI for intraoperative diagnosis cannot be trained in a supervised learning manner. In this study, we propose a deep-learning pipeline model for lymph node metastasis detection, in which CycleGAN translate MUSE images of unfixed lymph nodes to formalin-fixed paraffin-embedded (FFPE) sample, and diagnostic prediction is performed using deep convolutional neural network trained on FFPE sample images. Our pipeline yielded an average accuracy of 84.6% when using each of the three deep convolutional neural networks, which is a 18.3% increase over the classification-only model without CycleGAN. The modality translation to FFPE sample images using CycleGAN can be applied to various intraoperative diagnostic imaging systems and eliminate the difficulty for pathologists in labeling new modality images in clinical sites. We anticipate our pipeline to be a starting point for accurate rapid intraoperative diagnostic systems for new imaging modalities, leading to healthcare quality improvement.

Roadmap on Label-Free Super-Resolution Imaging

Label-free super-resolution (LFSR) imaging relies on light-scattering processes in nanoscale objects without a need for fluorescent (FL) staining required in super-resolved FL microscopy. The objectives of this Roadmap are to present a comprehensive vision of the developments, the state-of-the-art in this field, and to discuss the resolution boundaries and hurdles which need to be overcome to break the classical diffraction limit of the LFSR imaging. The scope of this Roadmap spans from the advanced interference detection techniques, where the diffraction-limited lateral resolution is combined with unsurpassed axial and temporal resolution, to techniques with true lateral super-resolution capability which are based on understanding resolution as an information science problem, on using novel structured illumination, near-field scanning, and nonlinear optics approaches, and on designing superlenses based on nanoplasmonics, metamaterials, transformation optics, and microsphere-assisted approaches. To this end, this Roadmap brings under the same umbrella researchers from the physics and biomedical optics communities in which such studies have often been developing separately. The ultimate intent of this paper is to create a vision for the current and future developments of LFSR imaging based on its physical mechanisms and to create a great opening for the series of articles in this field.

High-precision bladder cancer diagnosis method: 2D Raman spectrum figures based on maintenance technology combined with automatic weighted feature fusion network

BACKGROUND

Raman spectroscopy has been extensively utilized as a marker-free detection method in the complementary diagnosis of cancer. Multivariate statistical classification analysis is frequently employed for Raman spectral data classification. Nevertheless, traditional multivariate statistical classification analysis performs poorly when analyzing large samples and multicategory spectral data. In addition, with the advancement of computer vision, convolutional neural networks (CNNs) have demonstrated extraordinarily precise analysis of two-dimensional image processing.

RESULT

Combining 2D Raman spectrograms with automatic weighted feature fusion network (AWFFN) for bladder cancer detection is presented in this paper. Initially, the s-transform (ST) is implemented for the first time to convert 1D Raman data into 2D spectrograms, achieving 99.2% detection accuracy. Second, four upscaling techniques, including short time fourier transform (STFT), recurrence map (RP), markov transform field (MTF), and grammy angle field (GAF), were used to transform the 1D Raman spectral data into a variety of 2D Raman spectrograms. In addition, a particle swarm optimization (PSO) algorithm is combined with VGG19, ResNet50, and ResNet101 to construct a weighted feature fusion network, and this parallel network is employed for evaluating multiple spectrograms. Class activation mapping (CAM) is additionally employed to illustrate and evaluate the process of feature extraction via the three parallel network branches. The results demonstrate that the combination of a 2D Raman spectrogram along with a CNN for the diagnosis of bladder cancer obtains a 99.2% accuracy rate，which indicates that it is an extremely promising auxiliary technology for cancer diagnosis.

SIGNIFICANCE

The proposed two-dimensional Raman spectroscopy method has an improved precision than one-dimensional spectroscopic data, which presents a potential methodology for assisted cancer detection and providing crucial technical support for assisted diagnosis.

Rapid azoospermia classification by stimulated Raman scattering and second harmonic generation microscopy

Disease diagnosis and classification pose significant challenges due to the limited capabilities of traditional methods to obtain molecular information with spatial distribution. Optical imaging techniques, utilizing (auto)fluorescence and nonlinear optical signals, introduce new dimensions for biomarkers exploration that can improve diagnosis and classification. Nevertheless, these signals often cover only a limited number of species, impeding a comprehensive assessment of the tissue microenvironment, which is crucial for effective disease diagnosis and therapy. To address this challenge, we developed a multimodal platform, termed stimulated Raman scattering and second harmonic generation microscopy (SRASH), capable of simultaneously providing both chemical bonds and structural information of tissues. Applying SRASH imaging to azoospermia patient samples, we successfully identified lipids, protein, and collagen contrasts, unveiling molecular and structural signatures for non-obstructive azoospermia. This achievement is facilitated by LiteBlendNet-Dx (LBNet-Dx), our diagnostic algorithm, which achieved an outstanding 100% sample-level accuracy in classifying azoospermia, surpassing conventional imaging modalities. As a label-free technique, SRASH imaging eliminates the requirement for sample pre-treatment, demonstrating great potential for clinical translation and enabling molecular imaging-based diagnosis and therapy.

Nondestructive 3D Pathology Image Atlas of Barrett Esophagus With Open-Top Light-Sheet Microscopy

CONTEXT.—

Anatomic pathologists render diagnosis on tissue samples sectioned onto glass slides and viewed under a bright-field microscope. This approach is destructive to the sample, which can limit its use for ancillary assays that can inform patient management. Furthermore, the subjective interpretation of a relatively small number of 2D tissue sections per sample contributes to low interobserver agreement among pathologists for the assessment (diagnosis and grading) of various lesions.

OBJECTIVE.—

To evaluate 3D pathology data sets of thick formalin-fixed Barrett esophagus specimens imaged nondestructively with open-top light-sheet (OTLS) microscopy.

DESIGN.—

Formalin-fixed, paraffin-embedded Barrett esophagus samples (N = 15) were deparaffinized, stained with a fluorescent analog of hematoxylin-eosin, optically cleared, and imaged nondestructively with OTLS microscopy. The OTLS microscopy images were subsequently compared with archived hematoxylin-eosin histology sections from each sample.

RESULTS.—

Barrett esophagus samples, both small endoscopic forceps biopsies and endoscopic mucosal resections, exhibited similar resolvable structures between OTLS microscopy and conventional light microscopy with up to a ×20 objective (×200 overall magnification). The 3D histologic images generated by OTLS microscopy can enable improved discrimination of cribriform and well-formed gland morphologies. In addition, a much larger amount of tissue is visualized with OTLS microscopy, which enables improved assessment of clinical specimens exhibiting high spatial heterogeneity.

CONCLUSIONS.—

In esophageal specimens, OTLS microscopy can generate images comparable in quality to conventional light microscopy, with the advantages of providing 3D information for enhanced evaluation of glandular morphologies and enabling much more of the tissue specimen to be visualized nondestructively.

Accelerating Cancer Histopathology Workflows with Chemical Imaging and Machine Learning

Histopathology has remained a cornerstone for biomedical tissue assessment for over a century, with a resource-intensive workflow involving biopsy or excision, gross examination, sampling, tissue processing to snap frozen or formalin-fixed paraffin-embedded blocks, sectioning, staining, optical imaging, and microscopic assessment. Emerging chemical imaging approaches, including stimulated Raman scattering (SRS) microscopy, can directly measure inherent molecular composition in tissue (thereby dispensing with the need for tissue processing, sectioning, and using dyes) and can use artificial intelligence (AI) algorithms to provide high-quality images. Here we show the integration of SRS microscopy in a pathology workflow to rapidly record chemical information from minimally processed fresh-frozen prostate tissue. Instead of using thin sections, we record data from intact thick tissues and use optical sectioning to generate images from multiple planes. We use a deep learning–based processing pipeline to generate virtual hematoxylin and eosin images. Next, we extend the computational method to generate archival-quality images in minutes, which are equivalent to those obtained from hours/days-long formalin-fixed, paraffin-embedded processing. We assessed the quality of images from the perspective of enabling pathologists to make decisions, demonstrating that the virtual stained image quality was diagnostically useful and the interpathologist agreement on prostate cancer grade was not impacted. Finally, because this method does not wash away lipids and small molecules, we assessed the utility of lipid chemical composition in determining grade. Together, the combination of chemical imaging and AI provides novel capabilities for rapid assessments in pathology by reducing the complexity and burden of current workflows.

SIGNIFICANCE

Archival-quality (formalin-fixed paraffin-embedded), thin-section diagnostic images are obtained from thick-cut, fresh-frozen prostate tissues without dyes or stains to expedite cancer histopathology by combining SRS microscopy and machine learning.

A machine learning model for predicting the three-year survival status of patients with hypopharyngeal squamous cell carcinoma using multiple parameters

OBJECTIVE

This study aimed to establish a model for predicting the three-year survival status of patients with hypopharyngeal squamous cell carcinoma using artificial intelligence algorithms.

METHOD

Data from 295 patients with hypopharyngeal squamous cell carcinoma were analysed retrospectively. Training sets comprised 70 per cent of the data and test sets the remaining 30 per cent. A total of 22 clinical parameters were included as training features. In total, 12 different types of machine learning algorithms were used for model construction. Accuracy, sensitivity, specificity, area under the receiver operating characteristic curve and Cohen's kappa co-efficient were used to evaluate model performance.

RESULTS

The XGBoost algorithm achieved the best model performance. Accuracy, sensitivity, specificity, area under the receiver operating characteristic curve and kappa value of the model were 80.9 per cent, 92.6 per cent, 62.9 per cent, 77.7 per cent and 58.1 per cent, respectively.

CONCLUSION

This study successfully identified a machine learning model for predicting three-year survival status for patients with hypopharyngeal squamous cell carcinoma that can offer a new prognostic evaluation method for the clinical treatment of these patients.

A microfluidic approach for label-free identification of small-sized microplastics in seawater

Marine microplastics are emerging as a growing environmental concern due to their potential harm to marine biota. The substantial variations in their physical and chemical properties pose a significant challenge when it comes to sampling and characterizing small-sized microplastics. In this study, we introduce a novel microfluidic approach that simplifies the trapping and identification process of microplastics in surface seawater, eliminating the need for labeling. We examine various models, including support vector machine, random forest, convolutional neural network (CNN), and residual neural network (ResNet34), to assess their performance in identifying 11 common plastics. Our findings reveal that the CNN method outperforms the other models, achieving an impressive accuracy of 93% and a mean area under the curve of 98 ± 0.02%. Furthermore, we demonstrate that miniaturized devices can effectively trap and identify microplastics smaller than 50 µm. Overall, this proposed approach facilitates efficient sampling and identification of small-sized microplastics, potentially contributing to crucial long-term monitoring and treatment efforts.

An Unsupervised Learning-Based Regional Deformable Model for Automated Multi-Organ Contour Propagation

The aim of this study is to evaluate a regional deformable model based on a deep unsupervised learning model for automatic contour propagation in breast cone-beam computed tomography-guided adaptive radiation therapy. A deep unsupervised learning model was introduced to map breast's tumor bed, clinical target volume, heart, left lung, right lung, and spinal cord from planning computed tomography to cone-beam CT. To improve the traditional image registration method's performance, we used a regional deformable framework based on the narrow-band mapping, which can mitigate the effect of the image artifacts on the cone-beam CT. We retrospectively selected 373 anonymized cone-beam CT volumes from 111 patients with breast cancer. The cone-beam CTs are divided into three sets. 311 / 20 / 42 cone-beam CT images were used for training, validating, and testing. The manual contour was used as reference for the testing set. We compared the results between the reference and the model prediction for evaluating the performance. The mean Dice between manual reference segmentations and the model predicted segmentations for breast tumor bed, clinical target volume, heart, left lung, right lung, and spinal cord were 0.78 ± 0.09, 0.90 ± 0.03, 0.88 ± 0.04, 0.94 ± 0.03, 0.95 ± 0.02, and 0.77 ± 0.07, respectively. The results demonstrated a good agreement between the reference and the proposed contours. The proposed deep learning-based regional deformable model technique can automatically propagate contours for breast cancer adaptive radiotherapy. Deep learning in contour propagation was promising, but further investigation was warranted.

Toward next-generation endoscopes integrating biomimetic video systems, nonlinear optical microscopy, and deep learning

According to the World Health Organization, the proportion of the world's population over 60 years will approximately double by 2050. This progressive increase in the elderly population will lead to a dramatic growth of age-related diseases, resulting in tremendous pressure on the sustainability of healthcare systems globally. In this context, finding more efficient ways to address cancers, a set of diseases whose incidence is correlated with age, is of utmost importance. Prevention of cancers to decrease morbidity relies on the identification of precursor lesions before the onset of the disease, or at least diagnosis at an early stage. In this article, after briefly discussing some of the most prominent endoscopic approaches for gastric cancer diagnostics, we review relevant progress in three emerging technologies that have significant potential to play pivotal roles in next-generation endoscopy systems: biomimetic vision (with special focus on compound eye cameras), non-linear optical microscopies, and Deep Learning. Such systems are urgently needed to enhance the three major steps required for the successful diagnostics of gastrointestinal cancers: detection, characterization, and confirmation of suspicious lesions. In the final part, we discuss challenges that lie en route to translating these technologies to next-generation endoscopes that could enhance gastrointestinal imaging, and depict a possible configuration of a system capable of (i) biomimetic endoscopic vision enabling easier detection of lesions, (ii) label-free in vivo tissue characterization, and (iii) intelligently automated gastrointestinal cancer diagnostic.

Evaluating Differentiation Status of Mesenchymal Stem Cells by Label-Free Microscopy System and Machine Learning

Mesenchymal stem cells (MSCs) play a crucial role in tissue engineering, as their differentiation status directly affects the quality of the final cultured tissue, which is critical to the success of transplantation therapy. Furthermore, the precise control of MSC differentiation is essential for stem cell therapy in clinical settings, as low-purity stem cells can lead to tumorigenic problems. Therefore, to address the heterogeneity of MSCs during their differentiation into adipogenic or osteogenic lineages, numerous label-free microscopic images were acquired using fluorescence lifetime imaging microscopy (FLIM) and stimulated Raman scattering (SRS), and an automated evaluation model for the differentiation status of MSCs was built based on the K-means machine learning algorithm. The model is capable of highly sensitive analysis of individual cell differentiation status, so it has great potential for stem cell differentiation research.

Determination of esophageal squamous cell carcinoma and gastric adenocarcinoma on raw tissue using Raman spectroscopy

BACKGROUND

Cancer detection is a global research focus, and novel, rapid, and label-free techniques are being developed for routine clinical practice. This has led to the development of new tools and techniques from the bench side to routine clinical practice. In this study, we present a method that uses Raman spectroscopy (RS) to detect cancer in unstained formalin-fixed, resected specimens of the esophagus and stomach. Our method can record a clear Raman-scattered light spectrum in these specimens, confirming that the Raman-scattered light spectrum changes because of the histological differences in the mucosal tissue.

AIM

To evaluate the use of Raman-scattered light spectrum for detecting endoscop-ically resected specimens of esophageal squamous cell carcinoma (SCC) and gastric adenocarcinoma (AC).

METHODS

We created a Raman device that is suitable for observing living tissues, and attempted to acquire Raman-scattered light spectra in endoscopically resected specimens of six esophageal tissues and 12 gastric tissues. We evaluated formalin-fixed tissues using this technique and captured shifts at multiple locations based on feasibility, ranging from six to 19 locations 200 microns apart in the vertical and horizontal directions. Furthermore, a correlation between the obtained Raman scattered light spectra and histopathological diagnosis was performed.

RESULTS

We successfully obtained Raman scattered light spectra from all six esophageal and 12 gastric specimens. After data capture, the tissue specimens were sent for histopathological analysis for further processing because RS is a label-free methodology that does not cause tissue destruction or alterations. Based on data analysis of molecular-level substrates, we established cut-off values for the diagnosis of esophageal SCC and gastric AC. By analyzing specific Raman shifts, we developed an algorithm to identify the range of esophageal SCC and gastric AC with an accuracy close to that of histopathological diagnoses.

CONCLUSION

Our technique provides qualitative information for real-time morphological diagnosis. However, further in vivo evaluations require an excitation light source with low human toxicity and large amounts of data for validation.

Accurate and Rapid Detection of Peritoneal Metastasis from Gastric Cancer by AI-Assisted Stimulated Raman Molecular Cytology

Peritoneal metastasis (PM) is the mostcommon form of distant metastasis and one of the leading causes of death in gastriccancer (GC). For locally advanced GC, clinical guidelines recommend peritoneal lavage cytology for intraoperative PM detection. Unfortunately, current peritoneal lavage cytology is limited by low sensitivity (<60%). Here the authors established the stimulated Raman molecular cytology (SRMC), a chemical microscopy-based intelligent cytology. The authors firstly imaged 53 951 exfoliated cells in ascites obtained from 80 GC patients (27 PM positive, 53 PM negative). Then, the authors revealed 12 single cell features of morphology and composition that are significantly different between PM positive and negative specimens, including cellular area, lipid protein ratio, etc. Importantly, the authors developed a single cell phenotyping algorithm to further transform the above raw features to feature matrix. Such matrix is crucial to identify the significant marker cell cluster, the divergence of which is finally used to differentiate the PM positive and negative. Compared with histopathology, the gold standard of PM detection, their SRMC method could reach 81.5% sensitivity, 84.9% specificity, and the AUC of 0.85, within 20 minutes for each patient. Together, their SRMC method shows great potential for accurate and rapid detection of PM from GC.

Artificial Intelligence and Laryngeal Cancer: From Screening to Prognosis: A State of the Art Review

OBJECTIVE

This state of the art review aims to examine contemporary advances in applications of artificial intelligence (AI) to the screening, detection, management, and prognostication of laryngeal cancer (LC).

DATA SOURCES

Four bibliographic databases were searched: PubMed, EMBASE, Cochrane, and IEEE.

REVIEW METHODS

A structured review of the current literature (up to January 2022) was performed. Search terms related to topics of AI in LC were identified and queried by 2 independent reviewers. Citations of selected studies and review articles were also evaluated to ensure comprehensiveness.

CONCLUSIONS

AI applications in LC have encompassed a variety of data modalities, including radiomics, genomics, acoustics, clinical data, and videomics, to support screening, diagnosis, therapeutic decision making, and prognosis. However, most studies remain at the proof-of-concept level, as AI algorithms are trained on single-institution databases with limited data sets and a single data modality.

IMPLICATIONS FOR PRACTICE

AI algorithms in LC will need to be trained on large multi-institutional data sets and integrate multimodal data for optimal performance and clinical utility from screening to prognosis. Out of the data types reviewed, genomics has the most potential to provide generalizable models thanks to available large multi-institutional open access genomic data sets. Voice acoustic data represent an inexpensive and accurate biomarker, which is easy and noninvasive to capture, offering a unique opportunity for screening and monitoring of LA, especially in low-resource settings.

Region-resolved multi-omics of the mouse eye

The eye is a complex organ consisting of multiple compartments with unique and specialized properties, and small disturbances in one eye region can result in impaired vision and blindness. Although there have been advancements in ocular research, the hierarchical molecular network in region-wide resolution, indicating the division of labor and crosstalk among different eye regions, is not yet comprehensively illuminated. Here, we present an atlas of region-resolved proteome and lipidome of mouse eye. Multiphoton microscopy-guided laser microdissection combined with in-depth label-free proteomics identifies 13,536 proteins across various mouse eye regions. Further integrative analysis of spectral imaging, label-free proteome, and imaging mass spectrometry of the lipidome and phosphoproteome reveals distinctive molecular features, including proteins and lipids of various anatomical mouse eye regions. These deposited datasets and our open proteome server integrating all information provide a valuable resource for future functional and mechanistic studies of mouse eye and ocular disease.

Tutorial: multiphoton microscopy to advance neuroscience research

Multiphoton microscopy (MPM) employs ultrafast infrared lasers for high-resolution deep three-dimensional imaging of live biological samples. The goal of this tutorial is to provide a practical guide to MPM imaging for novice microscopy developers and life-science users. Principles of MPM, microscope setup, and labeling strategies are discussed. Use of MPM to achieve unprecedented imaging depth of whole mounted explants and intravital imaging via implantable glass windows of the mammalian nervous system is demonstrated.

Stimulated Raman Scattering Microscopy Enables Gleason Scoring of Prostate Core Needle Biopsy by a Convolutional Neural Network

Focal therapy (FT) has been proposed as an approach to eradicate clinically significant prostate cancer while preserving the normal surrounding tissues to minimize treatment-related toxicity. Rapid histology of core needle biopsies is essential to ensure the precise FT for localized lesions and to determine tumor grades. However, it is difficult to achieve both high accuracy and speed with currently available histopathology methods. Here, we demonstrated that stimulated Raman scattering (SRS) microscopy could reveal the largely heterogeneous histologic features of fresh prostatic biopsy tissues in a label-free and near real-time manner. A diagnostic convolutional neural network (CNN) built based on images from 61 patients could classify Gleason patterns of prostate cancer with an accuracy of 85.7%. An additional 22 independent cases introduced as external test dataset validated the CNN performance with 84.4% accuracy. Gleason scores of core needle biopsies from 21 cases were calculated using the deep learning SRS system and showed a 71% diagnostic consistency with grading from three pathologists. This study demonstrates the potential of a deep learning-assisted SRS platform in evaluating the tumor grade of prostate cancer, which could help simplify the diagnostic workflow and provide timely histopathology compatible with FT treatment.

SIGNIFICANCE

A platform combining stimulated Raman scattering microscopy and a convolutional neural network provides rapid histopathology and automated Gleason scoring on fresh prostate core needle biopsies without complex tissue processing.

Combined Morphological and Spectroscopic Diagnostic of HER2 Expression in Breast Cancer Tissues Based on Label-Free Surface-Enhanced Raman Scattering

Breast cancer is the most commonly diagnosed cancer type worldwide. Overexpression of human epidermal growth factor receptor 2 (HER2) is an important subtype of breast cancer and results in an increased risk of recurrence and metastasis in patients. At present, immunohistochemistry (IHC) is used to detect the expression of HER2 in breast cancer tissues as the golden standard. However, IHC has some shortcomings, such as large subjective impact, long time consumption, expensive reagents, etc. In this paper, a combined morphological and spectroscopic diagnostic method based on label-free surface-enhanced Raman scattering (SERS) for HER2 expression in breast cancer is proposed. It can not only quantitively detect HER2 expression in breast cancer tissues by spectroscopic measurements but also give morphological images reflecting the distribution of HER2 in tissues. The results show that the consistency between this method and IHC is 95% and achieves the annotation of tumor regions on tissue sections. This method is time-consuming, quantifiable, intuitive, scalable, and easy to understand. Combined with deep learning approaches, it is expected to promote the development of clinical detection and diagnosis technology for breast cancer and other cancers.

Advanced Techniques in Head and Neck Cancer Imaging: Guide to Precision Cancer Management

Precision treatment requires precision imaging. With the advent of various advanced techniques in head and neck cancer treatment, imaging has become an integral part of the multidisciplinary approach to head and neck cancer care from diagnosis to staging and also plays a vital role in response evaluation in various tumors. Conventional anatomic imaging (CT scan, MRI, ultrasound) remains basic and focuses on defining the anatomical extent of the disease and its spread. Accurate assessment of the biological behavior of tumors, including tumor cellularity, growth, and response evaluation, is evolving with recent advances in molecular, functional, and hybrid/multiplex imaging. Integration of these various advanced diagnostic imaging and nonimaging methods aids understanding of cancer pathophysiology and provides a more comprehensive evaluation in this era of precision treatment. Here we discuss the current status of various advanced imaging techniques and their applications in head and neck cancer imaging.

Histological diagnosis of unprocessed breast core-needle biopsy via stimulated Raman scattering microscopy and multi-instance learning

Core-needle biopsy (CNB) plays a vital role in the initial diagnosis of breast cancer. However, the complex tissue processing and global shortage of pathologists have hindered traditional histopathology from timely diagnosis on fresh biopsies. In this work, we developed a full digital platform by integrating label-free stimulated Raman scattering (SRS) microscopy with weakly-supervised learning for rapid and automated cancer diagnosis on un-labelled breast CNB. Methods: We first compared the results of SRS imaging with standard hematoxylin and eosin (H&E) staining on adjacent frozen tissue sections. Then fresh unprocessed biopsy tissues were imaged by SRS to reveal diagnostic histoarchitectures. Next, weakly-supervised learning, i.e., the multi-instance learning (MIL) model was conducted to evaluate the ability to differentiate between benign and malignant cases, and compared with the performance of supervised learning model. Finally, gradient-weighted class activation mapping (Grad-CAM) and semantic segmentation were performed to spatially resolve benign/malignant areas with high efficiency. Results: We verified the ability of SRS in revealing essential histological hallmarks of breast cancer in both thin frozen sections and fresh unprocessed biopsy, generating histoarchitectures well correlated with H&E staining. Moreover, we demonstrated that weakly-supervised MIL model could achieve superior classification performance to supervised learnings, reaching diagnostic accuracy of 95% on 61 biopsy specimens. Furthermore, Grad-CAM allowed the trained MIL model to visualize the histological heterogeneity within the CNB. Conclusion: Our results indicate that MIL-assisted SRS microscopy provides rapid and accurate diagnosis on histologically heterogeneous breast CNB, and could potentially help the subsequent management of patients.

Determination of blood species using echelle Raman spectrometer and surface enhanced Raman spectroscopy

Blood species identification of human and animals has attracted much attention in the areas of customs inspection and forensic science. The combination of vibrational spectroscopy and machine learning has been proven to be feasible and effective for this purpose. However, the popularization of this technology needs instrument which is compact, robust and more suitable for field application. Besides the quantity of the blood sample should be as little as possible. In this study, we proposed a system using echelle Raman spectrometer combined with surface enhanced Raman spectroscopy (SERS), which protocol combines the advantages of broadband and high resolution of echelle Raman spectrometer with the advantages of high SERS spectral sensitivity. The SERS spectra of 26 species including human were collected with echelle Raman spectrometer, and the convolutional neural network was used for species identification, with an accuracy rate of over 94%. The feasibility, validity and reliability of the combination of echelle Raman spectrometer and SERS for blood species identification were realized.

Stimulated Raman Histology for Rapid Intra-Operative Diagnosis of Sinonasal and Skull Base Tumors

OBJECTIVE

Intra-operative stimulated Raman histology (SRH) is a novel technology that uses laser spectroscopy and color-matching algorithms to create images similar to the formalin-fixed paraffin-embedded (FFPE) section. We aim to assess the accuracy of SRH in a novel range of sinonasal and skull base tumors.

METHODS

Select patients undergoing sinonasal and skull base surgery using the Invenio Imaging™ Nio™ Laser Imaging SRH system between June 2020 and September 2021 were assessed. The SRH images were reviewed for pathologic features similar to frozen section (FS) and FFPE. Time taken for results and diagnostic concordance was assessed.

RESULTS

Sixty-seven SRH images from 7 tumor types in 12 patients were assessed. Pathologies included squamous cell carcinoma, rhabdomyosarcoma, inverted papilloma, adenoid cystic carcinoma, SMARCB1-deficient sinonasal carcinoma, mucosal melanoma, metastatic colonic adenocarcinoma, and meningioma. Tumor was identified in 100% of lesional specimens, with characteristic diagnostic features readily appreciable on SRH. Median time for diagnosis was significantly faster for SRH (4.3 min) versus FS (44.5 min; p = <.0001). Where SRH sample site matched precisely to FS (n = 32/67, 47.8%), the same diagnosis was confirmed in 93.8%. Sensitivity, specificity, precision, and overall accuracy of SRH were 93.3%, 94.1%, 93.8%, and 93.3%, respectively. Near-perfect concordance was seen between SRH and FS (Cohen's kappa [κ] = 0.89).

CONCLUSION

Stimulated Raman histology can rapidly produce images similar to FFPE H&E in sinonasal and skull base tumors. This technology has the potential to act as an adjunct or alternative to standard FS.

LEVEL OF EVIDENCE

4 Laryngoscope, 132:2142-2147, 2022.

Pixel-level multimodal fusion deep networks for predicting subcellular organelle localization from label-free live-cell imaging

Complex intracellular organizations are commonly represented by dividing the metabolic process of cells into different organelles. Therefore, identifying sub-cellular organelle architecture is significant for understanding intracellular structural properties, specific functions, and biological processes in cells. However, the discrimination of these structures in the natural organizational environment and their functional consequences are not clear. In this article, we propose a new pixel-level multimodal fusion (PLMF) deep network which can be used to predict the location of cellular organelle using label-free cell optical microscopy images followed by deep-learning-based automated image denoising. It provides valuable insights that can be of tremendous help in improving the specificity of label-free cell optical microscopy by using the Transformer-Unet network to predict the ground truth imaging which corresponds to different sub-cellular organelle architectures. The new prediction method proposed in this article combines the advantages of a transformer's global prediction and CNN's local detail analytic ability of background features for label-free cell optical microscopy images, so as to improve the prediction accuracy. Our experimental results showed that the PLMF network can achieve over 0.91 Pearson's correlation coefficient (PCC) correlation between estimated and true fractions on lung cancer cell-imaging datasets. In addition, we applied the PLMF network method on the cell images for label-free prediction of several different subcellular components simultaneously, rather than using several fluorescent labels. These results open up a new way for the time-resolved study of subcellular components in different cells, especially for cancer cells.

Fluorescence lifetime image microscopy prediction with convolutional neural networks for cell detection and classification in tissues

Convolutional neural networks (CNNs) and other deep-learning models have proven to be transformative tools for the automated analysis of microscopy images, particularly in the domain of cellular and tissue imaging. These computer-vision models have primarily been applied with traditional microscopy imaging modalities (e.g. brightfield and fluorescence), likely due to the availability of large datasets in these regimes. However, more advanced microscopy imaging techniques could, potentially, allow for improved model performance in various computational histopathology tasks. In this work, we demonstrate that CNNs can achieve high accuracy in cell detection and classification without large amounts of data when applied to histology images acquired by fluorescence lifetime imaging microscopy (FLIM). This accuracy is higher than what would be achieved with regular single or dual-channel fluorescence images under the same settings, particularly for CNNs pretrained on publicly available fluorescent cell or general image datasets. Additionally, generated FLIM images could be predicted from just the fluorescence image data by using a dense U-Net CNN model trained on a subset of ground-truth FLIM images. These U-Net CNN generated FLIM images demonstrated high similarity to ground truth and improved accuracy in cell detection and classification over fluorescence alone when used as input to a variety of commonly used CNNs. This improved accuracy was maintained even when the FLIM images were generated by a U-Net CNN trained on only a few example FLIM images.

Squamous Cell Carcinoma of Skin Cancer Margin Classification From Digital Histopathology Images Using Deep Learning

Objectives

Now a days, squamous cell carcinoma (SCC) margin assessment is done by examining histopathology images and inspection of whole slide images (WSI) using a conventional microscope. This is time-consuming, tedious, and depends on experts’ experience which may lead to misdiagnosis and mistreatment plans. This study aims to develop a system for the automatic diagnosis of skin cancer margin for squamous cell carcinoma from histopathology microscopic images by applying deep learning techniques.

Methods

The system was trained, validated, and tested using histopathology images of SCC cancer locally acquired from Jimma Medical Center Pathology Department from seven different skin sites using an Olympus digital microscope. All images were preprocessed and trained with transfer learning pre-trained models by fine-tuning the hyper-parameter of the selected models.

Results

The overall best training accuracy of the models become 95.3%, 97.1%, 89.8%, and 89.9% on EffecientNetB0, MobileNetv2, ResNet50, VGG16 respectively. In addition to this, the best validation accuracy of the models was 94.7%, 91.8%, 87.8%, and 86.7% respectively. The best testing accuracy of the models at the same epoch was 95.2%, 91.5%, 87%, and 85.5% respectively. From these models, EfficientNetB0 showed the best average training and testing accuracy than the other models.

Conclusions

The system assists the pathologist during the margin assessment of SCC by decreasing the diagnosis time from an average of 25 minutes to less than a minute.

Multiple Parallel Fusion Network for Predicting Protein Subcellular Localization from Stimulated Raman Scattering (SRS) Microscopy Images in Living Cells

Stimulated Raman Scattering Microscopy (SRS) is a powerful tool for label-free detailed recognition and investigation of the cellular and subcellular structures of living cells. Determining subcellular protein localization from the cell level of SRS images is one of the basic goals of cell biology, which can not only provide useful clues for their functions and biological processes but also help to determine the priority and select the appropriate target for drug development. However, the bottleneck in predicting subcellular protein locations of SRS cell imaging lies in modeling complicated relationships concealed beneath the original cell imaging data owing to the spectral overlap information from different protein molecules. In this work, a multiple parallel fusion network, MPFnetwork, is proposed to study the subcellular locations from SRS images. This model used a multiple parallel fusion model to construct feature representations and combined multiple nonlinear decomposing algorithms as the automated subcellular detection method. Our experimental results showed that the MPFnetwork could achieve over 0.93 dice correlation between estimated and true fractions on SRS lung cancer cell datasets. In addition, we applied the MPFnetwork method to cell images for label-free prediction of several different subcellular components simultaneously, rather than using several fluorescent labels. These results open up a new method for the time-resolved study of subcellular components in different cells, especially cancer cells.

[Application of Raman-based technologies in the detection of urological tumors]

Urinary system tumors affect a huge number of individuals, and are frequently recurrent and progressing following surgery, necessitating lifelong surveillance. As a result, early and precise diagnosis of urinary system cancers is important for prevention and therapy. Histopathology is now the golden stan-dard for the diagnosis, but it is invasive, time-consuming, and inconvenient for initial diagnosis and re-gular follow-up assessment. Endoscopy can directly witness the tumor's structure, but intrusive detection is likely to cause harm to the patient's organs, and it is apt to create other hazards in frequently examined patients. Imaging is a valuable non-invasive and quick assessment tool; however, it can be difficult to define the type of lesions and has limited sensitivity for early tumor detection. The conventional approaches for detecting tumors have their own set of limitations. Thus, detection methods that combine non-invasive detection, label-free detection, high sensitivity and high specificity are urgently needed to aid clinical diagnosis. Optical diagnostics and imaging are increasingly being employed in healthcare settings in a variety of sectors. Raman scattering can assess changes in molecular signatures in cancer cells or tissues based on the interaction with vibrational modes of common molecular bonds. Due to the advantages of label-free, strong chemical selectivity, and high sensitivity, Raman scattering, especially coherent Raman scattering microscopy imaging with high spatial resolution, has been widely used in biomedical research. And quantity studies have shown that it has a good application in the detection and diagnosis of bladder can-cer, renal clear cell carcinoma, prostate cancer, and other cancers. In this paper, several nonlinear imaging techniques based on Raman scattering technology are briefly described, including Raman spectroscopy, coherent anti-Stokes Raman scattering, stimulated Raman scattering, and surface-enhanced Raman spectroscopy. And we will discuss the application of these techniques for detecting urologic malignancy. Future research directions are predicted using the advantages and limitations of the aforesaid methodologies in the research. For clinical practice, Raman scattering technology is intended to enable more accurate, rapid, and non-invasive in early diagnosis, intraoperative margins, and pathological grading basis for clinical practice.

Instant diagnosis of gastroscopic biopsy via deep-learned single-shot femtosecond stimulated Raman histology

Gastroscopic biopsy provides the only effective method for gastric cancer diagnosis, but the gold standard histopathology is time-consuming and incompatible with gastroscopy. Conventional stimulated Raman scattering (SRS) microscopy has shown promise in label-free diagnosis on human tissues, yet it requires the tuning of picosecond lasers to achieve chemical specificity at the cost of time and complexity. Here, we demonstrate that single-shot femtosecond SRS (femto-SRS) reaches the maximum speed and sensitivity with preserved chemical resolution by integrating with U-Net. Fresh gastroscopic biopsy is imaged in <60 s, revealing essential histoarchitectural hallmarks perfectly agreed with standard histopathology. Moreover, a diagnostic neural network (CNN) is constructed based on images from 279 patients that predicts gastric cancer with accuracy >96%. We further demonstrate semantic segmentation of intratumor heterogeneity and evaluation of resection margins of endoscopic submucosal dissection (ESD) tissues to simulate rapid and automated intraoperative diagnosis. Our method holds potential for synchronizing gastroscopy and histopathological diagnosis.

Diagnosis of gastric cancer currently requires gastroscopic biopsy, which requires time and expertize to perform. Here, the authors demonstrate a femto-SRS imaging method which showed high accuracy in diagnosing gastric cancer without the need for pathologistbased diagnosis.

Quantitative Stimulated Raman Scattering Microscopy: Promises and Pitfalls

Since its first demonstration, stimulated Raman scattering (SRS) microscopy has become a powerful chemical imaging tool that shows promise in numerous biological and biomedical applications. The spectroscopic capability of SRS enables identification and tracking of specific molecules or classes of molecules, often without labeling. SRS microscopy also has the hallmark advantage of signal strength that is directly proportional to molecular concentration, allowing for in situ quantitative analysis of chemical composition of heterogeneous samples with submicron spatial resolution and subminute temporal resolution. However, it is important to recognize that quantification through SRS microscopy requires assumptions regarding both system and sample. Such assumptions are often taken axiomatically, which may lead to erroneous conclusions without proper validation. In this review, we focus on the tacitly accepted, yet complex, quantitative aspect of SRS microscopy. We discuss the various approaches to quantitative analysis, examples of such approaches, challenges in different systems, and potential solutions. Through our examination of published literature, we conclude that a scrupulous approach to experimental design can further expand the powerful and incisive quantitative capabilities of SRS microscopy.

Raman spectroscopy and multivariate analysis as potential tool to follow Alzheimer's disease progression

Raman spectroscopy is an emerging tool in the research and diagnosis of different diseases, including neurodegenerative disorders. In this work, blood serum samples collected from healthy controls and dementia patients were analysed by Raman spectroscopy to develop a classification model for the diagnosis of dementia of Alzheimer’s type (DAT). Raman spectra were processed by means of multivariate tools for multivariate analysis. Lower concentration levels of carotenoids were detected in blood serum from patients, which allowed for a good discrimination with respect to controls, such as 93% of correct predictions on the test set with random forest. We also hypothesize that carotenoid levels might be informative about the severity and progression of the disease, since the intensity of carotenoid signals decreased from the early stage to more severe patients. These encouraging results suggest the possibility to use Raman spectroscopy for the analysis of alternative biofluids (e.g. saliva) and the unobtrusive diagnosis of other neurodegenerative disorders.

An immune-related lncRNA pairs signature to identify the prognosis and predict the immune landscape of laryngeal squamous cell carcinoma

Background

Laryngeal squamous cell carcinoma (LSCC) is the most common squamous cell carcinoma. Though significant effort has been focused on molecular pathogenesis, development, and recurrence of LSCC, little is known about its relationship with the immune-related long non-coding RNA (lncRNA) pairs.

Methods

After obtaining the transcriptome profiling data sets and the corresponding clinical characteristics of LSCC patients and normal samples from The Cancer Genome Atlas (TCGA) database, a series of bioinformatic analysis was conducted to select the differently expressed immune-related lncRNAs and build a signature of immune-related lncRNA pairs. Then, the effectiveness of the signature was validated.

Results

A total of 111 LSCC patients and 12 normal samples’ transcriptome profiling data sets were retrieved from TCGA. 301 differently expressed immune-related lncRNAs were identified and 35,225 lncRNA pairs were established. After univariate Cox analysis, LASSO regression and multivariate Cox analysis, 7 lncRNA pairs were eventually selected to construct a signature. The riskscore was computed using the following formula: Riskscore = 0.95 × (AL133330.1|AC132872.3) + (-1.23)  × (LINC01094|LINC02154) + 0.65 × (LINC02575|AC122685.1) + (-1.15)  × (MIR9-3HG|LINC01748) + 1.45 × (AC092687.3|SNHG12) + (-0.87)  × (AC090204.1|AL158166.1) + 0.64 × (LINC01063|Z82243.1). Patients were classified into the high-risk group (> 1.366) and the low-risk group (< 1.366) according to the cutoff value (1.366), which is based on the 5-year riskscore ROC curve. The survival analysis showed that the low-risk group had a better prognosis (P < 0.001). The riskscore was better than other clinical characteristics in prognostic prediction and the area under the curves (AUCs) for the 1-, 3-, and 5-year survivals were 0.796, 0.946, and 0.895, respectively. Combining age, gender, grade, stage, and riskscore, a nomograph was developed to predict survival probability in LSCC patients. Then, the riskscore was confirmed to be related with the content of tumor-infiltration immune cells and the model could serve as a potential predictor for chemosensitivity.

Conclusion

We successfully established a more stable signature of 7 immune-related lncRNA pairs, which has demonstrated a better prognostic ability for LSCC patients and may assist clinicians to precisely prescribe chemo drugs.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-022-09524-1.

Deep learning-based image processing in optical microscopy

Optical microscopy has emerged as a key driver of fundamental research since it provides the ability to probe into imperceptible structures in the biomedical world. For the detailed investigation of samples, a high-resolution image with enhanced contrast and minimal damage is preferred. To achieve this, an automated image analysis method is preferable over manual analysis in terms of both speed of acquisition and reduced error accumulation. In this regard, deep learning (DL)-based image processing can be highly beneficial. The review summarises and critiques the use of DL in image processing for the data collected using various optical microscopic techniques. In tandem with optical microscopy, DL has already found applications in various problems related to image classification and segmentation. It has also performed well in enhancing image resolution in smartphone-based microscopy, which in turn enablse crucial medical assistance in remote places.

Graphical abstract

Future-Oriented Advanced Diarylethene Photoswitches: From Molecular Design to Spontaneous Assembly Systems

Diarylethene (DAE) photoswitch is a new and promising family of photochromic molecules and has shown superior performance as a smart trigger in stimulus-responsive materials. During the past few decades, the DAE family has achieved a leap from simple molecules to functional molecules and developed toward validity as a universal switching building block. In recent years, the introduction of DAE into an assembly system has been an attractive strategy that enables the photochromic behavior of the building blocks to be manifested at the level of the entire system, beyond the DAE unit itself. This assembly-based strategy will bring many unexpected results that promote the design and manufacture of a new generation of advanced materials. Here, recent advances in the design and fabrication of diarylethene as a trigger in materials science, chemistry, and biomedicine are reviewed.

High-Precision Intelligent Cancer Diagnosis Method: 2D Raman Figures Combined with Deep Learning

Raman spectroscopy, as a label-free detection technology, has been widely used in tumor diagnosis. However, most tumor diagnosis procedures utilize multivariate statistical analysis methods for classification, which poses a major bottleneck toward achieving high accuracy. Here, we propose a concept called the two-dimensional (2D) Raman figure combined with convolutional neural network (CNN) to improve the accuracy. Two-dimensional Raman figures can be obtained from four transformation methods: spectral recurrence plot (SRP), spectral Gramian angular field (SGAF), spectral short-time Fourier transform (SSTFT), and spectral Markov transition field (SMTF). Two-dimensional CNN models all yield more than 95% accuracy, which is higher than the PCA-LDA method and the Raman-spectrum-CNN method, indicating that 2D Raman figure inputs combined with CNN may be one reason for gaining excellent performances. Among 2D-CNN models, the main difference is the conversion, where SRP is based on the structure of wavenumber series with the best performances (98.9% accuracy, 99.5% sensitivity, 98.3% specificity), followed by SGAF on the wavenumber series, SSTFT on wavenumber and intensity information, and SMTF on wavenumber position information. The inclusion of external information in the conversion may be another reason for improvement in the accuracy. The excellent capability shows huge potential for tumor diagnosis via 2D Raman figures and may be applied in other spectroscopy analytical fields.

Quantitative Chemical Imaging of Bone Tissue for Intraoperative and Diagnostic Applications

Bone is difficult to image using traditional histopathological methods, leading to challenges in intraoperative pathological evaluation that is critical in guiding surgical treatment, particularly in orthopedic oncology. In this study, we demonstrate that a multimodal quantitative imaging approach that combines stimulated Raman scattering (SRS) microscopy, two-photon fluorescence (TPF) microscopy, and second-harmonic generation (SHG) microscopy can provide useful diagnostic information regarding intact bone tissue fragments from surgical excision or biopsy specimens. We imaged bone samples from 17 patient cases and performed quantitative chemical and morphological analyses of both mineral and organic components of bone. Our main findings show that carbonate content combined with morphometric analysis of bone organic matrix can separate several major classes of bone cancer-associated diagnostic categories with an average accuracy of 92%. This proof-of-principle study demonstrates that quantitative multimodal imaging and machine learning-based analysis of bony tissue can provide crucial diagnostic information for guiding clinical decisions in orthopedic oncology. Moreover, the general methodology of morphological and chemical imaging combined with machine learning can be readily extended to other tissue types for tissue diagnosis in intraoperative and other clinical settings.

Highly accurate diagnosis of lung adenocarcinoma and squamous cell carcinoma tissues by deep learning

Intraoperative detection of the marginal tissues is the last and most important step to complete the resection of adenocarcinoma and squamous cell carcinoma. However, the current intraoperative diagnosis is time-consuming and requires numerous steps including staining. In this paper, we present the use of Raman spectroscopy with deep learning to achieve accurate diagnosis with stain-free process. To make the spectrum more suitable for deep learning, we utilize an unusual way of thinking which regards Raman spectral signal as a sequence and then converts it into two-dimensional Raman spectrogram by short-time Fourier transform as input. The normal-adenocarcinoma deep learning model and normal-squamous carcinoma deep learning model both achieve more than 96% accuracy, 95% sensitivity and 98% specificity when test, which higher than the conventional principal components analysis-linear discriminant analysis method with normal-adenocarcinoma model (0.896 accuracy, 0.867 sensitivity, 0.926 specificity) and normal-squamous carcinoma model (0.821 accuracy, 0.776 sensitivity, 1.000 specificity). The high performance of deep learning models provides a reliable way for intraoperative detection of marginal tissue, and is expected to reduce the detection time and save human lives.

Differential characterization of lumbar spine associated tissue histology with nonlinear optical microscopy

Percutaneous endoscopic lumbar discectomy (PELD) is the major effective treatment for lumbar disc herniation, and rapid histological identification of dissected tissue is critical to guide the discectomy. In this work, we revealed the histological features of different types of peridural tissues of the lumbar spine by label-free multi-modal nonlinear optical microscopy. Stimulated Raman scattering (SRS) was used to extract lipid and protein distributions, while second harmonic generation (SHG) and two-photon excited fluorescence (TPEF) signals were applied to image the collagen and elastin fibers at the same time. Our results demonstrated that the nonlinear optical features of the dura and adjacent soft tissues were significantly different, showing the potentials of our method for intraoperative differentiation of these critical tissues and improving the surgical outcome of PELD.

Deep Convolution Neural Network for Laryngeal Cancer Classification on Contact Endoscopy-Narrow Band Imaging

(1) Background: Contact Endoscopy (CE) and Narrow Band Imaging (NBI) are optical imaging modalities that can provide enhanced and magnified visualization of the superficial vascular networks in the laryngeal mucosa. The similarity of vascular structures between benign and malignant lesions causes a challenge in the visual assessment of CE-NBI images. The main objective of this study is to use Deep Convolutional Neural Networks (DCNN) for the automatic classification of CE-NBI images into benign and malignant groups with minimal human intervention. (2) Methods: A pretrained Res-Net50 model combined with the cut-off-layer technique was selected as the DCNN architecture. A dataset of 8181 CE-NBI images was used during the fine-tuning process in three experiments where several models were generated and validated. The accuracy, sensitivity, and specificity were calculated as the performance metrics in each validation and testing scenario. (3) Results: Out of a total of 72 trained and tested models in all experiments, Model 5 showed high performance. This model is considerably smaller than the full ResNet50 architecture and achieved the testing accuracy of 0.835 on the unseen data during the last experiment. (4) Conclusion: The proposed fine-tuned ResNet50 model showed a high performance to classify CE-NBI images into the benign and malignant groups and has the potential to be part of an assisted system for automatic laryngeal cancer detection.