Research and application of tongue and face diagnosis based on deep learning

Evaluating deep learning techniques for identifying tongue features in subthreshold depression: a prospective observational study

Objective

This study aims to evaluate the potential of using tongue image features as non-invasive biomarkers for diagnosing subthreshold depression and to assess the correlation between these features and acupuncture treatment outcomes using advanced deep learning models.

Methods

We employed five advanced deep learning models-DenseNet169, MobileNetV3Small, SEResNet101, SqueezeNet, and VGG19_bn-to analyze tongue image features in individuals with subthreshold depression. These models were assessed based on accuracy, precision, recall, and F1 score. Additionally, we investigated the relationship between the best-performing model's predictions and the success of acupuncture treatment using Pearson's correlation coefficient.

Results

Among the models, SEResNet101 emerged as the most effective, achieving an impressive 98.5% accuracy and an F1 score of 0.97. A significant positive correlation was found between its predictions and the alleviation of depressive symptoms following acupuncture (Pearson's correlation coefficient = 0.72, p<0.001).

Conclusion

The findings suggest that the SEResNet101 model is highly accurate and reliable for identifying tongue image features in subthreshold depression. It also appears promising for assessing the impact of acupuncture treatment. This study contributes novel insights and approaches to the auxiliary diagnosis and treatment evaluation of subthreshold depression.

Opportunities and challenges of traditional Chinese medicine doctors in the era of artificial intelligence

With the exponential advancement of artificial intelligence (AI) technology, the realm of medicine is experiencing a paradigm shift, engendering a multitude of prospects and trials for healthcare practitioners, encompassing those devoted to the practice of traditional Chinese medicine (TCM). This study explores the evolving landscape for TCM practitioners in the AI era, emphasizing that while AI can be helpful, it cannot replace the role of TCM practitioners. It is paramount to underscore the intrinsic worth of human expertise, accentuating that artificial intelligence (AI) is merely an instrument. On the one hand, AI-enabled tools like intelligent symptom checkers, diagnostic assistance systems, and personalized treatment plans can augment TCM practitioners' expertise and capacity, improving diagnosis accuracy and treatment efficacy. AI-empowered collaborations between Western medicine and TCM can strengthen holistic care. On the other hand, AI may disrupt conventional TCM workflow and doctor-patient relationships. Maintaining the humanistic spirit of TCM while embracing AI requires upholding professional ethics and establishing appropriate regulations. To leverage AI while retaining the essence of TCM, practitioners need to hone holistic analytical skills and see AI as complementary. By highlighting promising applications and potential risks of AI in TCM, this study provides strategic insights for stakeholders to promote the integrated development of AI and TCM for better patient outcomes. With proper implementation, AI can become a valuable assistant for TCM practitioners to elevate healthcare quality.

A survey of artificial intelligence in tongue image for disease diagnosis and syndrome differentiation

The rapid development of artificial intelligence technology has gradually extended from the general field to all walks of life, and intelligent tongue diagnosis is the product of a miraculous connection between this new discipline and traditional disciplines. We reviewed the deep learning methods and machine learning applied in tongue image analysis that have been studied in the last 5 years, focusing on tongue image calibration, detection, segmentation, and classification of diseases, syndromes, and symptoms/signs. Introducing technical evolutions or emerging technologies were applied in tongue image analysis; as we have noticed, attention mechanism, multiscale features, and prior knowledge were successfully applied in it, and we emphasized the value of combining deep learning with traditional methods. We also pointed out two major problems concerned with data set construction and the low reliability of performance evaluation that exist in this field based on the basic essence of tongue diagnosis in traditional Chinese medicine. Finally, a perspective on the future of intelligent tongue diagnosis was presented; we believe that the self-supervised method, multimodal information fusion, and the study of tongue pathology will have great research significance.