1
|
Xiong D, Marcus M, Maida CA, Lyu Y, Hays RD, Wang Y, Shen J, Spolsky VW, Lee SY, Crall JJ, Liu H. Development of short forms for screening children's dental caries and urgent treatment needs using item response theory and machine learning methods. PLoS One 2024; 19:e0299947. [PMID: 38517846 PMCID: PMC10959356 DOI: 10.1371/journal.pone.0299947] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Accepted: 02/20/2024] [Indexed: 03/24/2024] Open
Abstract
OBJECTIVES Surveys can assist in screening oral diseases in populations to enhance the early detection of disease and intervention strategies for children in need. This paper aims to develop short forms of child-report and proxy-report survey screening instruments for active dental caries and urgent treatment needs in school-age children. METHODS This cross-sectional study recruited 497 distinct dyads of children aged 8-17 and their parents between 2015 to 2019 from 14 dental clinics and private practices in Los Angeles County. We evaluated responses to 88 child-reported and 64 proxy-reported oral health questions to select and calibrate short forms using Item Response Theory. Seven classical Machine Learning algorithms were employed to predict children's active caries and urgent treatment needs using the short forms together with family demographic variables. The candidate algorithms include CatBoost, Logistic Regression, K-Nearest Neighbors (KNN), Naïve Bayes, Neural Network, Random Forest, and Support Vector Machine. Predictive performance was assessed using repeated 5-fold nested cross-validations. RESULTS We developed and calibrated four ten-item short forms. Naïve Bayes outperformed other algorithms with the highest median of cross-validated area under the ROC curve. The means of best testing sensitivities and specificities using both child-reported and proxy-reported responses were 0.84 and 0.30 for active caries, and 0.81 and 0.31 for urgent treatment needs respectively. Models incorporating both response types showed a slightly higher predictive accuracy than those relying on either child-reported or proxy-reported responses. CONCLUSIONS The combination of Item Response Theory and Machine Learning algorithms yielded potentially useful screening instruments for both active caries and urgent treatment needs of children. The survey screening approach is relatively cost-effective and convenient when dealing with oral health assessment in large populations. Future studies are needed to further leverage the customize and refine the instruments based on the estimated item characteristics for specific subgroups of the populations to enhance predictive accuracy.
Collapse
Affiliation(s)
- Di Xiong
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
- Department of Biostatistics, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Marvin Marcus
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Carl A. Maida
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Yuetong Lyu
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
- Department of Biostatistics, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Ron D. Hays
- Division of General Internal Medicine and Health Services Research, Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, California, United States of America
- Department of Health Policy and Management, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, California, United States of America
- RAND Corporation, Santa Monica, California, United States of America
| | - Yan Wang
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Jie Shen
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Vladimir W. Spolsky
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Steve Y. Lee
- Sectopm of Interdisciplinary Dentistry, Division of Diagnostic and Surgical Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
| | - James J. Crall
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
| | - Honghu Liu
- Section of Public and Population Health, Division of Oral and Systemic Health Sciences, School of Dentistry, University of California, Los Angeles, Los Angeles, California, United States of America
- Department of Biostatistics, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, California, United States of America
- Division of General Internal Medicine and Health Services Research, Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, California, United States of America
| |
Collapse
|
2
|
Adeoye J, Su YX. Artificial intelligence in salivary biomarker discovery and validation for oral diseases. Oral Dis 2024; 30:23-37. [PMID: 37335832 DOI: 10.1111/odi.14641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 05/19/2023] [Accepted: 05/28/2023] [Indexed: 06/21/2023]
Abstract
Salivary biomarkers can improve the efficacy, efficiency, and timeliness of oral and maxillofacial disease diagnosis and monitoring. Oral and maxillofacial conditions in which salivary biomarkers have been utilized for disease-related outcomes include periodontal diseases, dental caries, oral cancer, temporomandibular joint dysfunction, and salivary gland diseases. However, given the equivocal accuracy of salivary biomarkers during validation, incorporating contemporary analytical techniques for biomarker selection and operationalization from the abundant multi-omics data available may help improve biomarker performance. Artificial intelligence represents one such advanced approach that may optimize the potential of salivary biomarkers to diagnose and manage oral and maxillofacial diseases. Therefore, this review summarized the role and current application of techniques based on artificial intelligence for salivary biomarker discovery and validation in oral and maxillofacial diseases.
Collapse
Affiliation(s)
- John Adeoye
- Division of Oral and Maxillofacial Surgery, Faculty of Dentistry, University of Hong Kong, Hong Kong SAR, China
| | - Yu-Xiong Su
- Division of Oral and Maxillofacial Surgery, Faculty of Dentistry, University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
3
|
Havsed K, Hänsel Petersson G, Isberg PE, Pigg M, Svensäter G, Rohlin M. Multivariable prediction models of caries increment: a systematic review and critical appraisal. Syst Rev 2023; 12:202. [PMID: 37904228 PMCID: PMC10614348 DOI: 10.1186/s13643-023-02298-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 07/28/2023] [Indexed: 11/01/2023] Open
Abstract
BACKGROUND Multivariable prediction models are used in oral health care to identify individuals with an increased likelihood of caries increment. The outcomes of the models should help to manage individualized interventions and to determine the periodicity of service. The objective was to review and critically appraise studies of multivariable prediction models of caries increment. METHODS Longitudinal studies that developed or validated prediction models of caries and expressed caries increment as a function of at least three predictors were included. PubMed, Cochrane Library, and Web of Science supplemented with reference lists of included studies were searched. Two reviewers independently extracted data using CHARMS (Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies) and assessed risk of bias and concern regarding applicability using PROBAST (Prediction model Risk Of Bias ASessment Tool). Predictors were analysed and model performance was recalculated as estimated positive (LR +) and negative likelihood ratios (LR -) based on sensitivity and specificity presented in the studies included. RESULTS Among the 765 reports identified, 21 studies providing 66 prediction models fulfilled the inclusion criteria. Over 150 candidate predictors were considered, and 31 predictors remained in studies of final developmental models: caries experience, mutans streptococci in saliva, fluoride supplements, and visible dental plaque being the most common predictors. Predictive performances varied, providing LR + and LR - ranges of 0.78-10.3 and 0.0-1.1, respectively. Only four models of coronal caries and one root caries model scored LR + values of at least 5. All studies were assessed as having high risk of bias, generally due to insufficient number of outcomes in relation to candidate predictors and considerable uncertainty regarding predictor thresholds and measurements. Concern regarding applicability was low overall. CONCLUSIONS The review calls attention to several methodological deficiencies and the significant heterogeneity observed across the studies ruled out meta-analyses. Flawed or distorted study estimates lead to uncertainty about the prediction, which limits the models' usefulness in clinical decision-making. The modest performance of most models implies that alternative predictors should be considered, such as bacteria with acid tolerant properties. TRIAL REGISTRATION PROSPERO CRD#152,467 April 28, 2020.
Collapse
Affiliation(s)
- Kristian Havsed
- Department of Pediatric Dentistry, Institute for Postgraduate Dental Education, Jönköping, Sweden.
- Centre for Oral Health, School of Health and Welfare, Jönköping University, Jönköping, Sweden.
- Faculty of Odontology, Malmö University, Malmö, Sweden.
| | | | | | - Maria Pigg
- Faculty of Odontology, Malmö University, Malmö, Sweden
| | | | | |
Collapse
|
4
|
Al-Namankany A. Influence of Artificial Intelligence-Driven Diagnostic Tools on Treatment Decision-Making in Early Childhood Caries: A Systematic Review of Accuracy and Clinical Outcomes. Dent J (Basel) 2023; 11:214. [PMID: 37754334 PMCID: PMC10530226 DOI: 10.3390/dj11090214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Revised: 08/23/2023] [Accepted: 09/11/2023] [Indexed: 09/28/2023] Open
Abstract
Early detection and accurate prediction of the risk of early childhood caries (ECC) are essential for effective prevention and management. This systematic review aims to assess the performance and applicability of machine learning algorithms in ECC prediction and detection. A comprehensive search was conducted to identify studies utilizing machine learning algorithms to predict or detect ECC. The included (n = 6) studies demonstrated high accuracy, sensitivity, specificity, and area under the receiver operating characteristic (AUC) values related to predicting and detecting ECC. The application of machine learning algorithms contributed to enhanced clinical decision-making, targeted preventive measures, and improved ECC management. The studies also highlighted the importance of considering multiple factors, including demographic, environmental, and genetic factors, when developing dental caries prediction models. Machine learning algorithms hold significant potential for ECC prediction and detection, having promising performance outcomes. Due to the heterogeneity of the studies, no meta-analysis could be performed. Moreover, further research is needed to explore the feasibility, acceptability, and effectiveness of integrating these algorithms into dental practice. This approach would ultimately contribute to enabling more effective and personalized dental caries management and improved oral health outcomes for diverse populations.
Collapse
Affiliation(s)
- Abeer Al-Namankany
- Paediatric Dentistry and Orthodontics Department, College of Dentistry, Taibah University, P.O. Box 41141, Almadinah Almunawwarah 38008, Saudi Arabia
| |
Collapse
|
5
|
Yin C, Yan B. Machine learning in basic scientific research on oral diseases. DIGITAL MEDICINE 2023; 9. [DOI: 10.1097/dm-2023-00001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
6
|
Vishwanathaiah S, Fageeh HN, Khanagar SB, Maganur PC. Artificial Intelligence Its Uses and Application in Pediatric Dentistry: A Review. Biomedicines 2023; 11:biomedicines11030788. [PMID: 36979767 PMCID: PMC10044793 DOI: 10.3390/biomedicines11030788] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2023] [Revised: 02/26/2023] [Accepted: 03/01/2023] [Indexed: 03/08/2023] Open
Abstract
In the global epidemic era, oral problems significantly impact a major population of children. The key to a child’s optimal health is early diagnosis, prevention, and treatment of these disorders. In recent years, the field of artificial intelligence (AI) has seen tremendous pace and progress. As a result, AI’s infiltration is witnessed even in those areas that were traditionally thought to be best left to human specialists. The ultimate ability to improve patient care and make precise diagnoses of illnesses has revolutionized the world of healthcare. In the field of dentistry, the competence to execute treatment measures while still providing appropriate patient behavior counseling is in high demand, particularly in the field of pediatric dental care. As a result, we decided to conduct this review specifically to examine the applications of AI models in pediatric dentistry. A comprehensive search of the subjects was done using a wide range of databases to look for studies that have been published in peer-reviewed journals from its inception until 31 December 2022. After the application of the criteria, only 25 of the 351 articles were taken into consideration for this review. According to the literature, AI is frequently used in pediatric dentistry for the purpose of making an accurate diagnosis and assisting clinicians, dentists, and pediatric dentists in clinical decision making, developing preventive strategies, and establishing an appropriate treatment plan.
Collapse
Affiliation(s)
- Satish Vishwanathaiah
- Department of Preventive Dental Sciences, Division of Pediatric Dentistry, College of Dentistry, Jazan University, Jazan 45142, Saudi Arabia
- Correspondence: (S.V.); (P.C.M.); Tel.: +966-542635434 (S.V.); +966-505916621 (P.C.M.)
| | - Hytham N. Fageeh
- Department of Preventive Dental Sciences, Division of Periodontics, College of Dentistry, Jazan University, Jazan 45142, Saudi Arabia
| | - Sanjeev B. Khanagar
- Preventive Dental Science Department, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Riyadh 11426, Saudi Arabia
- King Abdullah International Medical Research Centre, Ministry of National Guard Health Affairs, Riyadh 11481, Saudi Arabia
| | - Prabhadevi C. Maganur
- Department of Preventive Dental Sciences, Division of Pediatric Dentistry, College of Dentistry, Jazan University, Jazan 45142, Saudi Arabia
- Correspondence: (S.V.); (P.C.M.); Tel.: +966-542635434 (S.V.); +966-505916621 (P.C.M.)
| |
Collapse
|
7
|
Qu X, Zhang C, Houser SH, Zhang J, Zou J, Zhang W, Zhang Q. Prediction model for early childhood caries risk based on behavioral determinants using a machine learning algorithm. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 227:107221. [PMID: 36384058 DOI: 10.1016/j.cmpb.2022.107221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 05/05/2022] [Accepted: 11/01/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND An easily accessible caries risk prediction model (CRPM) based on nonbiological predictors is lacking. Developing a CRPM for community screening is essential for children's dental health promotion by a public health approach. OBJECTIVE This study aimed to develop and validate a caries risk prediction model (CRPM) for children using a machine learning algorithm based on dental care behavioral factors and other nonbiological factors using a 3-month multicenter cohort. METHODS Children aged 12 months to 60 months were recruited at three primary care settings and three kindergartens in Chengdu, China. Dental examination was conducted for all enrolled children by calibrated pediatric dentists at baseline and three months later. All parents of the enrolled children were asked to complete a questionnaire with dental-related information. Machine learning algorithms, including random forest, logistic regression, and adaptive boosting, were used to develop a prediction model. Sensitivity, specificity, accuracy, precision, negative predictive value and F-score were reported to estimate the internal validation of the models. RESULTS A total of 481 out of 745 children without a history of caries experience at baseline remained for analysis. In the total sample population, 236 (49.1%) children were female, and the mean age was 31.2 months. During the follow-up exams, 66 (13.6%) children had new-onset caries. The child's age, height, weight, family caries status, brush teeth two minutes per time, fluoride toothpaste usage, brushing twice per day, parental monitoring brushing teeth, mother delivery method, brushing child's teeth every day, child number counts, and night feeding frequency in the last month were measured and included in a prediction model. Of the prediction models, the highest area under the curve of RF was 0.91 (95% CI: 0.87- 0.94), followed by 0.86 (95% CI: 0.81-0.91) of LR and 0.81 (95% CI: 0.76-0.86) of AdaBoost. CONCLUSION In this CRPM, new onset of dental caries in three months among children aged < 60 months could be predicted by answering twelve nonbiological questions. A good model performance was shown within the internal validation. Dental home care could be improved by referring the CRPM result before new caries onset.
Collapse
Affiliation(s)
- Xing Qu
- Institute of Hospital Management, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Chao Zhang
- West China Biomedical Big Data Center, West China Hospital, Sichuan University; Med-X Center for Informatics, Sichuan University, Chengdu 610041, China
| | - Shannon H Houser
- Department of Health Services Administration, University of Alabama at Birmingham, Alabama 35294, USA
| | - Jian Zhang
- West China Biomedical Big Data Center, West China Hospital, Sichuan University; Med-X Center for Informatics, Sichuan University, Chengdu 610041, China
| | - Jing Zou
- Department of Pediatric Dentistry, West China Hospital of Stomatology, State Key Laboratory of Oral Diseases & National Clinical Research, Sichuan Unversity, Chengdu 610041, China
| | - Wei Zhang
- Institute of Hospital Management, West China Hospital, Sichuan University, Chengdu 610041, China; West China Biomedical Big Data Center, West China Hospital, Sichuan University; Med-X Center for Informatics, Sichuan University, Chengdu 610041, China.
| | - Qiong Zhang
- Department of Pediatric Dentistry, West China Hospital of Stomatology, State Key Laboratory of Oral Diseases & National Clinical Research, Sichuan Unversity, Chengdu 610041, China.
| |
Collapse
|
8
|
Ngnamsie Njimbouom S, Lee K, Kim JD. MMDCP: Multi-Modal Dental Caries Prediction for Decision Support System Using Deep Learning. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:10928. [PMID: 36078635 PMCID: PMC9518085 DOI: 10.3390/ijerph191710928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/25/2022] [Accepted: 08/29/2022] [Indexed: 06/15/2023]
Abstract
In recent years, healthcare has gained unprecedented attention from researchers in the field of Human health science and technology. Oral health, a subdomain of healthcare described as being very complex, is threatened by diseases like dental caries, gum disease, oral cancer, etc. The critical point is to propose an identification mechanism to prevent the population from being affected by these diseases. The large amount of online data allows scholars to perform tremendous research on health conditions, specifically oral health. Regardless of the high-performing dental consultation tools available in current healthcare, computer-based technology has shown the ability to complete some tasks in less time and cost less than when using similar healthcare tools to perform the same type of work. Machine learning has displayed a wide variety of advantages in oral healthcare, such as predicting dental caries in the population. Compared to the standard dental caries prediction previously proposed, this work emphasizes the importance of using multiple data sources, referred to as multi-modality, to extract more features and obtain accurate performances. The proposed prediction model constructed using multi-modal data demonstrated promising performances with an accuracy of 90%, F1-score of 89%, a recall of 90%, and a precision of 89%.
Collapse
Affiliation(s)
| | - Kwonwoo Lee
- Department of Computer and Electronics Convergence Engineering, Sun Moon University, Asan 31460, Korea
| | - Jeong-Dong Kim
- Department of Computer and Electronics Convergence Engineering, Sun Moon University, Asan 31460, Korea
- Genome-Based BioIT Convergence Institute, Sun Moon University, Asan 31460, Korea
| |
Collapse
|
9
|
Application and Performance of Artificial Intelligence Technology in Detection, Diagnosis and Prediction of Dental Caries (DC)—A Systematic Review. Diagnostics (Basel) 2022; 12:diagnostics12051083. [PMID: 35626239 PMCID: PMC9139989 DOI: 10.3390/diagnostics12051083] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Revised: 04/12/2022] [Accepted: 04/25/2022] [Indexed: 01/27/2023] Open
Abstract
Evolution in the fields of science and technology has led to the development of newer applications based on Artificial Intelligence (AI) technology that have been widely used in medical sciences. AI-technology has been employed in a wide range of applications related to the diagnosis of oral diseases that have demonstrated phenomenal precision and accuracy in their performance. The aim of this systematic review is to report on the diagnostic accuracy and performance of AI-based models designed for detection, diagnosis, and prediction of dental caries (DC). Eminent electronic databases (PubMed, Google scholar, Scopus, Web of science, Embase, Cochrane, Saudi Digital Library) were searched for relevant articles that were published from January 2000 until February 2022. A total of 34 articles that met the selection criteria were critically analyzed based on QUADAS-2 guidelines. The certainty of the evidence of the included studies was assessed using the GRADE approach. AI has been widely applied for prediction of DC, for detection and diagnosis of DC and for classification of DC. These models have demonstrated excellent performance and can be used in clinical practice for enhancing the diagnostic performance, treatment quality and patient outcome and can also be applied to identify patients with a higher risk of developing DC.
Collapse
|
10
|
Khalil RM, Kamel MG. Comment on: AI-supported modified risk staging for multiple myeloma cancer useful in real-world scenario. Transl Oncol 2021; 15:101241. [PMID: 34735895 PMCID: PMC8571790 DOI: 10.1016/j.tranon.2021.101241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 10/01/2021] [Indexed: 11/23/2022] Open
Affiliation(s)
- Rania M Khalil
- Department of Biochemistry, Pharmacy College, Delta University for Science and Technology, Gamasa, Egypt.
| | | |
Collapse
|