Estimating Cervical Vertebral Maturation with a Lateral Cephalogram Using the Convolutional Neural Network

Efficacy of the methods of age determination using artificial intelligence in panoramic radiographs - a systematic review

The aim of this systematic review is to analyze the literature to determine whether the methods of artificial intelligence are effective in determining age in panoramic radiographs. Searches without language and year limits were conducted in PubMed/Medline, Embase, Web of Science, and Scopus databases. Hand searches were also performed, and unpublished manuscripts were searched in specialized journals. Thirty-six articles were included in the analysis. Significant differences in terms of root mean square error and mean absolute error were found between manual methods and artificial intelligence techniques, favoring the use of artificial intelligence (p < 0.00001). Few articles compared deep learning methods with machine learning models or manual models. Although there are advantages of machine learning in data processing and deep learning in data collection and analysis, non-comparable data was a limitation of this study. More information is needed on the comparison of these techniques, with particular emphasis on time as a variable.

Use of artificial intelligence in determination of bone age of the healthy individuals: A scoping review

BACKGROUND

Bone age assessment, as an indicator of biological age, is widely used in orthodontics and pediatric endocrinology. Owing to significant subject variations in the manual method of assessment, artificial intelligence (AI), machine learning (ML), and deep learning (DL) play a significant role in this aspect. A scoping review was conducted to search the existing literature on the role of AI, ML, and DL in skeletal age or bone age assessment in healthy individuals.

METHODS

A literature search was conducted in PubMed, Scopus, and Web of Science from January 2012 to December 2022 using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses-Extension for Scoping Reviews (PRISMA-ScR) and Joanna Briggs Institute guidelines. Grey literature was searched using Google Scholar and OpenGrey. Hand-searching of the articles in all the reputed orthodontic journals and the references of the included articles were also searched for relevant articles for the present scoping review.

RESULTS

Nineteen articles that fulfilled the inclusion criteria were included. Ten studies used skeletal maturity indicators based on hand and wrist radiographs, two studies used magnetic resonance imaging and seven studies used cervical vertebrae maturity indicators based on lateral cephalograms to assess the skeletal age of the individuals. Most of these studies were published in non-orthodontic medical journals. BoneXpert automated software was the most commonly used software, followed by DL models, and ML models in the studies for assessment of bone age. The automated method was found to be as reliable as the manual method for assessment.

CONCLUSIONS

This scoping review validated the use of AI, ML, or DL in bone age assessment of individuals. A more uniform distribution of sufficient samples in different stages of maturation, use of three-dimensional inputs such as magnetic resonance imaging, and cone beam computed tomography is required for better training of the models to generalize the outputs for use in the target population.

CURRENT NEURAL NETWORKS DEMONSTRATE POTENTIAL IN AUTOMATED CERVICAL VERTEBRAL MATURATION STAGE CLASSIFICATION BASED ON LATERAL CEPHALOGRAMS

ARTICLE TITLE AND BIBLIOGRAPHIC INFORMATION

Neural networks for classification of cervical vertebrae maturation: a systematic review. Mathew R, Palatinus S, Padala S, Alshehri A, Awadh W, Bhandi S, Thomas J, Patil S. Angle Orthod. 2022 Nov 1;92(6):796-804.

SOURCE OF FUNDING

No financial support was reported.

TYPE OF STUDY/DESIGN

Systematic review.

AggregateNet: A deep learning model for automated classification of cervical vertebrae maturation stages

OBJECTIVE

A study of supervised automated classification of the cervical vertebrae maturation (CVM) stages using deep learning (DL) network is presented. A parallel structured deep convolutional neural network (CNN) with a pre-processing layer that takes X-ray images and the age as the input is proposed.

METHODS

A total of 1018 cephalometric radiographs were labelled and classified according to the CVM stages. The images were separated according to gender for better model-fitting. The images were cropped to extract the cervical vertebrae automatically using an object detector. The resulting images and the age inputs were used to train the proposed DL model: AggregateNet with a set of tunable directional edge enhancers. After the features of the images were extracted, the age input was concatenated to the output feature vector. To have the parallel network not overfit, data augmentation was used. The performance of our CNN model was compared with other DL models, ResNet20, Xception, MobileNetV2 and custom-designed CNN model with the directional filters.

RESULTS

The proposed innovative model that uses a parallel structured network preceded with a pre-processing layer of edge enhancement filters achieved a validation accuracy of 82.35% in CVM stage classification on female subjects, 75.0% in CVM stage classification on male subjects, exceeding the accuracy achieved with the other DL models investigated. The effectiveness of the directional filters is reflected in the improved performance attained in the results. If AggregateNet is used without directional filters, the test accuracy decreases to 80.0% on female subjects and to 74.03% on male subjects.

CONCLUSION

AggregateNet together with the tunable directional edge filters is observed to produce higher accuracy than the other models that we investigated in the fully automated determination of the CVM stages.

Application of Artificial Intelligence in Orthodontics: Current State and Future Perspectives

In recent years, there has been the notable emergency of artificial intelligence (AI) as a transformative force in multiple domains, including orthodontics. This review aims to provide a comprehensive overview of the present state of AI applications in orthodontics, which can be categorized into the following domains: (1) diagnosis, including cephalometric analysis, dental analysis, facial analysis, skeletal-maturation-stage determination and upper-airway obstruction assessment; (2) treatment planning, including decision making for extractions and orthognathic surgery, and treatment outcome prediction; and (3) clinical practice, including practice guidance, remote care, and clinical documentation. We have witnessed a broadening of the application of AI in orthodontics, accompanied by advancements in its performance. Additionally, this review outlines the existing limitations within the field and offers future perspectives.

Deep convolutional neural network-the evaluation of cervical vertebrae maturation

OBJECTIVES

This study aimed to automatically determine the cervical vertebral maturation (CVM) processes on lateral cephalometric radiograph images using a proposed deep learning-based convolutional neural network (CNN) model and to test the success rate of this CNN model in detecting CVM stages using precision, recall, and F1-score.

METHODS

A total of 588 digital lateral cephalometric radiographs of patients with a chronological age between 8 and 22 years were included in this study. CVM evaluation was carried out by two dentomaxillofacial radiologists. CVM stages in the images were divided into 6 subgroups according to the growth process. A convolutional neural network (CNN) model was developed in this study. Experimental studies for the developed model were carried out in the Jupyter Notebook environment using the Python programming language, the Keras, and TensorFlow libraries.

RESULTS

As a result of the training that lasted 40 epochs, 58% training and 57% test accuracy were obtained. The model obtained results that were very close to the training on the test data. On the other hand, it was determined that the model showed the highest success in terms of precision and F1-score in the CVM Stage 1 and the highest success in the recall value in the CVM Stage 2.

CONCLUSION

The experimental results have shown that the developed model achieved moderate success and it reached a classification accuracy of 58.66% in CVM stage classification.

Cervical Vertebral Maturation Assessment using various Machine Learning techniques on Lateral cephalogram: A systematic literature review

Importance

For the assessment of optimum treatment timing in dentofacial orthopedics, understanding the growth process is of paramount importance. The evaluation of skeletal maturity based on study of the morphology of the cervical vertebrae has been devised to minimize radiation exposure of a patient due to hand wrist radiography. Cervical vertebral maturation assessment (CVMA) predictions have been examined in the state-of-the-art machine learning techniques in the recent past which require more attention and validation by clinicians and practitioners.

Objectives

This paper aimed to answer the question "How are machine learning techniques being employed in studies concerning cervical vertebral maturation assessment using lateral cephalograms?"

Method

A systematic search through the available literature was performed for this work based upon the Population, Intervention, Comparison and Outcome (PICO) framework.

Data sources study selection data extraction and synthesis

The searches were performed in Ovid Medline, Embase, PubMed and Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Database of Systematic Reviews (CDSR). A search of the grey literature was also performed in Google Scholar and OpenGrey. We also did a hand-searching in the Angle Orthodontist, Journal of Orthodontics and Craniofacial Research, Progress in Orthodontics, and the American Journal of Orthodontics and Dentofacial Orthopedics. References from the included articles were also searched.

Main outcomes and measures results

A total of 25 papers which were assessed for full text, and 13 papers were included for the systematic review. The machine learning methods used were scrutinized according to their performance and comparison to human observers/experts. The accuracy of the models ranged between 60 and 90% or above, and satisfactory agreement and correlation with the human observers.

Conclusions and relevance

Machine learning models can be used for detection and classification of the cervical vertebrae maturation. In this systematic review (SR), the studies were summarized in terms of ML techniques applied, sample data, age range of sample and conventional method for CVMA, which showed that further studies with a uniform distribution of samples equally in stages of maturation and according to the gender is required for better training of the models in order to generalize the outputs for prolific use to target population.

Automated Sagittal Skeletal Classification of Children Based on Deep Learning

Malocclusions are a type of cranio-maxillofacial growth and developmental deformity that occur with high incidence in children. Therefore, a simple and rapid diagnosis of malocclusions would be of great benefit to our future generation. However, the application of deep learning algorithms to the automatic detection of malocclusions in children has not been reported. Therefore, the aim of this study was to develop a deep learning-based method for automatic classification of the sagittal skeletal pattern in children and to validate its performance. This would be the first step in establishing a decision support system for early orthodontic treatment. In this study, four different state-of-the-art (SOTA) models were trained and compared by using 1613 lateral cephalograms, and the best performance model, Densenet-121, was selected was further subsequent validation. Lateral cephalograms and profile photographs were used as the input for the Densenet-121 model, respectively. The models were optimized using transfer learning and data augmentation techniques, and label distribution learning was introduced during model training to address the inevitable label ambiguity between adjacent classes. Five-fold cross-validation was conducted for a comprehensive evaluation of our method. The sensitivity, specificity, and accuracy of the CNN model based on lateral cephalometric radiographs were 83.99, 92.44, and 90.33%, respectively. The accuracy of the model with profile photographs was 83.39%. The accuracy of both CNN models was improved to 91.28 and 83.98%, respectively, while the overfitting decreased after addition of label distribution learning. Previous studies have been based on adult lateral cephalograms. Therefore, our study is novel in using deep learning network architecture with lateral cephalograms and profile photographs obtained from children in order to obtain a high-precision automatic classification of the sagittal skeletal pattern in children.

Automatic determination of pubertal growth spurts based on the cervical vertebral maturation staging using deep convolutional neural networks

BACKGROUND

This study aimed to develop a deep convolutional neural network (CNN) for automatic classification of pubertal growth spurts using cervical vertebral maturation (CVM) staging based on the lateral cephalograms of an Iranian subpopulation.

MATERIAL AND METHODS

Cephalometric radiographs were collected from 1846 eligible patients (aged 5-18 years) referred to the orthodontic department of Hamadan University of Medical Sciences. These images were labeled by two experienced orthodontists. Two scenarios, including two- and three-class (pubertal growth spurts using CVM), were considered as the output for the classification task. The cropped image of the second to fourth cervical vertebrae was used as input to the network. After the preprocessing, the augmentation step, and hyperparameter tuning, the networks were trained with initial random weighting and transfer learning. Finally, the best architecture among the different architectures was determined based on the accuracy and F-score criteria.

RESULTS

The CNN based on the ConvNeXtBase-296 architecture had the highest accuracy for automatically assessing pubertal growth spurts based on CVM staging in both three-class (82% accuracy) and two-class (93% accuracy) scenarios. Given the limited amount of data available for training the target networks for most of the architectures in use, transfer learning improves predictive performance.

CONCLUSIONS

The results of this study confirm the potential of CNNs as an auxiliary diagnostic tool for intelligent assessment of skeletal maturation staging with high accuracy even with a relatively small number of images. Considering the development of orthodontic science toward digitalization, the development of such intelligent decision systems is proposed.

Deep focus approach for accurate bone age estimation from lateral cephalogram

Background/purpose

Bone age is a useful indicator of children's growth and development. Recently, the rapid development of deep-learning technique has shown promising results in estimating bone age. This study aimed to devise a deep-learning approach for accurate bone-age estimation by focusing on the cervical vertebrae on lateral cephalograms of growing children using image segmentation.

Materials and methods

We included 900 participants, aged 4-18 years, who underwent lateral cephalogram and hand-wrist radiograph on the same day. First, cervical vertebrae segmentation was performed from the lateral cephalogram using DeepLabv3+ architecture. Second, after extracting the region of interest from the segmented image for preprocessing, bone age was estimated through transfer learning using a regression model based on Inception-ResNet-v2 architecture. The dataset was divided into train:test sets in a ratio of 4:1; five-fold cross-validation was performed at each step.

Results

The segmentation model possessed average accuracy, intersection over union, and mean boundary F1 scores of 0.956, 0.913, and 0.895, respectively, for the segmentation of cervical vertebrae from lateral cephalogram. The regression model for estimating bone age from segmented cervical vertebrae images yielded average mean absolute error and root mean squared error values of 0.300 and 0.390 years, respectively. The coefficient of determination of the proposed method for the actual and estimated bone age was 0.983. Our method visualized important regions on cervical vertebral images to make a prediction using the gradient-weighted regression activation map technique.

Conclusion

Results showed that our proposed method can estimate bone age by lateral cephalogram with sufficiently high accuracy.

Neural networks for classification of cervical vertebrae maturation: a systematic review

OBJECTIVE

To assess the accuracy of identification and/or classification of the stage of cervical vertebrae maturity on lateral cephalograms by neural networks as compared with the ground truth determined by human observers.

MATERIALS AND METHODS

Search results from four electronic databases (PubMed [MEDLINE], Embase, Scopus, and Web of Science) were screened by two independent reviewers, and potentially relevant articles were chosen for full-text evaluation. Articles that fulfilled the inclusion criteria were selected for data extraction and methodologic assessment by the QUADAS-2 tool.

RESULTS

The search identified 425 articles across the databases, from which 8 were selected for inclusion. Most publications concerned the development of the models with different input features. Performance of the systems was evaluated against the classifications performed by human observers. The accuracy of the models on the test data ranged from 50% to more than 90%. There were concerns in all studies regarding the risk of bias in the index test and the reference standards. Studies that compared models with other algorithms in machine learning showed better results using neural networks.

CONCLUSIONS

Neural networks can detect and classify cervical vertebrae maturation stages on lateral cephalograms. However, further studies need to develop robust models using appropriate reference standards that can be generalized to external data.

iCVM: An Interpretable Deep Learning Model for CVM Assessment under Label Uncertainty

The Cervical Vertebral Maturation (CVM) method aims to determine the craniofacial skeletal maturational stage, which is crucial for orthodontic and orthopedic treatment. In this paper, we explore the potential of deep learning for automatic CVM assessment. In particular, we propose a convolutional neural network named iCVM. Based on the residual network, it is specialized for the challenges unique to the task of CVM assessment. 1) To combat overfitting due to limited data size, multiple dropout layers are utilized. 2) To address the inevitable label ambiguity between adjacent maturational stages, we introduce the concept of label distribution learning in the loss function. Besides, we attempt to analyze the regions important for the prediction of the model by using the Grad-CAM technique. The learned strategy shows surprisingly high consistency with the clinical criteria. This indicates that the decisions made by our model are well interpretable, which is critical in evaluation of growth and development in orthodontics. Moreover, to drive future research in the field, we release a new dataset named CVM-900 along with the paper. It contains the cervical part of 900 lateral cephalograms collected from orthodontic patients of different ages and genders. Experimental results show that the proposed approach achieves superior performance on CVM-900 in terms of various evaluation metrics.