1
|
Chen J, Fan X, Chen Z, Peng Y, Liang L, Su C, Chen Y, Yao J. Enhancing YOLO5 for the Assessment of Irregular Pelvic Radiographs with Multimodal Information. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:744-755. [PMID: 38315343 PMCID: PMC11031542 DOI: 10.1007/s10278-024-00986-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 12/09/2023] [Accepted: 12/12/2023] [Indexed: 02/07/2024]
Abstract
Developmental dysplasia of the hip (DDH) is one of the most common orthopedic disorders in infants and young children. Accurate identification and localization of anatomical landmarks are prerequisites for the diagnosis of DDH. In recent years, various works have employed deep learning algorithms on radiography images for DDH diagnosis. However, none of these works have considered the incorporation of multimodal information. The pelvis exhibits distinct structures at different developmental stages, and there are also gender-based differences. In light of this, this study proposes a method to enhance the performance of deep learning models in diagnosing DDH by incorporating age and gender information into the channels. The study utilizes YOLO5 to construct a deep learning network for detecting hip joint landmarks. Moreover, a comprehensive dataset of 7750 pelvic X-ray images is established, covering ages from 4 months to 16 years and encompassing various conditions, such as deformities and post-operative cases, which authentically capture the temporal diversity and pathological complexities of DDH. Experimental results show that the YOLO5 model with integrated multimodal information achieves a mAP0.5-0.95 of 83.1% and a diagnostic accuracy of 86.7% in test dataset. The F1 scores for diagnosing cases of normal (NM), suspected dislocation (SD), mild dislocation (MD), and heavily dislocation (HD) are 90.9%, 79.8%, 63.5%, and 97.4%, respectively. Furthermore, experiments conducted on datasets of different sizes and networks of different sizes demonstrate the beneficial impact of multimodal information in improving the effectiveness of deep learning in diagnosing DDH.
Collapse
Affiliation(s)
- Jing Chen
- School of Physics and Optoelectronic Engineering, Guangdong University of Technology, Guangzhou, 510006, Guangdong, China
| | - Xiaoyou Fan
- School of Physics and Optoelectronic Engineering, Guangdong University of Technology, Guangzhou, 510006, Guangdong, China
| | - Zhen Chen
- School of Physics and Optoelectronic Engineering, Guangdong University of Technology, Guangzhou, 510006, Guangdong, China
| | - Yichao Peng
- Department of Pediatric Orthopedics, Center for Orthopaedic Surgery, Hospital of Guangdong Province, The Third School of Clinical Medicine, Southern Medical University, The Third Affiliated Hospital of Southern Medical University, Guangzhou, 510630, Guangdong, China
- Department of Orthopedics, Academy of Orthopedics Guangdong Province, Guangdong Provincial Key Laboratory of Bone and Joint Degeneration Diseases, Guangzhou, 510630, Guangdong, China
| | - Lichong Liang
- School of Physics and Optoelectronic Engineering, Guangdong University of Technology, Guangzhou, 510006, Guangdong, China
| | - Chengyue Su
- School of Physics and Optoelectronic Engineering, Guangdong University of Technology, Guangzhou, 510006, Guangdong, China
| | - Yun Chen
- Department of Pediatric Orthopedics, Center for Orthopaedic Surgery, Hospital of Guangdong Province, The Third School of Clinical Medicine, Southern Medical University, The Third Affiliated Hospital of Southern Medical University, Guangzhou, 510630, Guangdong, China.
- School of Nursing, Southern Medical University, The Third Affiliated Hospital of Southern Medical University, Guangzhou, 510630, Guangdong, China.
| | - Jinghui Yao
- Department of Pediatric Orthopedics, Center for Orthopaedic Surgery, Hospital of Guangdong Province, The Third School of Clinical Medicine, Southern Medical University, The Third Affiliated Hospital of Southern Medical University, Guangzhou, 510630, Guangdong, China.
- Department of Orthopedics, Academy of Orthopedics Guangdong Province, Guangdong Provincial Key Laboratory of Bone and Joint Degeneration Diseases, Guangzhou, 510630, Guangdong, China.
| |
Collapse
|
2
|
Jan F, Rahman A, Busaleh R, Alwarthan H, Aljaser S, Al-Towailib S, Alshammari S, Alhindi KR, Almogbil A, Bubshait DA, Ahmed MIB. Assessing Acetabular Index Angle in Infants: A Deep Learning-Based Novel Approach. J Imaging 2023; 9:242. [PMID: 37998088 PMCID: PMC10672484 DOI: 10.3390/jimaging9110242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 10/25/2023] [Accepted: 11/02/2023] [Indexed: 11/25/2023] Open
Abstract
Developmental dysplasia of the hip (DDH) is a disorder characterized by abnormal hip development that frequently manifests in infancy and early childhood. Preventing DDH from occurring relies on a timely and accurate diagnosis, which requires careful assessment by medical specialists during early X-ray scans. However, this process can be challenging for medical personnel to achieve without proper training. To address this challenge, we propose a computational framework to detect DDH in pelvic X-ray imaging of infants that utilizes a pipelined deep learning-based technique consisting of two stages: instance segmentation and keypoint detection models to measure acetabular index angle and assess DDH affliction in the presented case. The main aim of this process is to provide an objective and unified approach to DDH diagnosis. The model achieved an average pixel error of 2.862 ± 2.392 and an error range of 2.402 ± 1.963° for the acetabular angle measurement relative to the ground truth annotation. Ultimately, the deep-learning model will be integrated into the fully developed mobile application to make it easily accessible for medical specialists to test and evaluate. This will reduce the burden on medical specialists while providing an accurate and explainable DDH diagnosis for infants, thereby increasing their chances of successful treatment and recovery.
Collapse
Affiliation(s)
- Farmanullah Jan
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Atta Rahman
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Roaa Busaleh
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Haya Alwarthan
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Samar Aljaser
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Sukainah Al-Towailib
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Safiyah Alshammari
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Khadeejah Rasheed Alhindi
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Asrar Almogbil
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia (K.R.A.)
| | - Dalal A. Bubshait
- Department of Orthopedics, College of Medicine, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| | - Mohammed Imran Basheer Ahmed
- Department of Computer Engineering, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
| |
Collapse
|
3
|
Sha J, Huang L, Chen Y, Fan Z, Lin J, Yang Q, Li Y, Yan Y. Clinical thought-based software for diagnosing developmental dysplasia of the hip on pediatric pelvic radiographs. Front Pediatr 2023; 11:1080194. [PMID: 37063681 PMCID: PMC10098126 DOI: 10.3389/fped.2023.1080194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 03/06/2023] [Indexed: 04/18/2023] Open
Abstract
Background The common methods of radiographic diagnosis of developmental dysplasia of the hip (DDH) include measuring hip parameters and quantifying the degree of hip dislocation. However, clinical thought-based analysis of hip parameters may be a more effective way to achieve expert-like diagnoses of DDH. This study aims to develop a diagnostic strategy-based software for pediatric DDH and validate its clinical feasibility. Methods In total, 543 anteroposterior pelvic radiographs were retrospectively collected from January 2017 to December 2021. Two independent clinicians measured four diagnostic indices to compare the diagnoses made by the software and conventional manual method. The diagnostic accuracy was evaluated using the receiver operator characteristic (ROC) curves and confusion matrix, and the consistency of parametric measurements was assessed using Bland-Altman plots. Results In 543 cases (1,086 hips), the area under the curve, accuracy, sensitivity, and specificity of the software for diagnosing DDH were 0.988-0.994, 99.08%-99.72%, 98.07%-100.00%, and 99.59%, respectively. Compared with the expert panel, the Bland-Altman 95% limits of agreement for the acetabular index, as determined by the software, were -2.09°-2.91° (junior orthopedist) and -1.98°-2.72° (intermediate orthopedist). As for the lateral center-edge angle, the 95% limits were -3.68°-5.28° (junior orthopedist) and -2.94°-4.59° (intermediate orthopedist). Conclusions The software can provide expert-like analysis of pelvic radiographs and obtain the radiographic diagnosis of pediatric DDH with great consistency and efficiency. Its initial success lays the groundwork for developing a full-intelligent comprehensive diagnostic system of DDH.
Collapse
Affiliation(s)
- Jia Sha
- Department of Orthopedics, Xijing Hospital, Air Force Military Medical University, Xi’an, China
| | - Luyu Huang
- Department of Orthopedics, Xijing Hospital, Air Force Military Medical University, Xi’an, China
| | - Yaopeng Chen
- School of Telecommunications Engineering, Xidian University, Xi’an, China
- Guangzhou Institute, Xidian University, Xi’an, China
| | - Zongzhi Fan
- Department of Orthopedics, Xijing Hospital, Air Force Military Medical University, Xi’an, China
| | - Jincong Lin
- Department of Orthopedics, Xijing Hospital, Air Force Military Medical University, Xi’an, China
| | - Qinghai Yang
- School of Telecommunications Engineering, Xidian University, Xi’an, China
| | - Yi Li
- School of Telecommunications Engineering, Xidian University, Xi’an, China
- Correspondence: Yabo Yan Yi Li
| | - Yabo Yan
- Department of Orthopedics, Xijing Hospital, Air Force Military Medical University, Xi’an, China
- Correspondence: Yabo Yan Yi Li
| |
Collapse
|
4
|
Fraiwan M, Al-Kofahi N, Ibnian A, Hanatleh O. Detection of developmental dysplasia of the hip in X-ray images using deep transfer learning. BMC Med Inform Decis Mak 2022; 22:216. [PMID: 35964072 PMCID: PMC9375244 DOI: 10.1186/s12911-022-01957-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2022] [Accepted: 07/30/2022] [Indexed: 01/14/2023] Open
Abstract
Background Developmental dysplasia of the hip (DDH) is a relatively common disorder in newborns, with a reported prevalence of 1–5 per 1000 births. It can lead to developmental abnormalities in terms of mechanical difficulties and a displacement of the joint (i.e., subluxation or dysplasia). An early diagnosis in the first few months from birth can drastically improve healing, render surgical intervention unnecessary and reduce bracing time. A pelvic X-ray inspection represents the gold standard for DDH diagnosis. Recent advances in deep learning artificial intelligence have enabled the use of many image-based medical decision-making applications. The present study employs deep transfer learning in detecting DDH in pelvic X-ray images without the need for explicit measurements. Methods Pelvic anteroposterior X-ray images from 354 subjects (120 DDH and 234 normal) were collected locally at two hospitals in northern Jordan. A system that accepts these images as input and classifies them as DDH or normal was developed using thirteen deep transfer learning models. Various performance metrics were evaluated in addition to the overfitting/underfitting behavior and the training times. Results The highest mean DDH detection accuracy was 96.3% achieved using the DarkNet53 model, although other models achieved comparable results. A common theme across all the models was the extremely high sensitivity (i.e., recall) value at the expense of specificity. The F1 score, precision, recall and specificity for DarkNet53 were 95%, 90.6%, 100% and 94.3%, respectively. Conclusions Our automated method appears to be a highly accurate DDH screening and diagnosis method. Moreover, the performance evaluation shows that it is possible to further improve the system by expanding the dataset to include more X-ray images.
Collapse
Affiliation(s)
- Mohammad Fraiwan
- Department of Computer Engineering, Jordan University of Science and Technology, Irbid, Jordan.
| | - Noran Al-Kofahi
- Department of Internal Medicine, Jordan University of Science and Technology, Irbid, Jordan
| | - Ali Ibnian
- Department of Internal Medicine, Jordan University of Science and Technology, Irbid, Jordan
| | - Omar Hanatleh
- Department of Internal Medicine, Jordan University of Science and Technology, Irbid, Jordan
| |
Collapse
|