1
|
Morita D, Kawarazaki A, Soufi M, Otake Y, Sato Y, Numajiri T. Automatic detection of midfacial fractures in facial bone CT images using deep learning-based object detection models. JOURNAL OF STOMATOLOGY, ORAL AND MAXILLOFACIAL SURGERY 2024; 125:101914. [PMID: 38750725 DOI: 10.1016/j.jormas.2024.101914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 04/24/2024] [Accepted: 05/12/2024] [Indexed: 05/18/2024]
Abstract
BACKGROUND Midfacial fractures are among the most frequent facial fractures. Surgery is recommended within 2 weeks of injury, but this time frame is often extended because the fracture is missed on diagnostic imaging in the busy emergency medicine setting. Using deep learning technology, which has progressed markedly in various fields, we attempted to develop a system for the automatic detection of midfacial fractures. The purpose of this study was to use this system to diagnose fractures accurately and rapidly, with the intention of benefiting both patients and emergency room physicians. METHODS One hundred computed tomography images that included midfacial fractures (e.g., maxillary, zygomatic, nasal, and orbital fractures) were prepared. In each axial image, the fracture area was surrounded by a rectangular region to create the annotation data. Eighty images were randomly classified as the training dataset (3736 slices) and 20 as the validation dataset (883 slices). Training and validation were performed using Single Shot MultiBox Detector (SSD) and version 8 of You Only Look Once (YOLOv8), which are object detection algorithms. RESULTS The performance indicators for SSD and YOLOv8 were respectively: precision, 0.872 and 0.871; recall, 0.823 and 0.775; F1 score, 0.846 and 0.82; average precision, 0.899 and 0.769. CONCLUSIONS The use of deep learning techniques allowed the automatic detection of midfacial fractures with good accuracy and high speed. The system developed in this study is promising for automated detection of midfacial fractures and may provide a quick and accurate solution for emergency medical care and other settings.
Collapse
Affiliation(s)
- Daiki Morita
- Department of Plastic and Reconstructive Surgery, Kyoto Prefectural University of Medicine, Kyoto, Japan; Department of Plastic and Reconstructive Surgery, Tokai University School of Medicine, Kanagawa, Japan.
| | - Ayako Kawarazaki
- Department of Plastic and Reconstructive Surgery, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Mazen Soufi
- Division of Information Science, Nara Institute of Science and Technology, Nara, Japan
| | - Yoshito Otake
- Division of Information Science, Nara Institute of Science and Technology, Nara, Japan
| | - Yoshinobu Sato
- Division of Information Science, Nara Institute of Science and Technology, Nara, Japan
| | - Toshiaki Numajiri
- Department of Plastic and Reconstructive Surgery, Kyoto Prefectural University of Medicine, Kyoto, Japan
| |
Collapse
|
2
|
Lu CY, Wang YH, Chen HL, Goh YX, Chiu IM, Hou YY, Kuo KH, Lin WC. Artificial Intelligence Application in Skull Bone Fracture with Segmentation Approach. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01156-0. [PMID: 38954293 DOI: 10.1007/s10278-024-01156-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 05/12/2024] [Accepted: 05/27/2024] [Indexed: 07/04/2024]
Abstract
This study aims to evaluate an AI model designed to automatically classify skull fractures and visualize segmentation on emergent CT scans. The model's goal is to boost diagnostic accuracy, alleviate radiologists' workload, and hasten diagnosis, thereby enhancing patient outcomes. Unique to this research, both pediatric and post-operative patients were not excluded, and diagnostic durations were analyzed. Our testing dataset for the observer studies involved 671 patients, with a mean age of 58.88 years and fairly balanced gender representation. Model 1 of our AI algorithm, trained with 1499 fracture-positive cases, showed a sensitivity of 0.94 and specificity of 0.87, with a DICE score of 0.65. Implementing post-processing rules (specifically Rule B) improved the model's performance, resulting in a sensitivity of 0.94, specificity of 0.99, and a DICE score of 0.63. AI-assisted diagnosis resulted in significantly enhanced performance for all participants, with sensitivity almost doubling for junior radiology residents and other specialists. Additionally, diagnostic durations were significantly reduced (p < 0.01) with AI assistance across all participant categories. Our skull fracture detection model, employing a segmentation approach, demonstrated high performance, enhancing diagnostic accuracy and efficiency for radiologists and clinical physicians. This underlines the potential of AI integration in medical imaging analysis to improve patient care.
Collapse
Affiliation(s)
- Chia-Yin Lu
- Department of Diagnostic Radiology, Chang Gung Memorial Hospital, Kaohsiung, Taiwan
| | - Yu-Hsin Wang
- Department of Diagnostic Radiology, Chang Gung Memorial Hospital, Kaohsiung, Taiwan
| | - Hsiu-Ling Chen
- Department of Diagnostic Radiology, Chang Gung Memorial Hospital, Kaohsiung, Taiwan
| | - Yu-Xin Goh
- Department of Neurology, Shuang Ho Hospital, Ministry of Health and Welfare, Taipei Medical University, New Taipei City, Taiwan
| | - I-Min Chiu
- Department of Emergency Medicine, Chang Gung Memorial Hospital, Kaohsiung, Taiwan
| | - Ya-Yuan Hou
- Department of Neurology, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan
| | - Kuei-Hong Kuo
- Division of Medical Image, Far Eastern Memorial Hospital, No. 21, Sec. 2, Nan Ya South Road., Banqiao District, New Taipei City, Taiwan.
- School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan.
| | - Wei-Che Lin
- Department of Diagnostic Radiology, Chang Gung Memorial Hospital, Kaohsiung, Taiwan.
- Department of Radiology, Jen Ai Chang Gung Health Dali Branch, Taichung, Taiwan.
| |
Collapse
|
3
|
Pham TD, Holmes SB, Coulthard P. A review on artificial intelligence for the diagnosis of fractures in facial trauma imaging. Front Artif Intell 2024; 6:1278529. [PMID: 38249794 PMCID: PMC10797131 DOI: 10.3389/frai.2023.1278529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 12/11/2023] [Indexed: 01/23/2024] Open
Abstract
Patients with facial trauma may suffer from injuries such as broken bones, bleeding, swelling, bruising, lacerations, burns, and deformity in the face. Common causes of facial-bone fractures are the results of road accidents, violence, and sports injuries. Surgery is needed if the trauma patient would be deprived of normal functioning or subject to facial deformity based on findings from radiology. Although the image reading by radiologists is useful for evaluating suspected facial fractures, there are certain challenges in human-based diagnostics. Artificial intelligence (AI) is making a quantum leap in radiology, producing significant improvements of reports and workflows. Here, an updated literature review is presented on the impact of AI in facial trauma with a special reference to fracture detection in radiology. The purpose is to gain insights into the current development and demand for future research in facial trauma. This review also discusses limitations to be overcome and current important issues for investigation in order to make AI applications to the trauma more effective and realistic in practical settings. The publications selected for review were based on their clinical significance, journal metrics, and journal indexing.
Collapse
Affiliation(s)
- Tuan D. Pham
- Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | | | | |
Collapse
|
4
|
Wang HC, Wang SC, Yan JL, Ko LW. Artificial Intelligence Model Trained with Sparse Data to Detect Facial and Cranial Bone Fractures from Head CT. J Digit Imaging 2023; 36:1408-1418. [PMID: 37095310 PMCID: PMC10407005 DOI: 10.1007/s10278-023-00829-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 02/15/2023] [Accepted: 03/31/2023] [Indexed: 04/26/2023] Open
Abstract
The presence of cranial and facial bone fractures is an important finding on non-enhanced head computed tomography (CT) scans from patients who have sustained head trauma. Some prior studies have proposed automatic cranial fracture detections, but studies on facial fractures are lacking. We propose a deep learning system to automatically detect both cranial and facial bone fractures. Our system incorporated models consisting of YOLOv4 for one-stage fracture detection and improved ResUNet (ResUNet++) for the segmentation of cranial and facial bones. The results from the two models mapped together provided the location of the fracture and the name of the fractured bone as the final output. The training data for the detection model were the soft tissue algorithm images from a total of 1,447 head CT studies (a total of 16,985 images), and the training data for the segmentation model included 1,538 selected head CT images. The trained models were tested on a test dataset consisting of 192 head CT studies (a total of 5,890 images). The overall performance achieved a sensitivity of 88.66%, a precision of 94.51%, and an F1 score of 0.9149. Specifically, the cranial and facial regions were evaluated and resulted in a sensitivity of 84.78% and 80.77%, a precision of 92.86% and 87.50%, and F1 scores of 0.8864 and 0.8400, respectively. The average accuracy for the segmentation labels concerning all predicted fracture bounding boxes was 80.90%. Our deep learning system could accurately detect cranial and facial bone fractures and identify the fractured bone region simultaneously.
Collapse
Affiliation(s)
- Huan-Chih Wang
- Division of Neurosurgery, Department of Surgery, National Taiwan University Hospital, Chungshan Rd, No. 7, Taipei City 100, Taiwan
- Division of Neurosurgery, Department of Surgery, National Taiwan University Hospital Hsinchu Branch, Hsinchu, Taiwan
- Department of Biological Science & Technology, College of Biological Science and Technology, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| | - Shao-Chung Wang
- Department of Medical Imaging and Intervention, Gung Medical Foundation, New Taipei Municipal Tucheng Hospital, Chang
, New Taipei City, Taiwan
| | - Jiun-Lin Yan
- Department of Neurosurgery, Keelung Chang Gung Memorial Hospital, Keelung, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Li-Wei Ko
- Department of Biological Science & Technology, College of Biological Science and Technology, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
- Present Address: Institute of Electrical and Control Engineering, College of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| |
Collapse
|
5
|
Lin X, Yan Z, Kuang Z, Zhang H, Deng X, Yu L. Fracture R-CNN: An anchor-efficient anti-interference framework for skull fracture detection in CT images. Med Phys 2022; 49:7179-7192. [PMID: 35713606 DOI: 10.1002/mp.15809] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 04/19/2022] [Accepted: 05/16/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Skull fracture, as a common traumatic brain injury, can lead to multiple complications including bleeding, leaking of cerebrospinal fluid, infection, and seizures. Automatic skull fracture detection (SFD) is of great importance, especially in emergency medicine. PURPOSE Existing algorithms for SFD, developed based on hand-crafted features, suffer from low detection accuracy due to poor generalizability to unseen samples. Deploying deep detectors designed for natural images like Faster Region-based Convolutional Neural Network (R-CNN) for SFD can be helpful but are of high redundancy and with nonnegligible false detections due to the cranial suture and skull base interference. Therefore, we, for the first time, propose an anchor-efficient anti-interference deep learning framework named Fracture R-CNN for accurate SFD with low computational cost. METHODS The proposed Fracture R-CNN is developed by incorporating the prior knowledge utilized in clinical diagnosis into the original Faster R-CNN. Specifically, based on the distributions of skull fractures, we first propose an adaptive anchoring region proposal network (AA-RPN) to generate proposals for diverse-scale fractures with low computational complexity. Then, based on the prior knowledge that cranial sutures exist in the junctions of bones and usually contain sclerotic margins, we design an anti-interference head (A-Head) network to eliminate the cranial suture interference for better SFD detection. In addition, to further enhance the anti-interference ability of the proposed A-Head, a difficulty-balanced weighted loss function is proposed to emphasize more on distinguishing the interference areas from the skull base and the cranial sutures during training. RESULTS Experimental results demonstrate that the proposed Fracture R-CNN outperforms the current state-of-the-art (SOTA) deep detectors for SFD with a higher recall and fewer false detections. Compared to Faster R-CNN, the proposed Fracture R-CNN improves the average precision (AP) by 11.74% and the free-response receiver operating characteristic (FROC) score by 11.08%. Through validating on various backbones, we further demonstrate the architecture independence of Fracture R-CNN, making it extendable to other detection applications. CONCLUSIONS As the customized deep learning-based framework for SFD, Fracture R-CNN can effectively overcome the unique challenges in SFD with less computational cost, leading to a better detection performance compared to the SOTA deep detectors. Moreover, we believe the prior knowledge explored for Fracture R-CNN would shed new light on future deep learning approaches for SFD.
Collapse
Affiliation(s)
- Xian Lin
- School of Electronic Information and Communication, Huazhong University of Science and Technology, Wuhan, China
| | - Zengqiang Yan
- School of Electronic Information and Communication, Huazhong University of Science and Technology, Wuhan, China
| | - Zhuo Kuang
- School of Electronic Information and Communication, Huazhong University of Science and Technology, Wuhan, China
| | - Hang Zhang
- Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Xianbo Deng
- Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Li Yu
- School of Electronic Information and Communication, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|