Web-Based Spine Segmentation Using Deep Learning in Computed Tomography Images

Artificial intelligence: a new cutting-edge tool in spine surgery

The purpose of this narrative review was to comprehensively elaborate the various components of artificial intelligence (AI), their applications in spine surgery, practical concerns, and future directions. Over the years, spine surgery has been continuously transformed in various aspects, including diagnostic strategies, surgical approaches, procedures, and instrumentation, to provide better-quality patient care. Surgeons have also augmented their surgical expertise with rapidly growing technological advancements. AI is an advancing field that has the potential to revolutionize many aspects of spine surgery. We performed a comprehensive narrative review of the various aspects of AI and machine learning in spine surgery. To elaborate on the current role of AI in spine surgery, a review of the literature was performed using PubMed and Google Scholar databases for articles published in English in the last 20 years. The initial search using the keywords "artificial intelligence" AND "spine," "machine learning" AND "spine," and "deep learning" AND "spine" extracted a total of 78, 60, and 37 articles and 11,500, 4,610, and 2,270 articles on PubMed and Google Scholar. After the initial screening and exclusion of unrelated articles, duplicates, and non-English articles, 405 articles were identified. After the second stage of screening, 93 articles were included in the review. Studies have shown that AI can be used to analyze patient data and provide personalized treatment recommendations in spine care. It also provides valuable insights for planning surgeries and assisting with precise surgical maneuvers and decisionmaking during the procedures. As more data become available and with further advancements, AI is likely to improve patient outcomes.

3D multi-scale feature extraction and recalibration network for spinal structure and lesion segmentation

BACKGROUND

Automatic segmentation has emerged as a promising technique for the diagnosis of spinal conditions.

PURPOSE

To design and evaluate a deep convolution network for segmenting the intervertebral disc, spinal canal, facet joint, and herniated disk on magnetic resonance imaging (MRI) scans.

MATERIAL AND METHODS

MRI scans of 70 patients with disc herniation were gathered and manually annotated by radiologists. A novel deep neural network was developed, comprising 3D squeeze-and-excitation blocks and multi-scale feature extraction blocks for automated segmentation of spinal structure and lesion. To address the issue of class imbalance, a weighted cross-entropy loss was introduced for training. In addition, semi-supervision segmentation was accomplished to reduce annotation labor cost.

RESULTS

The proposed model achieved 77.67% mean intersection over union, with 9.56% and 11.11% gains over typical V-Net and U-Net respectively, outperforming the other models in ablation experiments. In addition, the semi-supervision segmentation method was proven to work.

CONCLUSION

The 3D multi-scale feature extraction and recalibration network achieved an excellent segmentation performance of intervertebral disc, spinal canal, facet joint, and herniated disk, outperforming typical encoder-decoder networks.

An Automated Deep Learning Approach for Spine Segmentation and Vertebrae Recognition Using Computed Tomography Images

Spine image analysis is based on the accurate segmentation and vertebrae recognition of the spine. Several deep learning models have been proposed for spine segmentation and vertebrae recognition, but they are very computationally demanding. In this research, a novel deep learning model is introduced for spine segmentation and vertebrae recognition using CT images. The proposed model works in two steps: (1) A cascaded hierarchical atrous spatial pyramid pooling residual attention U-Net (CHASPPRAU-Net), which is a modified version of U-Net, is used for the segmentation of the spine. Cascaded spatial pyramid pooling layers, along with residual blocks, are used for feature extraction, while the attention module is used for focusing on regions of interest. (2) A 3D mobile residual U-Net (MRU-Net) is used for vertebrae recognition. MobileNetv2 includes residual and attention modules to accurately extract features from the axial, sagittal, and coronal views of 3D spine images. The features from these three views are concatenated to form a 3D feature map. After that, a 3D deep learning model is used for vertebrae recognition. The VerSe 20 and VerSe 19 datasets were used to validate the proposed model. The model achieved more accurate results in spine segmentation and vertebrae recognition than the state-of-the-art methods.

Automatic Method for Optic Disc Segmentation Using Deep Learning on Retinal Fundus Images

OBJECTIVES

The optic disc is part of the retinal fundus image structure, which influences the extraction of glaucoma features. This study proposes a method that automatically segments the optic disc area in retinal fundus images using deep learning based on a convolutional neural network (CNN).

METHODS

This study used private and public datasets containing retinal fundus images. The private dataset consisted of 350 images, while the public dataset was the Retinal Fundus Glaucoma Challenge (REFUGE). The proposed method was based on a CNN with a single-shot multibox detector (MobileNetV2) to form images of the region-of-interest (ROI) using the original image resized into 640 × 640 input data. A pre-processing sequence was then implemented, including augmentation, resizing, and normalization. Furthermore, a U-Net model was applied for optic disc segmentation with 128 × 128 input data.

RESULTS

The proposed method was appropriately applied to the datasets used, as shown by the values of the F1-score, dice score, and intersection over union of 0.9880, 0.9852, and 0.9763 for the private dataset, respectively, and 0.9854, 0.9838 and 0.9712 for the REFUGE dataset.

CONCLUSIONS

The optic disc area produced by the proposed method was similar to that identified by an ophthalmologist. Therefore, this method can be considered for implementing automatic segmentation of the optic disc area.

Characterizing browser-based medical imaging AI with serverless edge computing: towards addressing clinical data security constraints

Artificial intelligence (AI) has been widely introduced to various medical imaging applications ranging from disease visualization to medical decision support. However, data privacy has become an essential concern in clinical practice of deploying the deep learning algorithms through cloud computing. The sensitivity of patient health information (PHI) commonly limits network transfer, installation of bespoke desktop software, and access to computing resources. Serverless edge-computing shed light on privacy preserved model distribution maintaining both high flexibility (as cloud computing) and security (as local deployment). In this paper, we propose a browser-based, cross-platform, and privacy preserved medical imaging AI deployment system working on consumer-level hardware via serverless edge-computing. Briefly we implement this system by deploying a 3D medical image segmentation model for computed tomography (CT) based lung cancer screening. We further curate tradeoffs in model complexity and data size by characterizing the speed, memory usage, and limitations across various operating systems and browsers. Our implementation achieves a deployment with (1) a 3D convolutional neural network (CNN) on CT volumes (256×256×256 resolution), (2) an average runtime of 80 seconds across Firefox v.102.0.1/Chrome v.103.0.5060.114/Microsoft Edge v.103.0.1264.44 and 210 seconds on Safari v.14.1.1, and (3) an average memory usage of 1.5 GB on Microsoft Windows laptops, Linux workstation, and Apple Mac laptops. In conclusion, this work presents a privacy-preserved solution for medical imaging AI applications that minimizes the risk of PHI exposure. We characterize the tools, architectures, and parameters of our framework to facilitate the translation of modern deep learning methods into routine clinical care.

Deep label fusion: A generalizable hybrid multi-atlas and deep convolutional neural network for medical image segmentation

Deep convolutional neural networks (DCNN) achieve very high accuracy in segmenting various anatomical structures in medical images but often suffer from relatively poor generalizability. Multi-atlas segmentation (MAS), while less accurate than DCNN in many applications, tends to generalize well to unseen datasets with different characteristics from the training dataset. Several groups have attempted to integrate the power of DCNN to learn complex data representations and the robustness of MAS to changes in image characteristics. However, these studies primarily focused on replacing individual components of MAS with DCNN models and reported marginal improvements in accuracy. In this study we describe and evaluate a 3D end-to-end hybrid MAS and DCNN segmentation pipeline, called Deep Label Fusion (DLF). The DLF pipeline consists of two main components with learnable weights, including a weighted voting subnet that mimics the MAS algorithm and a fine-tuning subnet that corrects residual segmentation errors to improve final segmentation accuracy. We evaluate DLF on five datasets that represent a diversity of anatomical structures (medial temporal lobe subregions and lumbar vertebrae) and imaging modalities (multi-modality, multi-field-strength MRI and Computational Tomography). These experiments show that DLF achieves comparable segmentation accuracy to nnU-Net (Isensee et al., 2020), the state-of-the-art DCNN pipeline, when evaluated on a dataset with similar characteristics to the training datasets, while outperforming nnU-Net on tasks that involve generalization to datasets with different characteristics (different MRI field strength or different patient population). DLF is also shown to consistently improve upon conventional MAS methods. In addition, a modality augmentation strategy tailored for multimodal imaging is proposed and demonstrated to be beneficial in improving the segmentation accuracy of learning-based methods, including DLF and DCNN, in missing data scenarios in test time as well as increasing the interpretability of the contribution of each individual modality.

Artificial Intelligence in Spinal Imaging: Current Status and Future Directions

Spinal maladies are among the most common causes of pain and disability worldwide. Imaging represents an important diagnostic procedure in spinal care. Imaging investigations can provide information and insights that are not visible through ordinary visual inspection. Multiscale in vivo interrogation has the potential to improve the assessment and monitoring of pathologies thanks to the convergence of imaging, artificial intelligence (AI), and radiomic techniques. AI is revolutionizing computer vision, autonomous driving, natural language processing, and speech recognition. These revolutionary technologies are already impacting radiology, diagnostics, and other fields, where automated solutions can increase precision and reproducibility. In the first section of this narrative review, we provide a brief explanation of the many approaches currently being developed, with a particular emphasis on those employed in spinal imaging studies. The previously documented uses of AI for challenges involving spinal imaging, including imaging appropriateness and protocoling, image acquisition and reconstruction, image presentation, image interpretation, and quantitative image analysis, are then detailed. Finally, the future applications of AI to imaging of the spine are discussed. AI has the potential to significantly affect every step in spinal imaging. AI can make images of the spine more useful to patients and doctors by improving image quality, imaging efficiency, and diagnostic accuracy.

Green synthesis of gold nanoparticles in Gum Arabic using pulsed laser ablation for CT imaging

Laser ablation synthesis in liquid solution (PLAL) is a green technique that allows for the physical formation of nanomaterials. This study indicates the preparation of stable gold nanoparticles (AuNPs) in Gum Arabic (GA) solution via laser ablation as a CT contrast agent. The optical properties were achieved using the absorption spectroscopic technique whereas the morphology and size distribution were investigated by TEM and ImageJ software. TEM image shows greater stability and spherical shape of GA-AuNPs with smaller size at 1.85 ± 0.99 nm compared to AuNPs without GA. The absorption spectrum of pure AuNPs has a lower absorption peak height in the visible range at λ = 521 nm, while the spectrum of GA-AuNPs has a higher plasmon peak height at λ = 514 nm with a blue shift towards lower wavelengths. The concentration of GA that dissolved in 10 mL of DI water via laser ablation is set at 20 mg. Increasing the number of pulses has only a minor effect on particle size distribution, which remains tiny in the nanometer range (less than 3 nm). For energies greater than 200 mJ, there is a blue shift toward shorter wavelengths. As the concentration of GA-AuNPs increases, the CT number is also increased indicating good image contrast. It can be concluded that there is a positive and significant influence of GA as a reducing agent for AuNPs, and a contrast agent for CT imaging which highlights its superiority in future medical applications.

Current development and prospects of deep learning in spine image analysis: a literature review

BACKGROUND AND OBJECTIVE

As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature.

METHODS

A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed.

KEY CONTENT AND FINDINGS

The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability.

CONCLUSIONS

The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.

Automated segmentation of the fractured vertebrae on CT and its applicability in a radiomics model to predict fracture malignancy

Although CT radiomics has shown promising results in the evaluation of vertebral fractures, the need for manual segmentation of fractured vertebrae limited the routine clinical implementation of radiomics. Therefore, automated segmentation of fractured vertebrae is needed for successful clinical use of radiomics. In this study, we aimed to develop and validate an automated algorithm for segmentation of fractured vertebral bodies on CT, and to evaluate the applicability of the algorithm in a radiomics prediction model to differentiate benign and malignant fractures. A convolutional neural network was trained to perform automated segmentation of fractured vertebral bodies using 341 vertebrae with benign or malignant fractures from 158 patients, and was validated on independent test sets (internal test, 86 vertebrae [59 patients]; external test, 102 vertebrae [59 patients]). Then, a radiomics model predicting fracture malignancy on CT was constructed, and the prediction performance was compared between automated and human expert segmentations. The algorithm achieved good agreement with human expert segmentation at testing (Dice similarity coefficient, 0.93-0.94; cross-sectional area error, 2.66-2.97%; average surface distance, 0.40-0.54 mm). The radiomics model demonstrated good performance in the training set (AUC, 0.93). In the test sets, automated and human expert segmentations showed comparable prediction performances (AUC, internal test, 0.80 vs 0.87, p = 0.044; external test, 0.83 vs 0.80, p = 0.37). In summary, we developed and validated an automated segmentation algorithm that showed comparable performance to human expert segmentation in a CT radiomics model to predict fracture malignancy, which may enable more practical clinical utilization of radiomics.

Segmentation Performance Comparison Considering Regional Characteristics in Chest X-ray Using Deep Learning

Chest radiography is one of the most widely used diagnostic methods in hospitals, but it is difficult to read clearly because several human organ tissues and bones overlap. Therefore, various image processing and rib segmentation methods have been proposed to focus on the desired target. However, it is challenging to segment ribs elaborately using deep learning because they cannot reflect the characteristics of each region. Identifying which region has specific characteristics vulnerable to deep learning is an essential indicator of developing segmentation methods in medical imaging. Therefore, it is necessary to compare the deep learning performance differences based on regional characteristics. This study compares the differences in deep learning performance based on the rib region to verify whether deep learning reflects the characteristics of each part and to demonstrate why this regional performance difference has occurred. We utilized 195 normal chest X-ray datasets with data augmentation for learning and 5-fold cross-validation. To compare segmentation performance, the rib image was divided vertically and horizontally based on the spine, clavicle, heart, and lower organs, which are characteristic indicators of the baseline chest X-ray. Resultingly, we found that the deep learning model showed a 6-7% difference in the segmentation performance depending on the regional characteristics of the rib. We verified that the performance differences in each region cannot be ignored. This study will enable a more precise segmentation of the ribs and the development of practical deep learning algorithms.

Automated Mathematical Algorithm for Quantitative Measurement of Strabismus Based on Photographs of Nine Cardinal Gaze Positions

This study presents an automated algorithm that measures ocular deviation quantitatively using photographs of the nine cardinal points of gaze by means of deep learning (DL) and image processing techniques. Photographs were collected from patients with strabismus. The images were used as inputs for the DL segmentation models that segmented the sclerae and limbi. Subsequently, the images were registered for the mathematical algorithm. Two-dimensional sclera and limbus were modeled, and the corneal light reflex points of the primary gaze images were determined. Limbus recognition was performed to measure the pixel-wise distance between the corneal reflex point and limbus center. The segmentation models exhibited high performance, with 96.88% dice similarity coefficient (DSC) for the sclera segmentation and 95.71% DSC for the limbus segmentation. The mathematical algorithm was tested on two cranial nerve palsy patients to evaluate its ability to measure and compare ocular deviation in different directions. These results were consistent with the symptoms of such disorders. This algorithm successfully measured the distance of ocular deviation in patients with strabismus. With complementation in the dimension calculations, we expect that this algorithm can be used further in clinical settings to diagnose and measure strabismus at a low cost.

Computer-Aided Diagnosis for Determining Sagittal Spinal Curvatures Using Deep Learning and Radiography

Analyzing spinal curvatures manually is time-consuming and tedious for clinicians, and intra-observer and inter-observer variability can affect manual measurements. In this study, we developed and evaluated the performance of an automated deep learning-based computer-aided diagnosis (CAD) tool for measuring the sagittal alignment of the spine from X-ray images. The CAD system proposed here performs two functions: deep learning-based lateral spine segmentation and automatic analysis of thoracic kyphosis and lumbar lordosis angles. We utilized 322 datasets with data augmentation for learning and fivefold cross-validation. The segmentation model was based on U-Net, which has multiple applications in medical image processing. Here, we utilized parameter equations and trigonometric functions to design spinal angle measurement algorithms. The kyphosis (T4-T12) and lordosis angle (L1-S1, L1-L5) were automatically measured to help diagnose kyphosis and lordosis. The segmentation model had precision, sensitivity, and dice similarity coefficient values of 90.53 ± 4.61%, 89.53 ± 1.8%, and 90.22 ± 0.62%, respectively. The performance of the CAD algorithm was also verified with the Pearson correlation, Bland-Altman, and intra-class correlation coefficient (ICC) analysis. The proposed angle measurement algorithm exhibited high similarity and reliability during verification. Therefore, CAD can help clinicians in reaching a diagnosis by analyzing the sagittal spinal curvatures while reducing observer-based variability and the required time or effort.

Fully automated segmentation of lumbar bone marrow in sagittal, high-resolution T1-weighted magnetic resonance images using 2D U-NET

BACKGROUND

We investigated a 2-dimensional (2D) U-Net model to delineate lumbar bone marrow (BM) using a high resolution T1-weighted magnetic resonance imaging.

METHOD

Healthy controls (n = 44, 836 images) and patients with hematologic diseases (n = 56, 1064 images) received MRI of the lumbar spines. Lumbar BM on each image was manually delineated by an experienced radiologist as a ground-truth. The 2D U-Net models were trained using a healthy lumbar BM only, diseased BM only, and using healthy and diseased BM combined, respectively. The models were validated using healthy and diseased subjects, separately. A repeated-measures analysis of variance was performed to compare segmentation accuracies with 2 validation cohorts among U-Net trained with healthy subjects (UNET_HC), U-Net trained with diseased subjects (UNET_HD), U-Net trained with all subjects including both healthy and diseased subjects (UNET_HCHD), and 3-dimensional Grow-Cut algorithm (3DGC).

RESULTS

When validated with the healthy subjects, UNET_HC, UNET_HD, UNET_HCHD and 3DGC achieved the mean and standard deviation of the Dice Similarity Coefficient (DSC) of 0.9415 ± 0.07056, 0.9583 ± 0.05146, 0.9602 ± 0.0486 and 0.9139 ± 0.2039, respectively. When validated with the diseased subjects, DSCs of UNET_HC, UNET_HD, UNET_HCHD and 3DGC were 0.8303 ± 0.1073, 0.9502 ± 0.0217, 0.9502 ± 0.0217 and 0.8886 ± 0.2179, respectively. The U-Net models segmented BM better than the semi-automatic 3DGC (P < 0.0001), and UNET_HD produced better results than UNET_HC (P < 0.0001).

CONCLUSIONS

We successfully constructed a fully automatic lumbar BM segmentation model for a high-resolution T1-weighted MRI using U-Net, which outperformed most of the previously reported approaches and the existing semi-automatic algorithm.

Clinical utility of convolutional neural networks for treatment planning in radiotherapy for spinal metastases

•

We presented a CNN workflow for segmentation and labeling of vertebrae on CT.

•

This approach proved to be robust in a majority of cases with spinal metastases.

•

The presented workflow can save time in a clinical radiotherapy setting.

•

The approach also allows for more advanced quantitative image analysis of vertebrae.

Background and purpose

Spine delineation is essential for high quality radiotherapy treatment planning of spinal metastases. However, manual delineation is time-consuming and prone to interobserver variability. Automatic spine delineation, especially using deep learning, has shown promising results in healthy subjects. We aimed to evaluate the clinical utility of deep learning-based vertebral body delineations for radiotherapy planning purposes.

Materials and methods

A multi-scale convolutional neural network (CNN) was used for automatic segmentation and labeling. Two approaches were tested: the combined approach using one CNN for both segmentation and labeling, and the sequential approach using separate CNN’s for these tasks. Training and internal validation data included 580 vertebrae, external validation data included 202 vertebrae. For quantitative assessment, Dice similarity coefficient (DSC) and Hausdorff distance (HD) were used. Axial slices from external images were presented to radiation oncologists for subjective evaluation.

Results

Both approaches performed comparably during the internal validation (DSC: 96.7%, HD: 3.6 mm), but the sequential approach proved more robust during the external validation (DSC: 94.5% vs 94.4%, p < 0.001, HD: 4.5 vs 7.1 mm, p < 0.001). Subsequently, subjective evaluation of this sequential approach showed that experienced radiation oncologists could distinguish automatic from human-made contours in 63% of cases. They rated automatic contours clinically acceptable in 77% of cases, compared to 88% of human-made contours.

Conclusion

We present a feasible approach for automatic vertebral body delineation using two variants of a multi-scale CNN. This approach generates high quality automatic delineations, which can save time in a clinical radiotherapy workflow.

Fully automated segmentation in temporal bone CT with neural network: a preliminary assessment study

BACKGROUND

Segmentation of important structures in temporal bone CT is the basis of image-guided otologic surgery. Manual segmentation of temporal bone CT is time- consuming and laborious. We assessed the feasibility and generalization ability of a proposed deep learning model for automated segmentation of critical structures in temporal bone CT scans.

METHODS

Thirty-nine temporal bone CT volumes including 58 ears were divided into normal (n = 20) and abnormal groups (n = 38). Ossicular chain disruption (n = 10), facial nerve covering vestibular window (n = 10), and Mondini dysplasia (n = 18) were included in abnormal group. All facial nerves, auditory ossicles, and labyrinths of the normal group were manually segmented. For the abnormal group, aberrant structures were manually segmented. Temporal bone CT data were imported into the network in unmarked form. The Dice coefficient (DC) and average symmetric surface distance (ASSD) were used to evaluate the accuracy of automatic segmentation.

RESULTS

In the normal group, the mean values of DC and ASSD were respectively 0.703, and 0.250 mm for the facial nerve; 0.910, and 0.081 mm for the labyrinth; and 0.855, and 0.107 mm for the ossicles. In the abnormal group, the mean values of DC and ASSD were respectively 0.506, and 1.049 mm for the malformed facial nerve; 0.775, and 0.298 mm for the deformed labyrinth; and 0.698, and 1.385 mm for the aberrant ossicles.

CONCLUSIONS

The proposed model has good generalization ability, which highlights the promise of this approach for otologist education, disease diagnosis, and preoperative planning for image-guided otology surgery.

Machine learning in orthopaedic surgery

Artificial intelligence and machine learning in orthopaedic surgery has gained mass interest over the last decade or so. In prior studies, researchers have demonstrated that machine learning in orthopaedics can be used for different applications such as fracture detection, bone tumor diagnosis, detecting hip implant mechanical loosening, and grading osteoarthritis. As time goes on, the utility of artificial intelligence and machine learning algorithms, such as deep learning, continues to grow and expand in orthopaedic surgery. The purpose of this review is to provide an understanding of the concepts of machine learning and a background of current and future orthopaedic applications of machine learning in risk assessment, outcomes assessment, imaging, and basic science fields. In most cases, machine learning has proven to be just as effective, if not more effective, than prior methods such as logistic regression in assessment and prediction. With the help of deep learning algorithms, such as artificial neural networks and convolutional neural networks, artificial intelligence in orthopaedics has been able to improve diagnostic accuracy and speed, flag the most critical and urgent patients for immediate attention, reduce the amount of human error, reduce the strain on medical professionals, and improve care. Because machine learning has shown diagnostic and prognostic uses in orthopaedic surgery, physicians should continue to research these techniques and be trained to use these methods effectively in order to improve orthopaedic treatment.

A deep learning algorithm for automated measurement of vertebral body compression from X-ray images

The vertebral compression is a significant factor for determining the prognosis of osteoporotic vertebral compression fractures and is generally measured manually by specialists. The consequent misdiagnosis or delayed diagnosis can be fatal for patients. In this study, we trained and evaluated the performance of a vertebral body segmentation model and a vertebral compression measurement model based on convolutional neural networks. For vertebral body segmentation, we used a recurrent residual U-Net model, with an average sensitivity of 0.934 (± 0.086), an average specificity of 0.997 (± 0.002), an average accuracy of 0.987 (± 0.005), and an average dice similarity coefficient of 0.923 (± 0.073). We then generated 1134 data points on the images of three vertebral bodies by labeling each segment of the segmented vertebral body. These were used in the vertebral compression measurement model based on linear regression and multi-scale residual dilated blocks. The model yielded an average mean absolute error of 2.637 (± 1.872) (%), an average mean square error of 13.985 (± 24.107) (%), and an average root mean square error of 3.739 (± 2.187) (%) in fractured vertebral body data. The proposed algorithm has significant potential for aiding the diagnosis of vertebral compression fractures.

A deep learning method for automatic segmentation of the bony orbit in MRI and CT images

This paper proposes a fully automatic method to segment the inner boundary of the bony orbit in two different image modalities: magnetic resonance imaging (MRI) and computed tomography (CT). The method, based on a deep learning architecture, uses two fully convolutional neural networks in series followed by a graph-search method to generate a boundary for the orbit. When compared to human performance for segmentation of both CT and MRI data, the proposed method achieves high Dice coefficients on both orbit and background, with scores of 0.813 and 0.975 in CT images and 0.930 and 0.995 in MRI images, showing a high degree of agreement with a manual segmentation by a human expert. Given the volumetric characteristics of these imaging modalities and the complexity and time-consuming nature of the segmentation of the orbital region in the human skull, it is often impractical to manually segment these images. Thus, the proposed method provides a valid clinical and research tool that performs similarly to the human observer.

Segmentation and Identification of Vertebrae in CT Scans Using CNN, k-Means Clustering and k-NN

The accurate segmentation and identification of vertebrae presents the foundations for spine analysis including fractures, malfunctions and other visual insights. The large-scale vertebrae segmentation challenge (VerSe), organized as a competition at the Medical Image Computing and Computer Assisted Intervention (MICCAI), is aimed at vertebrae segmentation and labeling. In this paper, we propose a framework that addresses the tasks of vertebrae segmentation and identification by exploiting both deep learning and classical machine learning methodologies. The proposed solution comprises two phases: a binary fully automated segmentation of the whole spine, which exploits a 3D convolutional neural network, and a semi-automated procedure that allows locating vertebrae centroids using traditional machine learning algorithms. Unlike other approaches, the proposed method comes with the added advantage of no requirement for single vertebrae-level annotations to be trained. A dataset of 214 CT scans has been extracted from VerSe’20 challenge data, for training, validating and testing the proposed approach. In addition, to evaluate the robustness of the segmentation and labeling algorithms, 12 CT scans from subjects affected by severe, moderate and mild scoliosis have been collected from a local medical clinic. On the designated test set from Verse’20 data, the binary spine segmentation stage allowed to obtain a binary Dice coefficient of 89.17%, whilst the vertebrae identification one reached an average multi-class Dice coefficient of 90.09%. In order to ensure the reproducibility of the algorithms hereby developed, the code has been made publicly available.

Research on multi-path dense networks for MRI spinal segmentation

Accurate and robust segmentation of anatomical structures from magnetic resonance images is valuable in many computer-aided clinical tasks. Traditional codec networks are not satisfactory because of their low accuracy of edge segmentation, the low recognition rate of the target, and loss of detailed information. To address these problems, this study proposes a series of improved models for semantic segmentation and progressively optimizes them from the three aspects of convolution module, codec unit, and feature fusion. Instead of the standard convolution structure, we apply a new type of convolution module for the feature extraction. The networks integrate a multi-path method to obtain richer-detail edge information. Finally, a dense network is utilized to strengthen the ability of the feature fusion and integrate more different-level information. The evaluation of the Accuracy, Dice coefficient, and Jaccard index led to values of 0.9855, 0.9185, and 0.8507, respectively. These metrics of the best network increased by 1.0%, 4.0%, and 6.1%, respectively. Boundary F1-Score reached 0.9124 indicating that the proposed networks can segment smaller targets to obtain smoother edges. Our methods obtain more key information than traditional methods and achieve superiority in segmentation performance.

A novel segmentation method for cervical vertebrae based on PointNet++ and converge segmentation

BACKGROUND

Cervical spine instability is the key pathogenic factor for cervical spondylosis, which may easily cause cervical spinal cord nerve compression, numbness, weakness, and even paralysis of the limbs. The reconstruction of the internal fixation of the cervical spine is of great therapeutic significance, but is a high-risk and difficult procedure that requires precise planning. The high similarities between vertebrae may interfere with automatic operation planning; therefore, the segmentation of vertebrae is of great significance.

METHODS

Our segmentation algorithm has 3 parts. Firstly, an adaptive threshold filter to segment the cervical vertebra tissue structure form CT images. Secondly, segmentation of single vertebrae based on PointNet++ is introduced to segmentation cervical spine. Finally, converge segmentation which is based on edge information is utilized to clearly distinguish the edges of the two vertebrae to enhance the accuracy segmentation result.

RESULTS

Our approach improved the accuracy of the system up to 96.15%, and achieved the highest reported average score based on this dataset. We compared the results of the CNN and PointNet methods on a separate dataset of 240 CT scans with 18 classes and achieved a significantly higher performance for any given vertebra. Our experiments illustrated the promise and robustness of recent PointNet++-based segmentation of medical images.

CONCLUSION

The proposed method has better classification performance for segmentation cervical spine images, which segment a three-dimensional vertebral body directly and effectively. Furthermore, the precise segmentation of a single vertebral body can be used in automatic biomechanical analysis, computer-aided diagnosis and other aspects, so as to improve the level of automation in the treatment of cervical spondylosis.

The Role of Machine Learning in Spine Surgery: The Future Is Now

The recent influx of machine learning centered investigations in the spine surgery literature has led to increased enthusiasm as to the prospect of using artificial intelligence to create clinical decision support tools, optimize postoperative outcomes, and improve technologies used in the operating room. However, the methodology underlying machine learning in spine research is often overlooked as the subject matter is quite novel and may be foreign to practicing spine surgeons. Improper application of machine learning is a significant bioethics challenge, given the potential consequences of over- or underestimating the results of such studies for clinical decision-making processes. Proper peer review of these publications requires a baseline familiarity of the language associated with machine learning, and how it differs from classical statistical analyses. This narrative review first introduces the overall field of machine learning and its role in artificial intelligence, and defines basic terminology. In addition, common modalities for applying machine learning, including classification and regression decision trees, support vector machines, and artificial neural networks are examined in the context of examples gathered from the spine literature. Lastly, the ethical challenges associated with adapting machine learning for research related to patient care, as well as future perspectives on the potential use of machine learning in spine surgery, are discussed specifically.

A Review on the Use of Artificial Intelligence in Spinal Diseases

Artificial neural networks (ANNs) have been used in a wide variety of real-world applications and it emerges as a promising field across various branches of medicine. This review aims to identify the role of ANNs in spinal diseases. Literature were searched from electronic databases of Scopus and Medline from 1993 to 2020 with English publications reported on the application of ANNs in spinal diseases. The search strategy was set as the combinations of the following keywords: “artificial neural networks,” “spine,” “back pain,” “prognosis,” “grading,” “classification,” “prediction,” “segmentation,” “biomechanics,” “deep learning,” and “imaging.” The main findings of the included studies were summarized, with an emphasis on the recent advances in spinal diseases and its application in the diagnostic and prognostic procedures. According to the search strategy, a set of 3,653 articles were retrieved from Medline and Scopus databases. After careful evaluation of the abstracts, the full texts of 89 eligible papers were further examined, of which 79 articles satisfied the inclusion criteria of this review. Our review indicates several applications of ANNs in the management of spinal diseases including (1) diagnosis and assessment of spinal disease progression in the patients with low back pain, perioperative complications, and readmission rate following spine surgery; (2) enhancement of the clinically relevant information extracted from radiographic images to predict Pfirrmann grades, Modic changes, and spinal stenosis grades on magnetic resonance images automatically; (3) prediction of outcomes in lumbar spinal stenosis, lumbar disc herniation and patient-reported outcomes in lumbar fusion surgery, and preoperative planning and intraoperative assistance; and (4) its application in the biomechanical assessment of spinal diseases. The evidence suggests that ANNs can be successfully used for optimizing the diagnosis, prognosis and outcome prediction in spinal diseases. Therefore, incorporation of ANNs into spine clinical practice may improve clinical decision making.