2-Dimensional Long Film O-Arm Imaging, an Alternative When Intraoperative Fluoroscopy Is Inadequate

Multi-perspective region-based CNNs for vertebrae labeling in intraoperative long-length images

PURPOSE

Effective aggregation of intraoperative x-ray images that capture the patient anatomy from multiple view-angles has the potential to enable and improve automated image analysis that can be readily performed during surgery. We present multi-perspective region-based neural networks that leverage knowledge of the imaging geometry for automatic vertebrae labeling in Long-Film images - a novel tomographic imaging modality with an extended field-of-view for spine imaging.

METHOD

A multi-perspective network architecture was designed to exploit small view-angle disparities produced by a multi-slot collimator and consolidate information from overlapping image regions. A second network incorporates large view-angle disparities to jointly perform labeling on images from multiple views (viz., AP and lateral). A recurrent module incorporates contextual information and enforce anatomical order for the detected vertebrae. The three modules are combined to form the multi-view multi-slot (MVMS) network for labeling vertebrae using images from all available perspectives. The network was trained on images synthesized from 297 CT images and tested on 50 AP and 50 lateral Long-Film images acquired from 13 cadaveric specimens. Labeling performance of the multi-perspective networks was evaluated with respect to the number of vertebrae appearances and presence of surgical instrumentation.

RESULTS

The MVMS network achieved an F1 score of >96% and an average vertebral localization error of 3.3 mm, with 88.3% labeling accuracy on both AP and lateral images - (15.5% and 35.0% higher than conventional Faster R-CNN on AP and lateral views, respectively). Aggregation of multiple appearances of the same vertebra using the multi-slot network significantly improved the labeling accuracy (p < 0.05). Using the multi-view network, labeling accuracy on the more challenging lateral views was improved to the same level as that of the AP views. The approach demonstrated robustness to the presence of surgical instrumentation, commonly encountered in intraoperative images, and achieved comparable performance in images with and without instrumentation (88.9% vs. 91.2% labeling accuracy).

CONCLUSION

The MVMS network demonstrated effective multi-perspective aggregation, providing means for accurate, automated vertebrae labeling during spine surgery. The algorithms may be generalized to other imaging tasks and modalities that involve multiple views with view-angle disparities (e.g., bi-plane radiography). Predicted labels can help avoid adverse events during surgery (e.g., wrong-level surgery), establish correspondence with labels in preoperative modalities to facilitate image registration, and enable automated measurement of spinal alignment metrics for intraoperative assessment of spinal curvature.

Novel 2D long film imaging utility to avoid wrong level spinal surgery

Wrong-level spinal surgery (WLSS) can lead to increased morbidity, cost, and worse long-term outcomes. Current intraoperative localization methods rely on counting spinal levels from a known reference location using fluoroscopy. Miscounting from a reference is an intraoperative error that leads to WLSS, especially for those with anatomical variations. The problem is exacerbated when fluoroscopy is not able to produce images with the clarity needed to confidently count levels, a prevalent issue for obese patients.

A new feature called the “2D Long Film'' is available for the Medtronic (Minneapolis, MN) O-arm Surgical Imaging System. Using this novel technology and standard fluoroscopy, this study reports the imaging of two obese adult female patients with a body mass index of 36.9 and 42.0 undergoing transforaminal thoracic interbody fusion. Fluoroscopy images of obese patients are difficult to capture for two reasons: increased scatter and restricted field of view. This report demonstrates that 2D Long Film can improve both these issues for obese patients in need of thoracic localization. The 2D Long Film captures existing instrumentation, localization needles, and the vertebral levels in a clear single image.

We display the differences between standard fluoroscopy and the 2D Long Film for thoracic level localization, demonstrating a potential new standard of care and better visualization, leading to a less challenging vertebrae localization process, potentially mitigating WLSS risk. The quality of this new 2D Long Film feature could also reduce time in the operating room and the necessity of other visualization methods.

Deformable 3D-2D image registration and analysis of global spinal alignment in long-length intraoperative spine imaging

BACKGROUND

Spinal deformation during surgical intervention (caused by patient positioning and/or correction of malalignment) confounds conventional navigation due to assumptions of rigid transformation. Moreover, the ability to accurately quantify spinal alignment in the operating room would provide assessment of the surgical product via metrics that correlate with clinical outcome.

PURPOSE

A method for deformable 3D-2D registration of preoperative CT to intraoperative long-length tomosynthesis images is reported for accurate 3D evaluation of device placement in the presence of spinal deformation and automated evaluation of global spinal alignment (GSA).

METHODS

Long-length tomosynthesis ("Long Film", LF) images were acquired using an O-arm™ imaging system (Medtronic, Minneapolis USA). A deformable 3D-2D patient registration was developed using multi-scale masking (proceeding from the full-length image to local subvolumes about each vertebra) to transform vertebral labels and planning information from preoperative CT to the LF images. Automatic measurement of GSA [Main Thoracic Kyphosis (MThK) and Lumbar Lordosis (LL)] was obtained using a spline fit to registered labels. The "Known-Component Registration" (KC-Reg) method for device registration was adapted to the multi-scale process for 3D device localization from orthogonal LF images. The multi-scale framework was evaluated using a deformable spine phantom in which pedicle screws were inserted, and deformations were induced over a range in LL ∼25-80°. Further validation was carried out in a cadaver study with implanted pedicle screws and a similar range of spinal deformation. The accuracy of patient and device registration was evaluated in terms of 3D translational error and target registration error (TRE), respectively, and the accuracy of automatic GSA measurements were compared to manual annotation.

RESULTS

Phantom studies demonstrated accurate registration via the multi-scale framework for all vertebral levels in both the neutral and deformed spine: median (interquartile range, IQR) patient registration error was 1.1 mm (0.7-1.9 mm IQR). Automatic measures of MThK and LL agreed with manual delineation within -1.1° ± 2.2° and 0.7° ± 2.0° (mean and standard deviation), respectively. Device registration error was 0.7 mm (0.4-1.0 mm IQR) at the screw tip and 0.9° (1.0°-1.5°) about the screw trajectory. Deformable 3D-2D registration significantly outperformed conventional rigid registration (p < 0.05), which exhibited device registration error of 2.1 mm (0.8-4.1 mm) and 4.1° (1.2°-9.5°). Cadaver studies verified performance under realistic conditions, demonstrating patient registration error of 1.6 mm (0.9-2.1 mm); MThK within -4.2° ± 6.8° and LL within 1.7° ± 3.5°; and device registration error of 0.8 mm (0.5-1.9 mm) and 0.7° (0.4°-1.2°) for the multi-scale deformable method, compared to 2.5 mm (1.0-7.9 mm) and 2.3° (1.6°-8.1°) for rigid registration (p < 0.05).

CONCLUSION

The deformable 3D-2D registration framework leverages long-length intraoperative imaging to achieve accurate patient and device registration over extended lengths of the spine (up to 64 cm) even with strong anatomical deformation. The method offers a new means for quantitative validation of spinal correction (intraoperative GSA measurement) and 3D verification of device placement in comparison to preoperative images and planning data. This article is protected by copyright. All rights reserved.

A Review of the Methods on Cobb Angle Measurements for Spinal Curvature

Scoliosis is a common disease of the spine and requires regular monitoring due to its progressive properties. A preferred indicator to assess scoliosis is by the Cobb angle, which is currently measured either manually by the relevant medical staff or semi-automatically, aided by a computer. These methods are not only labor-intensive but also vary in precision by the inter-observer and intra-observer. Therefore, a reliable and convenient method is urgently needed. With the development of computer vision and deep learning, it is possible to automatically calculate the Cobb angles by processing X-ray or CT/MR/US images. In this paper, the research progress of Cobb angle measurement in recent years is reviewed from the perspectives of computer vision and deep learning. By comparing the measurement effects of typical methods, their advantages and disadvantages are analyzed. Finally, the key issues and their development trends are also discussed.

Intraoperative cone-beam and slot-beam CT: 3D image quality and dose with a slot collimator on the O-arm imaging system

PURPOSE

To characterize the 3D imaging performance and radiation dose for a prototype slot-beam configuration on an intraoperative O-arm™ Surgical Imaging System (Medtronic Inc., Littleton, MA) and identify potential improvements in soft-tissue image quality for surgical interventions.

METHODS

A slot collimator was integrated with the O-arm^™ system for slot-beam axial CT. The collimator can be automatically actuated to provide 1.2° slot-beam longitudinal collimation. Cone-beam and slot-beam configurations were investigated with and without an antiscatter grid (12:1 grid ratio, 60 lines/cm). Dose, scatter, image noise, and soft-tissue contrast resolution were evaluated in quantitative phantoms for head and body configurations over a range of exposure levels (beam energy and mAs), with reconstruction performed via filtered-backprojection. Qualitative imaging performance across various anatomical sites and imaging tasks was assessed with anthropomorphic head, abdomen, and pelvis phantoms.

RESULTS

The dose for a slot-beam scan varied from 0.02-0.06 mGy/mAs for head protocols to 0.01-0.03 mGy/mAs for body protocols, yielding dose reduction by ∼1/5 to 1/3 compared to cone-beam, owing to beam collimation and reduced x-ray scatter. The slot-beam provided an ∼6-7× reduction in scatter-to-primary ratio (SPR) compared to the cone-beam, yielding SPR ∼20-80% for head and body without the grid and ∼7-30% with the grid. Compared to cone-beam scans at equivalent dose, slot-beam images exhibited an ∼2.5× increase in soft-tissue contrast-to-noise ratio (CNR) for both grid and gridless configurations. For slot-beam scans, a further ∼10-30% improvement in CNR was achieved when the grid was removed. Slot-beam imaging could benefit certain interventional scenarios in which improved visualization of soft tissues is required within a fairly narrow longitudinal region of interest ( ± 7 mm in z )--for example, checking the completeness of tumor resection, preservation of adjacent anatomy, or detection of complications (e.g., hemorrhage). While preserving existing capabilities for fluoroscopy and cone-beam CT, slot-beam scanning could enhance the utility of intraoperative imaging and provide a useful mode for safety and validation checks in image-guided surgery.

CONCLUSIONS

The 3D imaging performance and dose of a prototype slot-beam CT configuration on the O-arm^™ system was investigated. Substantial improvements in soft-tissue image quality and reduction in radiation dose are evident with the slot-beam configuration due to reduced x-ray scatter.