A learning-based method for online adjustment of C-arm Cone-beam CT source trajectories for artifact avoidance

An interactive task-based method for the avoidance of metal artifacts in CBCT

PURPOSE

Intraoperative cone-beam CT imaging enables 3D validation of implant positioning and fracture reduction for orthopedic and trauma surgeries. However, the emergence of metal artifacts, especially in the vicinity of metallic objects, severely degrades the clinical value of the imaging modality. In previous works, metal artifact avoidance (MAA) methods have been shown to reduce metal artifacts by adapting the scanning trajectory. Yet, these methods fail to translate to clinical practice due to remaining methodological constraints and missing workflow integration.

METHODS

In this work, we propose a method to compute the spatial distribution and calibrated strengths of expected artifacts for a given tilted circular trajectory. By visualizing this as an overlay changing with the C-Arm's tilt, we enable the clinician to interactively choose an optimal trajectory while factoring in the procedural context and clinical task. We then evaluate this method in a realistic human cadaver study and compare the achieved image quality to acquisitions optimized using global metrics.

RESULTS

We assess the effectiveness of the compared methods by evaluation of image quality gradings of depicted pedicle screws. We find that both global metrics as well as the proposed visualization of artifact distribution enable a drastic improvement compared to standard non-tilted scans. Furthermore, the novel interactive visualization yields a significant improvement in subjective image quality compared to the state-of-the-art global metrics. Additionally we show that by formulating an imaging task, the proposed method allows to selectively optimize image quality and avoid artifacts in the region of interest.

CONCLUSION

We propose a method to spatially resolve predicted artifacts and provide a calibrated measure for artifact strength grading. This interactive MAA method proved practical and effective in reducing metal artifacts in the conducted cadaver study. We believe this study serves as a crucial step toward clinical application of an MAA system to improve image quality and enhance the clinical validation of implant placement.

Fully automatic online geometric calibration for non-circular cone-beam CT orbits using fiducials with unknown placement

BACKGROUND

Cone-beam CT (CBCT) with non-circular scanning orbits can improve image quality for 3D intraoperative image guidance. However, geometric calibration of such scans can be challenging. Existing methods typically require a prior image, specialized phantoms, presumed repeatable orbits, or long computation time.

PURPOSE

We propose a novel fully automatic online geometric calibration algorithm that does not require prior knowledge of fiducial configuration. The algorithm is fast, accurate, and can accommodate arbitrary scanning orbits and fiducial configurations.

METHODS

The algorithm uses an automatic initialization process to eliminate human intervention in fiducial localization and an iterative refinement process to ensure robustness and accuracy. We provide a detailed explanation and implementation of the proposed algorithm. Physical experiments on a lab test bench and a clinical robotic C-arm scanner were conducted to evaluate spatial resolution performance and robustness under realistic constraints.

RESULTS

Qualitative and quantitative results from the physical experiments demonstrate high accuracy, efficiency, and robustness of the proposed method. The spatial resolution performance matched that of our existing benchmark method, which used a 3D-2D registration-based geometric calibration algorithm.

CONCLUSIONS

We have demonstrated an automatic online geometric calibration method that delivers high spatial resolution and robustness performance. This methodology enables arbitrary scan trajectories and should facilitate translation of such acquisition methods in a clinical setting.

Enhanced artificial intelligence-based diagnosis using CBCT with internal denoising: Clinical validation for discrimination of fungal ball, sinusitis, and normal cases in the maxillary sinus

BACKGROUND AND OBJECTIVE

The cone-beam computed tomography (CBCT) provides three-dimensional volumetric imaging of a target with low radiation dose and cost compared with conventional computed tomography, and it is widely used in the detection of paranasal sinus disease. However, it lacks the sensitivity to detect soft tissue lesions owing to reconstruction constraints. Consequently, only physicians with expertise in CBCT reading can distinguish between inherent artifacts or noise and diseases, restricting the use of this imaging modality. The development of artificial intelligence (AI)-based computer-aided diagnosis methods for CBCT to overcome the shortage of experienced physicians has attracted substantial attention. However, advanced AI-based diagnosis addressing intrinsic noise in CBCT has not been devised, discouraging the practical use of AI solutions for CBCT. We introduce the development of AI-based computer-aided diagnosis for CBCT considering the intrinsic imaging noise and evaluate its efficacy and implications.

METHODS

We propose an AI-based computer-aided diagnosis method using CBCT with a denoising module. This module is implemented before diagnosis to reconstruct the internal ground-truth full-dose scan corresponding to an input CBCT image and thereby improve the diagnostic performance. The proposed method is model agnostic and compatible with various existing and future AI-based denoising or diagnosis models.

RESULTS

The external validation results for the unified diagnosis of sinus fungal ball, chronic rhinosinusitis, and normal cases show that the proposed method improves the micro-, macro-average area under the curve, and accuracy by 7.4, 5.6, and 9.6% (from 86.2, 87.0, and 73.4 to 93.6, 92.6, and 83.0%), respectively, compared with a baseline while improving human diagnosis accuracy by 11% (from 71.7 to 83.0%), demonstrating technical differentiation and clinical effectiveness. In addition, the physician's ability to evaluate the AI-derived diagnosis results may be enhanced compared with existing solutions.

CONCLUSION

This pioneering study on AI-based diagnosis using CBCT indicates that denoising can improve diagnostic performance and reader interpretability in images from the sinonasal area, thereby providing a new approach and direction to radiographic image reconstruction regarding the development of AI-based diagnostic solutions. Furthermore, we believe that the performance enhancement will expedite the adoption of automated diagnostic solutions using CBCT, especially in locations with a shortage of skilled clinicians and limited access to high-dose scanning.

Source-detector trajectory optimization for CBCT metal artifact reduction based on PICCS reconstruction

Precise instrument placement plays a critical role in all interventional procedures, especially percutaneous procedures such as needle biopsies, to achieve successful tumor targeting and increased diagnostic accuracy. C-arm cone beam computed tomography (CBCT) has the potential to precisely visualize the anatomy in direct vicinity of the needle and evaluate the adequacy of needle placement during the intervention, allowing for instantaneous adjustment in case of misplacement. However, even with the most advanced C-arm CBCT devices, it can be difficult to identify the exact needle position on CBCT images due to the strong metal artifacts around the needle. In this study, we proposed a framework for customized trajectory design in CBCT imaging based on Prior Image Constrained Compressed Sensing (PICCS) reconstruction with the goal of reducing metal artifacts in needle-based procedures. We proposed to optimize out-of-plane rotations in three-dimensional (3D) space and minimize projection views while reducing metal artifacts at specific volume of interests (VOIs). An anthropomorphic thorax phantom with a needle inserted inside and two tumor models as the imaging targets were used to validate the proposed approach. The performance of the proposed approach was also evaluated for CBCT imaging under kinematic constraints by simulating some collision areas on the geometry of the C-arm. We compared the result of optimized 3D trajectories using the PICCS algorithm and 20 projections with the result of a circular trajectory with sparse view using PICCS and Feldkamp, Davis, and Kress (FDK), both using 20 projections, and the circular FDK method with 313 projections. For imaging targets 1 and 2, the highest values of structural similarity index measure (SSIM) and universal quality index (UQI) between the reconstructed image from the optimized trajectories and the initial CBCT image at the VOI was calculated 0.7521, 0.7308 and 0.7308, 0.7248 respectively. These results significantly outperformed the FDK method (with 20 and 313 projections) and the PICCS method (20 projections) both using the circular trajectory. Our results showed that the proposed optimized trajectories not only significantly reduce metal artifacts but also suggest a dose reduction for needle-based CBCT interventions, considering the small number of projections used. Furthermore, our results showed that the optimized trajectories are compatible with spatially constrained situations and enable CBCT imaging under kinematic constraints when the standard circular trajectory is not feasible.

Synthetic data accelerates the development of generalizable learning-based algorithms for X-ray image analysis

Artificial intelligence (AI) now enables automated interpretation of medical images. However, AI's potential use for interventional image analysis remains largely untapped. This is because the post hoc analysis of data collected during live procedures has fundamental and practical limitations, including ethical considerations, expense, scalability, data integrity and a lack of ground truth. Here we demonstrate that creating realistic simulated images from human models is a viable alternative and complement to large-scale in situ data collection. We show that training AI image analysis models on realistically synthesized data, combined with contemporary domain generalization techniques, results in machine learning models that on real data perform comparably to models trained on a precisely matched real data training set. We find that our model transfer paradigm for X-ray image analysis, which we refer to as SyntheX, can even outperform real-data-trained models due to the effectiveness of training on a larger dataset. SyntheX provides an opportunity to markedly accelerate the conception, design and evaluation of X-ray-based intelligent systems. In addition, SyntheX provides the opportunity to test novel instrumentation, design complementary surgical approaches, and envision novel techniques that improve outcomes, save time or mitigate human error, free from the ethical and practical considerations of live human data collection.

Computed Tomography: State-of-the-Art Advancements in Musculoskeletal Imaging

ABSTRACT

Although musculoskeletal magnetic resonance imaging (MRI) plays a dominant role in characterizing abnormalities, novel computed tomography (CT) techniques have found an emerging niche in several scenarios such as trauma, gout, and the characterization of pathologic biomechanical states during motion and weight-bearing. Recent developments and advancements in the field of musculoskeletal CT include 4-dimensional, cone-beam (CB), and dual-energy (DE) CT. Four-dimensional CT has the potential to quantify biomechanical derangements of peripheral joints in different joint positions to diagnose and characterize patellofemoral instability, scapholunate ligamentous injuries, and syndesmotic injuries. Cone-beam CT provides an opportunity to image peripheral joints during weight-bearing, augmenting the diagnosis and characterization of disease processes. Emerging CBCT technologies improved spatial resolution for osseous microstructures in the quantitative analysis of osteoarthritis-related subchondral bone changes, trauma, and fracture healing. Dual-energy CT-based material decomposition visualizes and quantifies monosodium urate crystals in gout, bone marrow edema in traumatic and nontraumatic fractures, and neoplastic disease. Recently, DE techniques have been applied to CBCT, contributing to increased image quality in contrast-enhanced arthrography, bone densitometry, and bone marrow imaging. This review describes 4-dimensional CT, CBCT, and DECT advances, current logistical limitations, and prospects for each technique.

Source-detector trajectory optimization in cone-beam computed tomography: a comprehensive review on today’s state-of-the-art

Cone-beam computed tomography (CBCT) imaging is becoming increasingly important for a wide range of applications such as image-guided surgery, image-guided radiation therapy as well as diagnostic imaging such as breast and orthopaedic imaging. The potential benefits of non-circular source-detector trajectories was recognized in early work to improve the completeness of CBCT sampling and extend the field of view (FOV). Another important feature of interventional imaging is that prior knowledge of patient anatomy such as a preoperative CBCT or prior CT is commonly available. This provides the opportunity to integrate such prior information into the image acquisition process by customized CBCT source-detector trajectories. Such customized trajectories can be designed in order to optimize task-specific imaging performance, providing intervention or patient-specific imaging settings. The recently developed robotic CBCT C-arms as well as novel multi-source CBCT imaging systems with additional degrees of freedom provide the possibility to largely expand the scanning geometries beyond the conventional circular source-detector trajectory. This recent development has inspired the research community to innovate enhanced image quality by modifying image geometry, as opposed to hardware or algorithms. The recently proposed techniques in this field facilitate image quality improvement, FOV extension, radiation dose reduction, metal artifact reduction as well as 3D imaging under kinematic constraints. Because of the great practical value and the increasing importance of CBCT imaging in image-guided therapy for clinical and preclinical applications as well as in industry, this paper focuses on the review and discussion of the available literature in the CBCT trajectory optimization field. To the best of our knowledge, this paper is the first study that provides an exhaustive literature review regarding customized CBCT algorithms and tries to update the community with the clarification of in-depth information on the current progress and future trends.

Accuracy Assessment of Percutaneous Pedicle Screw Placement Using Cone Beam Computed Tomography with Metal Artifact Reduction

Metal artifact reduction (MAR) algorithms are used with cone beam computed tomography (CBCT) during augmented reality surgical navigation for minimally invasive pedicle screw instrumentation. The aim of this study was to assess intra- and inter-observer reliability of pedicle screw placement and to compare the perception of baseline image quality (NoMAR) with optimized image quality (MAR). CBCT images of 24 patients operated on for degenerative spondylolisthesis using minimally invasive lumbar fusion were analyzed retrospectively. Images were treated using NoMAR and MAR by an engineer, thus creating 48 randomized files, which were then independently analyzed by 3 spine surgeons and 3 radiologists. The Gertzbein and Robins classification was used for screw accuracy rating, and an image quality scale rated the clarity of pedicle screw and bony landmark depiction. Intra-class correlation coefficients (ICC) were calculated. NoMAR and MAR led to similarly good intra-observer (ICC > 0.6) and excellent inter-observer (ICC > 0.8) assessment reliability of pedicle screw placement accuracy. The image quality scale showed more variability in individual image perception between spine surgeons and radiologists (ICC range 0.51−0.91). This study indicates that intraoperative screw positioning can be reliably assessed on CBCT for augmented reality surgical navigation when using optimized image quality. Subjective image quality was rated slightly superior for MAR compared to NoMAR.

Universal orbit design for metal artifact elimination

Objective.Metal artifacts are a persistent problem in CT and cone-beam CT. In this work, we propose to reduce or even eliminate metal artifacts by providing better sampling of data using non-circular orbits.Approach.We treat any measurements intersecting metal as missing data, and aim to design a universal orbit that can generally accommodate arbitrary metal shapes and locations. We adapted a local sampling completeness metric based on Tuy's condition to quantify the extent of sampling in the presence of metal. A maxi-min objective over all possible metal locations was used for orbit design. A simple class of sinusoidal orbits was evaluated as a function of frequencies, maximum tilt angles, and orbital extents. Experimental implementation of these orbits were performed on an imaging bench and evaluated on two phantoms, one containing metal balls and the other containing a pedicle screw assembly for spine fixation. Metal artifact reduction (MAR) performance was compared amongst three approaches: non-circular orbits only, algorithmic correction only, and a combined approach.Main results.Theoretical evaluations of the objective favor sinusoidal orbits with large tilt angles and large orbital extents. Furthermore, orbits that leverage redundant azimuthal angles to sample non-redundant data have better performance, e.g. even or non-integer frequency sinusoids for a 360° acquisition. Experimental data support the trends observed in theoretical evaluations. Reconstructions using even or non-integer frequency orbits present less streaking artifacts and background details with finer resolution, even when multiple metal objects are present and even in the absence of MAR algorithms. The combined approach of non-circular orbits and MAR algorithm yields the best performance. The observed trend in image quality is supported by quantitative measures of sampling and severity of streaking artifact.Significance.This work demonstrates that sinusoidal orbits are generally robust against metal artifacts and can provide an avenue for improved image quality in interventional imaging.

Convex optimization algorithms in medical image reconstruction - in the age of AI

The past decade has seen the flourish of model based image reconstruction (MBIR) algorithms, which are often applications or adaptations of convex optimization algorithms from the optimization community. We review some state-of-the-art algorithms that have enjoyed wide popularity in medical image reconstruction, emphasize known connections between different algorithms, and discuss practical issues such as computation and memory cost. More recently, deep learning (DL) has forayed into medical imaging, where the latest development tries to exploit the synergy between DL and MBIR to elevate the MBIR's performance. We present existing approaches and emerging trends in DL-enhanced MBIR methods, with particular attention to the underlying role of convexity and convex algorithms on network architecture. We also discuss how convexity can be employed to improve the generalizability and representation power of DL networks in general.

The Impact of Machine Learning on 2D/3D Registration for Image-Guided Interventions: A Systematic Review and Perspective

Image-based navigation is widely considered the next frontier of minimally invasive surgery. It is believed that image-based navigation will increase the access to reproducible, safe, and high-precision surgery as it may then be performed at acceptable costs and effort. This is because image-based techniques avoid the need of specialized equipment and seamlessly integrate with contemporary workflows. Furthermore, it is expected that image-based navigation techniques will play a major role in enabling mixed reality environments, as well as autonomous and robot-assisted workflows. A critical component of image guidance is 2D/3D registration, a technique to estimate the spatial relationships between 3D structures, e.g., preoperative volumetric imagery or models of surgical instruments, and 2D images thereof, such as intraoperative X-ray fluoroscopy or endoscopy. While image-based 2D/3D registration is a mature technique, its transition from the bench to the bedside has been restrained by well-known challenges, including brittleness with respect to optimization objective, hyperparameter selection, and initialization, difficulties in dealing with inconsistencies or multiple objects, and limited single-view performance. One reason these challenges persist today is that analytical solutions are likely inadequate considering the complexity, variability, and high-dimensionality of generic 2D/3D registration problems. The recent advent of machine learning-based approaches to imaging problems that, rather than specifying the desired functional mapping, approximate it using highly expressive parametric models holds promise for solving some of the notorious challenges in 2D/3D registration. In this manuscript, we review the impact of machine learning on 2D/3D registration to systematically summarize the recent advances made by introduction of this novel technology. Grounded in these insights, we then offer our perspective on the most pressing needs, significant open problems, and possible next steps.

Toward on-the-fly trajectory optimization for C-arm CBCT under strong kinematic constraints

Cone beam computed tomography (CBCT) has become a vital tool in interventional radiology. Usually, a circular source-detector trajectory is used to acquire a three-dimensional (3D) image. Kinematic constraints due to the patient size or additional medical equipment often cause collisions with the imager while performing a full circular rotation. In a previous study, we developed a framework to design collision-free, patient-specific trajectories for the cases in which circular CBCT is not feasible. Our proposed trajectories included enough information to appropriately reconstruct a particular volume of interest (VOI), but the constraints had to be defined before the intervention. As most collisions are unpredictable, performing an on-the-fly trajectory optimization is desirable. In this study, we propose a search strategy that explores a set of trajectories that cover the whole collision-free area and subsequently performs a search locally in the areas with the highest image quality. Selecting the best trajectories is performed using simulations on a prior diagnostic CT volume which serves as a digital phantom for simulations. In our simulations, the Feature SIMilarity Index (FSIM) is used as the objective function to evaluate the imaging quality provided by different trajectories. We investigated the performance of our methods using three different anatomical targets inside the Alderson-Rando phantom. We used FSIM and Universal Quality Image (UQI) to evaluate the final reconstruction results. Our experiments showed that our proposed trajectories could achieve a comparable image quality in the VOI compared to the standard C-arm circular CBCT. We achieved a relative deviation less than 10% for both FSIM and UQI metrics between the reconstructed images from the optimized trajectories and the standard C-arm CBCT for all three targets. The whole trajectory optimization took approximately three to four minutes.