Automatic Bone Segmentation from MRI for Real-Time Knee Tracking in Fluoroscopic Imaging

Recent progress in real-time tracking of knee bone structures from fluoroscopic imaging using CT templates has opened the door to studying knee kinematics to improve our understanding of patellofemoral syndrome. The problem with CT imaging is that it exposes patients to extra ionising radiation, which adds to fluoroscopic imaging. This can be solved by segmenting bone templates from MRI instead of CT by using a deep neural network architecture called 2.5D U-Net. To train the network, we used the SKI10 database from the MICCAI challenge; it contains 100 knee MRIs with their corresponding annotated femur and tibia bones as the ground truth. Since patella tracking is essential in our application, the SKI10 database was augmented with a new label named UofA Patella. Using 70 MRIs from the database, a 2.5D U-Net was trained successfully after 75 epochs with an excellent final Dice score of 98%, which compared favourably with the best state-of-the-art algorithms. A test set of 30 MRIs were segmented using the trained 2.5D U-Net and then converted into 3D mesh templates by using a marching cube algorithm. The resulting 3D mesh templates were compared to the 3D mesh model extracted from the corresponding labelled data from the augmented SKI10. Even though the final Dice score (98%) compared well with the state-of-the-art algorithms, we initially found that the Euclidean distance between the segmented MRI and SKI10 meshes was over 6 mm in many regions, which is unacceptable for our application. By optimising many of the hyper-parameters of the 2.5D U-Net, we were able to find that, by changing the threshold used in the last layer of the network, one can significantly improve the average accuracy to 0.2 mm with a variance of 0.065 mm for most of the MRI mesh templates. These results illustrate that the Dice score is not always a good predictor of the geometric accuracy of segmentation and that fine-tuning hyper-parameters is critical for improving geometric accuracy.

Convex optimization for additive noise reduction in quantitative complex object wave retrieval using compressive off-axis digital holographic imaging

Image denoising is one of the important problems in the research field of computer vision, artificial intelligence, 3D vision, and image processing, where the fundamental aim is to recover the original image features from a noisy contaminated image. The camera sensor additive noise present in the holographic recording process reduces the quality of the retrieved image. Even though various techniques have been developed to minimize the noise in digital holography, the noise reduction still remains a challenging task. This article presents a compressive sensing (CS) technique to minimize the additive noise in the digital holographic reconstruction process. We demonstrate the reduction of additive noise using complex wave retrieval method as a sensing matrix in the CS model. The proposed CS method to suppress the noise during the reconstruction process is illustrated using numerical simulations. Only 50% of the pixel measurements are considered in the noisy hologram, which is far less than the original complex object pixels. The impact of additive gaussian noise in the recording plane on the reconstruction accuracy of both intensity and phase distribution is analysed. The CS method denoises and estimates the complex object information accurately. The numerical simulation results have shown that the proposed CS method has effectively minimized the noise in the reconstructed image and has greatly improved the quality of both intensity and phase information.