Synthetic MRI-Assisted and Self-Supervised Adaptive Segmentation of Organs-at-Risk (OARs) in MRI-Based Radiation Therapy

PURPOSE/OBJECTIVE(S)

This study proposes a self-supervised solution for OAR segmentation, combining patch-based adaptation and unsupervised synthesis of T2-weighted MRI data to finetune the segmentation model. The aim is to improve adaptation to patient anatomy, overcome limited annotated MRI data, and enhance the generalizability of automatic segmentation models for gynecological cancers.

MATERIALS/METHODS

The study used a patch-based cycle consistent generative adversarial network (cycle-GAN) for unsupervised MRI synthesis from CT scans of 20 patients, and a residual U-Net model for OARs segmentation. The segmentation model was trained and validated on synthetic MRI (sMRI) of 103 and 25 patient scans respectively, then finetuned on 78 MRI scans from radiation therapy fractions of 15 additional patients through three-fold cross validation. Self-supervised adaptation was applied, incorporating affine and elastic deformations, intensity shifting, and scaling. The model was trained on 96 × 96 × 96 sub-volumes and validated on entire pelvic sections of the same images. A combination of Dice and weighted cross entropy (CE) losses, with weights assigned for bladder (1), small bowel (1), rectum (2), sigmoid (2), left femoral head (0), and right femoral head (0), was used for OAR segmentation. The performance was evaluated against the model trained only on a limited number of acquired MRI data, as well as sMRI pretrained models with encoder weight freezing and either equal weighting or soft-tissue adjusted weighting.

RESULTS

Our sMRI-assisted approach showed improved performance for challenging pelvic OARs compared to the method using only the acquired MRI data. The self-supervised fraction-adaptive segmentation results indicated better performance in target soft-tissues when using at least one treatment fraction for organ-specific adaptation.

CONCLUSION

Our framework leverages pre-existing CT planning data for gynecological cancers to enhance the segmentation performance of OARs during MR-guided adaptive treatments. This approach offers substantial benefits for the radiation therapy workflow, including reduced variability in per-fraction segmentation and clinical burden. Further studies that involve human expert evaluations will be conducted to assess the practicality of this approach in radiation therapy.