RsALUNet : a reinforcement supervision U-Net-based framework for multi-ROI segmentation of medical images

Abstract

A new multiple region of interest (multi-ROI) segmentation framework, RsALUNet, is proposed in this paper, whose backbone was U-Net. Rs represented the reinforcement-supervision strategy by utilizing adversarial learning (AL) between U-Net’s decoders and an additional discriminator, which was based on the differences among the segmentation results (diff Segs increasingly similar to diff Labels ) and labels of multi-ROI (diff Labels ). As the AL progressed, diff Segs was , and this further contributed to a more accurate segmentation of each member in the multi-ROI. In addition to the Rs strategy, three blocks were proposed to enhance RsALUNet, namely, a dilated convolution chain providing diverse and large receptive fields to accommodate different target sizes, a fusion block integrating features of large targets to small ones to optimize the segmentation of the latter, and a location- encoder block extracting multi-scale positional information to enhance the model’s attention to the ROI. RsALUNet was evaluated through three multi-ROI segmentation tasks using different imaging modalities, including X-ray, ultrasound, and magnetic-resonance (MR) imaging. The mean Dice coefficient (Dice) increased from 1.1% to 8.5% compared to the other frameworks. The results demonstrate the promising adaptability and extendibility of our strategy and RsALUNet for multi-ROI segmentation in X-ray, ultrasound, and MR images.