Vol.36, No.3, 2021, pp.537-549, doi:10.32604/csse.2021.014578
ASRNet: Adversarial Segmentation and Registration Networks for Multispectral Fundus Images
  • Yanyun Jiang1, Yuanjie Zheng1,2,*, Xiaodan Sui1, Wanzhen Jiao3, Yunlong He4, Weikuan Jia1
1 School of Information Science and Engineering, Shandong Normal University, Jinan, 250358, China
2 Key Laboratory of Intelligent Computing & Information Security in Universities of Shandong, Shandong Provincial Key Laboratory for Novel Distributed Computer Software Technology, Institute of Biomedical Sciences, Shandong Normal University, Jinan, 250358, China
3 Shandong Provincial Hospital Affiliated to Shandong University, Jinan, 250021, China
4 INSA Lyon, University of Lyon, CNRS, Inserm, Villeurbanne, 69621, Cedex, France
* Corresponding Author: Yuanjie Zheng. Email:
Received 30 September 2020; Accepted 19 November 2020; Issue published 18 January 2021
Multispectral imaging (MSI) technique is often used to capture images of the fundus by illuminating it with different wavelengths of light. However, these images are taken at different points in time such that eyeball movements can cause misalignment between consecutive images. The multispectral image sequence reveals important information in the form of retinal and choroidal blood vessel maps, which can help ophthalmologists to analyze the morphology of these blood vessels in detail. This in turn can lead to a high diagnostic accuracy of several diseases. In this paper, we propose a novel semi-supervised end-to-end deep learning framework called “Adversarial Segmentation and Registration Nets” (ASRNet) for the simultaneous estimation of the blood vessel segmentation and the registration of multispectral images via an adversarial learning process. ASRNet consists of two subnetworks: (i) A segmentation module S that fulfills the blood vessel segmentation task, and (ii) A registration module R that estimates the spatial correspondence of an image pair. Based on the segmention-driven registration network, we train the segmentation network using a semi-supervised adversarial learning strategy. Our experimental results show that the proposed ASRNet can achieve state-of-the-art accuracy in segmentation and registration tasks performed with real MSI datasets.
Deep learning; deformable image registration; image segmentation; multispectral imaging (MSI)
Cite This Article
Y. Jiang, Y. Zheng, X. Sui, W. Jiao, Y. He et al., "Asrnet: adversarial segmentation and registration networks for multispectral fundus images," Computer Systems Science and Engineering, vol. 36, no.3, pp. 537–549, 2021.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.