Open Access iconOpen Access



Optical Flow with Learning Feature for Deformable Medical Image Registration

Jinrong Hu1, Lujin Li1, Ying Fu1, Maoyang Zou1, Jiliu Zhou1, Shanhui Sun2,*

1 Department of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China
2 Curacloud Corporation, 999 Third Ave, Suite 700 Seattle, WA, 98104, USA

* Corresponding Author: Shanhui Sun. Email: email

Computers, Materials & Continua 2022, 71(2), 2773-2788.


Deformable medical image registration plays a vital role in medical image applications, such as placing different temporal images at the same time point or different modality images into the same coordinate system. Various strategies have been developed to satisfy the increasing needs of deformable medical image registration. One popular registration method is estimating the displacement field by computing the optical flow between two images. The motion field (flow field) is computed based on either gray-value or handcrafted descriptors such as the scale-invariant feature transform (SIFT). These methods assume that illumination is constant between images. However, medical images may not always satisfy this assumption. In this study, we propose a metric learning-based motion estimation method called Siamese Flow for deformable medical image registration. We train metric learners using a Siamese network, which produces an image patch descriptor that guarantees a smaller feature distance in two similar anatomical structures and a larger feature distance in two dissimilar anatomical structures. In the proposed registration framework, the flow field is computed based on such features and is close to the real deformation field due to the excellent feature representation ability of the Siamese network. Experimental results demonstrate that the proposed method outperforms the Demons, SIFT Flow, Elastix, and VoxelMorph networks regarding registration accuracy and robustness, particularly with large deformations.


Cite This Article

J. Hu, L. Li, Y. Fu, M. Zou, J. Zhou et al., "Optical flow with learning feature for deformable medical image registration," Computers, Materials & Continua, vol. 71, no.2, pp. 2773–2788, 2022.

cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1563


  • 985


  • 0


Share Link