TY - EJOU AU - Wu, Xian AU - Song, Wei AU - Zhang, Xukun AU - Lin, Ganghua AU - Wang, Haimin AU - Deng, Yuanyong TI - Algorithm Development of Cloud Removal from Solar Images Based on Pix2Pix Network T2 - Computers, Materials \& Continua PY - 2022 VL - 71 IS - 2 SN - 1546-2226 AB - Sky clouds affect solar observations significantly. Their shadows obscure the details of solar features in observed images. Cloud-covered solar images are difficult to be used for further research without pre-processing. In this paper, the solar image cloud removing problem is converted to an image-to-image translation problem, with a used algorithm of the Pixel to Pixel Network (Pix2Pix), which generates a cloudless solar image without relying on the physical scattering model. Pix2Pix is consists of a generator and a discriminator. The generator is a well-designed U-Net. The discriminator uses PatchGAN structure to improve the details of the generated solar image, which guides the generator to create a pseudo realistic solar image. The image generation model and the training process are optimized, and the generator is jointly trained with the discriminator. So the generation model which can stably generate cloudless solar image is obtained. Extensive experiment results on Huairou Solar Observing Station, National Astronomical Observatories, and Chinese Academy of Sciences (HSOS, NAOC and CAS) datasets show that Pix2Pix is superior to the traditional methods based on physical prior knowledge in peak signal-to-noise ratio, structural similarity, perceptual index, and subjective visual effect. The result of the PSNR, SSIM and PI are 27.2121 dB, 0.8601 and 3.3341. KW - Pix2Pix; solar image; cloud removal DO - 10.32604/cmc.2022.022325