Intelligent Automation & Soft Computing DOI:10.32604/iasc.2021.017437
Article

An Adaptive SAR Despeckling Method Using Cuckoo Search Algorithm

Memoona Malik*, Iftikhar Azim, Amir Hanif Dar and Sohail Asghar

COMSATS University Islamabad, Islamabad, 44000, Pakistan
*Corresponding Author: Memoona Malik. Email: memoonamalik@comsats.edu.pk
Received: 30 January 2021; Accepted: 11 March 2021

Abstract: Despeckling of SAR imagery is a crucial step prior to their automated interpretation as information extraction from noisy images is a challenging task. Though a huge despeckling literature exists in this regard, there is still a room for improvement in existing techniques. The contemporary despeckling techniques adversely affect image edges during the noise reduction process and are thus responsible for losing the significant image features. Therefore, to preserve important features during the speckle reduction process, a two phase hybrid despeckling filter is proposed in this study. The first phase of the hybrid filter focuses on edge preservation by employing a new edge detection criterion for the guided filter. Whereas the second phase attempted to suppress speckle by utilizing some speckle suppression and edge preservation filters whose sequence is determined by the cuckoo search optimization algorithm (CSO). The CSO generates optimal sequences of these filters according to the nature of input images with peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) as its objective function. Performance comparison of the proposed hybrid filter with state-of-the art techniques has revealed its best despeckling behavior on standard and real SAR images.

Keywords: Cuckoo search optimization; edge preserving filters; hybrid filter; noise suppressing filters; SAR despeckling; speckle noise

1  Introduction

SAR (Synthetic Aperture Radar) imaging systems have been extensively used in Earth monitoring satellites for surveillance purposes as they provide high resolution images in the presence of natural obstacles such as clouds, dust, snow and drizzle [1]. However, due to the occurrence of speckle noise in SAR imagery, automated interpretation of these images becomes difficult. Usually speckle noise induces strong random variations in digital images due to its multiplicative nature. Therefore, it is responsible for severe distortion of important image contents in both homogeneous and heterogeneous regions (such as edges and textures) [2].To resolve this problem, many despeckling techniques have been developed so far which can be broadly classified into hybrid and non-hybrid techniques. The non-hybrid techniques are further classified into spatial domain filters i.e., local and non-local (NL), and frequency domain filters such as wavelets and curvelets.

The concept of local filters did not work well for heterogeneous regions as values of the neighboring pixels are quite different from the value of the pixel to be altered. Thus, local filters do not remove noise in heterogeneous regions and are responsible for blurring textures and edges due to the wrong estimation [3,4]. To overcome the problem of local filters, researchers have devised NL filters in past few years. Unlike local filters, these filters look up for a similar pixel or a block anywhere in the image which exhibits the same statistical nature as that of the selected pixel to preserve images’ fine details. However, all the NL based approaches suffer from the issues of increased computational cost, over-smoothening of low contrast regions and blurring of fine details at higher noise intensities while leaving residuals near the edges [5,6].

The wavelet based methods have also been extensively utilized for noise reduction purposes. But, the wavelet representation of 2D images produces a large number of wavelet coefficients that needs to be estimated for noise reduction. Estimating a large number of coefficients results in high mean square errors which affects the despeckling accuracy of wavelets [7]. Moreover, the wavelet transform based approaches are responsible for producing Gibbs-like ringing effects in homogeneous regions and near the edges [8]. In contrast, the curvelet transform is a better noise reduction scheme which is designed using mutilscale ridgelets at very fine scales to represent the curved edges as straight lines. This property of curvelet transform help preserve edges in a noisy image [9–11]. However, they fail to smooth homogeneous areas.

To cater all the above discussed issues of individual filters, various hybrid filters were proposed to reduce the speckle and preserve image details simultaneously [12–22]. Some of the hybrid filters investigated the parallel combination of existing filters i.e. SAR-BM3D and HLSS-C. These type of parallel combinations are computationally complex as the constituent filters itself belong to the category of hybrid ones. In contrast, those hybrid filters which has explored the sequence of standalone filters i.e. wiener filter, wavelet transform, cosine transform, guided filter, weighted least square filters, accomplishes the better despeckling performance with reasonable cost. For instance, SAR-BM3D, a renowned hybrid filter, has explored the denoising capabilities of wiener filtering in the wavelet transformed domain. Cost of SAR-BM3D is far less than the above described parallel combinations. The notion of SAR-BM3D has outperformed all the previous filters in SAR despeckling, however, it suffers from the blurring effect of wiener filtering and incapability of wavelets in edge preservation. Due to these limitations of the employed techniques, SAR-BM3D produces whitish areas in homogeneous regions and undergoes loss of details in heterogeneous regions.

This scenario motivates us in designing a novel despeckling approach that would despeckle different natured images i.e., images rich in homogeneous content and images containing high degree of edges, without losing important image details. Hence, in this paper, a concept of two phase hybrid filter is proposed that would preserve edges in the first phase and despeckle the diverse natured images in the second phase.

For edge preservation, a modified guided filter with a new edge detection criterion is proposed in the first phase. Whereas for speckle reduction, an adaptive sequence of some noise suppressing and edge preserving filters is determined in the second phase. The sequences are in accordance with the varying nature of images. Therefore, the proposed two phase hybrid filter is expected to better suppress noise in different types of images while preserving the significant image features. Detailed explanation of the proposed approach is provided in Section 2 while experimental evaluation of the proposed hybrid filter on standard and real SAR images is provided in Sections 3 and 4. And finally, Section 5 presents the conclusion of this paper.

2  Proposed Method

This study proposes a two phase hybrid filter for edge preservation while suppressing the speckle noise especially form SAR imagery. In the first phase, an improved version of the guided filter with a new edge detection criterion is presented to preserve edges. Afterwards, the output of the proposed guided filter gets fused with the wiener filter to benefit from the wiener’s speckle suppression capabilities as well as to obtain an initial estimate of the despeckled image. Though the output of the first phase competes with several despeckling filters in terms of edge retention, it failed to surpass the hybrid filters in despeckling accuracy. Consequently, the second phase becomes complementary for boosting the speckle reduction capabilities of the first phase. The second phase thus takes the initial despeckled estimate as an input and determines a unique sequence of some noise suppressing and edge preserving filters using the CSO. It is expected that the generated unique sequences are in accordance with the nature of the basic estimate i.e. rich in homogeneous or heterogeneous content, and helpful in improving the despeckling accuracy. Block diagram of the proposed two phase hybrid filter is provided in Fig. 1 for further comprehension.

2.1 First Phase

The Guided filter was designed with the notion of preserving edges [23]. It performs the neighborhood operation using any guidance image given to it and restores edges by maintaining the edge values as provided in the guidance image. The output of the guided filter, qi, can be computed as

qi=akIk+bk,∀i∈ωk (1)

where Ik is the guidance image, and ak and bk are linear coefficients which can be calculated by minimizing the difference between input and the output images.

Figure 1: Block diagram of the proposed hybrid filter

To improve the edge preserving performance of the guided filter, this study modified the guided filter for speckle suppression by proposing a new edge detection criterion based on the Curvelet transform and the canny edge detection operator.

Among many edge detection operators, canny operator is the one which is considered as the most reliable one. So, we utilized the edge map (EM) generated by the canny operator as a guide to the GF. The EM, being a binary image, restricts the values of ak to remain in the range of 0 to 1 and provides a reliable edge preserving estimate to the GF. But, the problem associated with the EM is that it is dependent on the input image. If the input image is noisy, then obtaining all the edges may get difficult. Hence, to improve the EM, a curvelet transform is first applied on the noisy input image for speckle reduction. Curvelet transform is a better noise suppression transform than many others with the edge preservation characteristics. It is designed using mutilscale ridgelets at very fine scales to represent the curved edges as straight lines and to preserve them in any noisy image. The canny operator is then applied on the curvelet transformed image to obtain a better EM. The finalized EM is then employed to re-compute the coefficient ak (Fig. 2).

Figure 2: Re-computation of ak′ using curvelet transform and canny operator

The proposed EM for enhancing the edge preservation performance of the GF can be calculated as:

EM=Canny(Ti) (2)

where

Ti=CT(N) (3)

where CT is the curvelet transform and N is the input image. To detect edges, this EM is incorporated in the Eq. (4) of the GF. The new equation becomes:

E′(ak′,bk′)=∑i∈wi⁡((ak,bk′−pi)+EM (4)

The improved guided filter minimizes the input and output images pi and qi . The coefficients ak and bk will be recomputed using new edge detection criterion as

ak′=1|ω|∑i∈ωkIiPi+μk′p¯k′σ2k′+EM (5)

bk′=p¯k′−ak′μk′ (6)

And the output image qi will then be calculated using ak′ andbk′ as follows

q^i=a^kIk+b^k (7)

where a^k and b^k represents the mean values of ak′ and bk′ .

Fig. 3 below provides a comparison between GF and the proposed improved GF on fruits image at simulated speckle with variance 0.03 in terms of SSIM. And Fig. 4 presents a comparison between the proposed GF with and without the curvelet transform.

Figure 3: Comparison of original and improved guided filter

The curvelet transform is better at edge preservation than speckle suppression. Therefore, the first phase fused the output of the proposed GF with the wiener filter for adequate image smoothing. This fusion combines the edge information provided by the proposed GF with the noise suppressing capability of the wiener filter to produce a despeckled image with preserved edges (Fig. 5).

Figure 4: Comparison of proposed guided filter with and without curvelet transform as a guidance image

Hence, the fused result provides a strong basic estimate for the second phase to operate on and enhance the despeckling performance. Output of the first phase competes with many standalone filters but failed to surpass the hybrid filters especially SAR-BM3D in terms of speckle suppression. Tab. 1 below provides a comparison of the first phase with contemporary standalone filters i.e., NLM, WT and CT, and hybrid filters i.e., PPB, FANS and SAR-BM3D, in terms of PSNR and SSIM.

Figure 5: Performance of filters used in the first phase

Table 1: Comparison of First Phase with Existing Filters on Cameraman at Speckle 0.03

2.2 Second Phase

The second phase computes a unique sequence of some predefined noise suppressing filters i.e., SRAD, wiener, wavelet, NLM, and edge preserving filters such as NLM based GF, wavelet based GF and curvelet based GF. This unique sequence is applied to the output of the first phase for enhancing its depeckling accuracy. In order to determine the unique sequence of the above mentioned filters, this study has explored the use of a multi objective optimization algorithm namely cuckoo search optimization (CSO) algorithm with PSNR, SSIM, and standard deviation (SD) as its objective function [24].

For our despeckling problem, the modified cuckoo search algorithm starts with an initial population of 5 nests holding one egg each (one sequence of 4 filters). The best eggs (solutions) are kept after evaluating their fitness through the objective function (PSNR & SSIM), and passed over to the next generations for quicker convergence. Remaining nests are populated using the levy distribution and their fitness is again compared with the best nests through the objective function [25]. Bad nests with poor performances are destroyed with the probability of 0.35. In order to determine the best combination of filters for despeckling each input image, the CSO iteratively maximizes PSNR and SSIM, and minimizes SD. In this experiment, the algorithm will stop after 30 iterations as it starts repeating values after 30 iterations.

The optimal sequence generated by the CSO comprises of four filters. Two of which gets fused i.e. one noise suppressing and edge preserving filter are combined to merge the information from two despeckled images. Position of the remaining two are adjusted in accordance with the fusion result to enhance the performance of the second phase. The CSO finds out which filters should be fused and which ones should be applied in a sequence before or after the fusion. The possible filter organizations are listed below:

1.    Fusion of Filter 1 & 2 Filter 3 Filter4

2.    Filter 1 Fusion of Filter 2 & 3 Filter 4

3.    Filter 1 Filter 2 Fusion of Filter 3 & 4

Unlike some previous attempts, the second phase of the proposed filter does not consider SAR-BM3D as one of the candidate filter due to its high computational cost. The filter selection criteria for designing the second phase of the proposed filter includes minimal computational cost and capability to maximally suppress noise and preserve image edges. This criteria automatically redirects the filter selection decision towards the standalone filters as hybrid filters are costly. The selected filters are provided in Tab. 2 along with their used parameters.

Table 2: Detail of noise suppressing and edge preservation filters

The generated optimal sequences i.e., [1, (9, 11), 6] represent the number of filters. Thus, according to the sequence, [1, (31, 2), 7], the filters that would be applied to despeckle an image are: WT on the noisy image, Fusion of wiener and NLM based GF, and SRAD.

To justify the need of a sequential application of multiple filters, a Lena image corrupted with 0.03 simulated speckle is taken as an example. The visual comparison is also provided for better understanding of the proposed approach (Fig. 6).

Figure 6: Result of applying combination (1, (12, 1), 6) on lena image corrupted with speckle 0.03

Fig. 6 shows the PSNR values after each step. Observation from Fig. 6 reveals that the PSNR value is at its maximum after applying the last filter. These initial results demonstrated the concept of adaptive computation which helps maintain image structures while performing the speckle suppression. A detailed comparison of hybrid despeckling filters i.e. PPB, FANS, SAR_BM3D and the proposed approach has been carried out on two test images i.e., boat and baboon. To prove the effectiveness of the proposed approach in terms of PSNR (Figs. 7 and 8) and SSIM (Figs. 9 and 10), this experiment has been conducted at several noise intensities. The CSO generates different sequences of filters for both images because of their dissimilar nature. This behavior of CSO demonstrates the adaptive nature of the proposed hybrid filter.

Figure 7: PSNR values of boat image

Figure 8: PSNR values of baboon image

Figure 9: SSIM values of boat image

Figure 10: SSIM values of baboon image

The image baboon is an indoor single object image containing less details as compared to the outdoor boat image. Hence, the permutation of filters generated by the CSO for baboon image is same at various noise intensities whereas different for boat image at different noise intensities (Tab. 3).

Table 3: Permutation of filters for Baboon and Boat images

3  Experimental Results on Standard Images

To investigate the strengths and weaknesses of the proposed filter, we first carried out an experiment on standard test images which are provided in Fig. 11. The selected gray scale test images are of different resolutions i.e., 256 × 256 and 512 × 512, and of different characteristics i.e., single and multi-object. Single object images i.e., Lena, baboon and Zelda, contain less details whereas indoor multi object images such as fruits, peppers, man and living room, and outdoor multi object images i.e., boat and hill are rich in texture and edges. Filters that are used in this experiment for comparison include NLM, PPB, FANS, SAR-BM3D, Curvelets and Wavelets. After confirming the despeckling performance of the proposed filter on standard images, a satellite data set was used to demonstrate its robustness.

Figure 11: Standard test images. (a) Cameraman (512 × 512), (b) Lena (256 × 256), (c) Peppers (512 × 512), (d) Baboon (512 × 512), (e) Zelda (512 × 512), (f) Fruits (512 × 512), (g) Man (512 × 512), (h) Boat (512 × 512), (i) Living room (512 × 512), (j) Hill (512 × 512)

Tabs. 4 and 5 below presents the despeckling results in terms of PSNR at simulated speckle with variance σ = 0.03 and σ = 0.05. The purpose of selecting two variance levels is to examine the performance of all filters at lower and higher levels of noise. Tabs. 6 and 7 presents the structure related information in terms of SSIM values. Despeckling results shown by the proposed filter on both types of images at several noise variances revealed its remarkable performance when compared with existing filters.

Table 4: PSNR values of existing and proposed filter at speckle 0.03

Table 5: PSNR values of existing and proposed filter at speckle 0.05

Table 6: SSIM values of existing and proposed filter at speckle 0.03

Table 7: SSIM values of existing and proposed filter at speckle 0.05

The proposed hybrid filter has shown an increase in PSNR values on all test images when compared with the standalone filters. Whereas, the curvelet transform has the best structure preserving capability as compared to the hybrid filters as depicted in Tabs. 5 and 7. The red highlighted values are greater than the proposed filter while yellow highlighted values are only greater than the SAR-BM3D. Mostly, curvelets perform better than the proposed filter in terms of SSIM, however, an exceptional behavior of NLM and wavelets has also been observed on the baboon and boat image.

The proposed filter has also demonstrated the good despeckling performance when assessed against the hybrid filters. It outperformed the present hybrid filters in terms of PSNR on all test images except the cameraman image. SAR-BM3D performs better despeckling on the cameraman image at both noise levels than the proposed. However, the proposed filter has shown the second good PSNR values at the cameraman image and it outperformed the SAR-BM3D in structural similarity index. The despeckling performance of the proposed filter on remaining test images, belonging to the discussed three categories, is remarkable.

An increase of 0.5 and greater has been seen in PSNR values of Lena and Baboon at both noise intensities (Fig. 12). However, Zelda has shown an increase of 0.3 to 0.5. The SSIM values, instead, are increased to 0.8 and higher on all single object images (Fig. 13). The filter sequences for Lena and baboon images are same on two different noise intensities. Whereas, different permutations for Zelda has produced the said results.

Figure 12: PSNR values at σ = 0.03 and σ = 0.05

Figure 13: SSIM values at σ = 0.03 and σ = 0.05

Multi object indoor and outdoor images presented an increase in PSNR and SSIM values depicting better performance of the proposed hybrid filter. Two best results among the test images are the Man image at σ = 0.03 showing an increase of 0.8 in PSNR and the Peppers image with an increase of 0.8 at σ = 0.05. Moreover, the increase in SSIM values observed for both these categories ranging from 0.02 to 0.1. A visual comparison of a multi object image is also provided below for further comprehension of the robustness of the proposed filter (Fig. 14).

Figure 14: Man at 0.05. (a) Original, (b) Noisy, (c) NLM, (d) WT, (e) CT, (f) PPB, (g) FANS, (h) SARBM3D, (i) Proposed

Poor noise suppression has been shown by both wavelets and curvelets. However, the curvelet transform tends to preserve the structural similarity in many images better than the SARBM3D. NLM also failed to preserve the structure of images but showed better noise suppression due to the blurring of image details. PPB has done the maximum over smoothing compared to the others and did not perform well in terms of both PSNR and SSIM on all images. Similarly, FANS also failed to accomplish the results equivalent to that of SAR-BM3D although it claimed the ability of detail preservation. The despeckling behavior of SAR-BM3D can be analyzed from Fig. 14 provided above. SAR-BM3D attempted to minimize the MMSE by blurring the image details. Extra whitening on Man’s face and hands and on the first lady’s shirt, the disappearance of texture on second lady’s shirt are the problems of over smoothing caused by SAR-BM3D. On the other hand, the proposed filter suppresses noise without these effects.

A histogram analysis of the image peppers is provided below as an evidence that the proposed filter restores speckled images even better than the various existing hybrid filters (Fig. 15).

Figure 15: Comparison of Hybrid filters for Peppers at 0.03. (a) Proposed, (b) SAR-BM3D, (c) Original, (d) FANS, (e) PPB

4  Experimental Results on SAR Imagery

Performance of the proposed approach is also assessed on real SAR imagery. For this experiment, we extracted two patches of 256 × 256 from single look Terra-SAR-X images which are provided in Fig. 16 below. ENL values of the existing and the proposed algorithm after despeckling different regions of interest (ROI) are provided in Tab. 8.

Figure 16: (a) Image 1, (b) Image 2

As speckle is inherent in SAR images, it is not possible to obtain clean SAR images and thus we can’t use PSNR and SSIM as the objective function of CSO. So, we propose standard deviation (SD) of SAR images as the objective function of CSO when we have to deal with real SAR imagery. The sequence determined by the CSO for first SAR image is [7, (1,12), 9] while [7, (9,1), 9] is for the second image.

Table 8: ENL Values of existing and proposed filter

Tab. 8 presents the ENL values of four regions of interests. ROI1 and ROI2 are taken from image1 while ROI3 and ROI4 belongs to the image2. Higher ENL values are shown by the PPB filter which does maximum smoothing of details as compared to all other standalone and hybrid filters. FANS and PPB both performs over smoothening, so their ENL values are greater than the others. Then comes SAR-BM3D, as it also blurs some of the details due to wiener filtering. The proposed filter did not surpass hybrid filters in smoothening of homogeneous regions as it is an edge preserving filter. And being its focus on preserving edges, it does not over smoothens details which ultimately results in lower ENL values.

All the empirical evaluations on standard and real SAR imagery are provided in Tabs. 4–7 which clearly shows the outstanding performance of the proposed hybrid filter in terms of PSNR and SSIM except on the cameraman image. However, the ENL values are lower than the other hybrid filters. One of the reasons for lower ENLs may be the despeckling without causing any kind of blurs. This behavior eventually helps in proving the best edge preservation capability of the proposed filter. The sequences generated by the CSO for despeckling of each image are also provided in the tables which may or may not be the same for any image at different noise intensities. This adaptive nature of the proposed hybrid filter is definitely the result of employing CSO in its design. Figs. 14 and 15 presents the noise suppression capability of the proposed on standard images whereas in Fig. 17, visual comparison of a real SAR image is provided. Robustness and effectiveness of the proposed filter can be analyzed through provided tables and figures.

Figure 17: Performance comparison of filters (a) Noisy, (b) NLM, (c) WT, (d) CT, (e) PPB, (f) FANS, (g) SARBM3D, (h) Proposed

5  Conclusion

To tackle the issue of speckle suppression while feature preservation, this study proposes a two phase hybrid filter. The first phase help preserve edges with a new edge detection criterion presented for the guided filter. The first phase also combines the output of the GF with the wiener filter for adequate smoothing. The result of the first phase is considered as an initial despeckled estimate and passed on to the second phase for further enhancement. The second phase determines optimal sequences of some predefined speckle suppressing and edge preserving filters with the help of CSO. Therefore, the second phase is helpful in boosting the despeckling accuracy while preserving edges.

We have utilized the standard test and real SAR images to assess the despeckling performance of the proposed and state-of-the-art filters in terms of PSNR, SSIM and ENL. The empirical evaluation revealed that the generated sequences of filters are in accordance with the image and noise characteristics. And this adaptive nature of the proposed filter helps in obtaining better despeckling accuracy and structural similarity on different noise levels and types of images. Hence, the despeckled images produced by the proposed hybrid filter can be used in many automated image processing applications.

Funding Statement: The authors received no specific funding for this study.

Conflicts of Interest: The authors declare that they have no conflicts of interests.

This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.