Open Access
2 January 2019 Restoration of remote sensing images based on nonconvex constrained high-order total variation regularization
Jianguang Zhu, Kai Li, Binbin Hao
Author Affiliations +
Funded by: National Natural Science Foundation of China (NSFC), Qindao Postdoctoral Science Foudation, China, Project of Shandong Province Higher Educational Science and Technology Program, China, Joint Innovative Center for Safe and Effective Mining Technology and Equipment of Coal Resources, Shandong Province of China and SDUST Research Fund
Abstract
Convex total variation (TV) regularization models have been widely used in remote sensing image restoration problems; however, these models tend to produce staircase effects. We consider a nonconvex second-order TV regularization model with linear constraints for remote sensing image restoration. To solve the nonconvex second-order TV regularization model, we propose an efficient alternating minimization algorithm based on generalized iterated shrinkage algorithm and alternating direction method of multipliers. Experimental results demonstrate the effectiveness of the proposed model, which can reduce staircase effects while preserving edges. In terms of signal-to-noise ratio and structural similarity index measure, the experimental results show that our proposed model and algorithm can give better performance compared with some state-of-the-art methods.

1.

Introduction

Image restoration has been widely studied in remote sensing image processing in the last decades.16 Image restoration problem refers to recovering an image from blurry and noisy observation. For simplicity, we assume that the underlying images have square domains and are grayscale. Let uRM×M be an original image, KRM×M represent a blurring or convolution operator, nRM×M be an additive noise, and gRM×M be the degraded or contaminated image. The image restoration model can be described as follows:

Eq. (1)

g=Ku+n.

It is well known that recovering u from g is a classical linear ill-posed inverse problem, and it is hard to directly find the solution. Many scholars have done a lot of research on the ill-posed problem and found that adding a regularization term to the restoration model can solve this problem effectively. Consequently, the image restoration methods with regularization have attracted wide attention.

A well-known regularized inverse problem is the Tikhonov regularization approach,7 which can be formulated as a one-step filter via Fourier transform for image restoration. Therefore, it produces a smoothing effect on the restored image, i.e., the Tikhonov-like regularization tends to make images overly smooth and often fails to preserve image edges. In comparison, a successful image restoration regularization model is the popular total variation (TV) restoration model, which was first proposed by Rudin et al.8,9 for Gaussian noise removal and then extended to image deconvolution. This regularization approach achieves an important advantage for edge-preserving image restoration. It has been proved to be effective both experimentally and theoretically. The model with TV regularization can be described as

Eq. (2)

minuu1+μ2Kug22.

The first term describes the TV regularization, where u denotes the gradient of u, and it is defined as u=(xu,yu)T. The second term is the fidelity term, which measures the difference between g and Ku. And μ>0 is a regularized scale parameter tuning the weight between these two terms. x and y are the two linear differential operators given as

(xu)i,j={ui+1,jui,jif  i<M,u1,juM,jif  i=M,(yu)i,j={ui,j+1ui,jif  j<M,ui,1ui,Mif  j=M,
for i,j=1,,M. Here, ui,j refers to the (jM+i)’th entry of the vector u. It is the (i,j)’th pixel location of the image, see Ref. 10.

The TV models have shown a remarkable advantage in preserving images’ sharp edges. In the last decade, a number of methods have been proposed to solve the unconstrained model [Eq. (2)], such as a fixed point iteration method, Newton’s method, Chambolle’s projection algorithm, iterative shrinkage/thresholding algorithms, alternating direction minimization (ADM) methods (see for instance Refs. 1112.13.14.15.16.17.18.19.20.21.22.23.24.25.26.27.28 and references therein). However, TV-based method suffers from the so-called staircasing phenomenon. Staircase solutions developed false edges that do not exist in the true image. To alleviate this drawback, many improved variation models have been proposed, such as high-order TV regularization methods2931 and fractional order TV model.3235 Combining the first-order and second-order TV regularizations, Papafitsoros and Schönlieb36 proposed a hybrid variational model. By balancing the first- and second-order derivative regularizations, Bredies et al.37 proposed the total generalized variation (TGV) model, which can eliminate the staircase artifacts. In this paper, we focus on the high-order TV regularization. The majority of the high-order norms involve second-order differential operators because piecewise vanishing second-order derivatives lead to piecewise linear solutions that better fit smooth regions (see Ref. 38 for more details).

The above regularization terms lead to a convex optimization. It is well known that the convergence of the convex optimization problem is guaranteed. TV minimization, which is the l1 norm of the gradient magnitude image (GMI), exploits the sparsity of GMI. However, the l1 norm usually underestimates the nonzero values underlying the signal.39 Chen and Selesnick40 indicated that nonconvex regularizer can exhibit sparser solution than l1 regularizer. To improve the shortcoming, a number of nonconvex regularizers are introduced. Nikolova et al.41 developed a nonsmooth nonconvex image restoration model to recover image with neat edges. Based on wavelet tight frame and the TV, Lv et al.42 investigated a nonconvex hybrid variational regularization for restoring the degraded images. Using nonconvex and nonsmooth potential function, Zhang et al.43 proposed a nonconvex and nonsmooth TGV model. Recent research reveals that for modeling the sparseness of image gradient, the lp-norm (·pp) with 0<p<1 is more suitable than the l1-norm (·1) of TV regularizer.44 In the works of Xu et al.,45 an efficient iterative half-thresholding algorithm to solve the l12 norm for noisy signal recovery was proposed. In Ref. 46, Zuo et al. introduced a generalized iterated shrinkage algorithm (GISA) by extending the popular soft-thresholding operator to solve the following image deconvolution model with p-norm:

Eq. (3)

minuμupp+12Kug22.

Recently, Afonso et al.47 proposed the following constrained TV regularized problem:

Eq. (4)

minuϕ(u)s.t.  Kugδ,
where the parameter δ>0 is an estimate of the noise level in the data and ϕ(u) is a regularization function. In the case where ϕ(u)=u1, the above problem is usually known as basis pursuit denoising (BPD).48 Meanwhile, the authors put forward a constrained split augmented Lagrangian shrinkage algorithm (C-SALSA) to solve the constrained model [Eq. (4)]. The experimental results indicate that C-SALSA method is effective and promising. Constrained problems are usually much more difficult to solve than unconstrained ones. Although, it has the important advantage that choosing a reasonable parameter δ is easier than finding a suitable regularization parameter μ.49

Inspired by the above-mentioned advantages of the nonconvex regularization and second-order TV regularization, we propose the following nonconvex approximation model with a linear constraint:

Eq. (5)

minu2upps.t.  Kug2δ,
where 2u=(xxuxyuyxuyyu) denotes the second-order discrete gradient of u. For solving the proposed nonconvex model [Eq. (5)], combining generalization of soft-thresholding algorithm and alternating direction method, we develop an efficient alternating iterated algorithm. The detailed solution process will be explained in Sec. 2. We report experimental results and do some comparisons. The comparison results show that our method is efficient and performs better than some state-of-the-art methods.

The paper is organized as follows: in Sec. 2, using the variable splitting technique, augmented Lagrangian method of multipliers (ADMM), and generalized soft-thresholding algorithm, an efficient alternating iterated algorithm is proposed to solve the proposed model [Eq. (5)]. In Sec. 3, we present numerical results and performance comparisons. Finally, Sec. 4 concludes this paper.

2.

Solving Constrained Nonconvex Second-Order Total Variation Image Restoration Model

In this section, we propose an efficient method to solve the nonconvex constrained second-order TV [Eq. (5)]. Based on variable splitting technology and generalized soft-thresholding function, ADMM is used to solve the proposed nonconvex constrained second-order TV model [Eq. (5)].

By introducing two auxiliary variables ω and r, we can obtain the following equivalent form of the model [Eq. (5)]:

Eq. (6)

minu,ωωpps.t.  ω=2u,Kug=r(r2δ).

To further translate the above-constrained problem into unconstrained ones, the augmented Lagrangian function is introduced. The augmented Lagrangian function of Eq. (6) is defined as follows:

Eq. (7)

LA(ω,u,λ1,λ2)=ωppλ1T(ω2u)+β12ω2u22λ2T(Kugr)+β22Kugr22,
where λ1 and λ2 are the Lagrange multipliers, β1 and β2 are the penalty parameters.

According to the idea of classical ADMM, the solution of the problem [Eq. (7)] is to find a saddle point of LA(ω,u,λ1,λ2). This can be done by alternately minimizing the augmented Lagrangian function LA(·) with the following form:

{ωk+1=argminωLA(ω,uk,λ1k,λ2k),uk+1=argminuLA(ωk+1,u,λ1k,λ2k),rk+1=argminr(λ2k)T(Kugr)+β22Kuk+1gr22,s.t.  r2δ,
and the Lagrange multiplier parameters are updated as follows:
{λ1k+1=λ1kβ1ξ(ωk+12uk+1),λ2k+1=λ2kβ2ξ(Kuk+1grk+1),
where ξ is a relaxation parameter. Next, we investigate the subproblems one by one.

  • (1) The ω subproblem: The ω subproblem is a nonconvex minimization problem due to the nonconvex lp norm regularizer. For fixed uk, λ1k, and λ2k, the minimization of Eq. (7) with respect to ω can be obtained as

    Eq. (8)

    ωk+1=argminωLA(ω,uk,λ1k,λ2k)=argminωωpp(λ1k)T(ω2uk)+β12ω2uk22=argminωωpp+β12ω(2uk+λ1kβ1)22.

    There are a number of methods proposed to solve the above ω subproblem [Eq. (8)], such as iteratively reweighted l1-minimization and iteratively reweighted least squares method.5053 However, these methods could not converge to the global optimal solution. To guarantee the convergence of minimization of ω subproblem, Zuo et al.46 employed a generalized soft thresholding algorithm (GST) to solve this problem. Then, the solutions ωk+1 are given as

    Eq. (9)

    ωk+1=TpGST(2uk+λ1kβ1;1β1).

    The function TpGST in Eq. (9) is defined as

    TpGST(y;λ)={0,if  |y|τpGST(λ),sgn(y)Spj(|y|;λ),if  |y|>τpGST(λ),
    where sgn(·) is the signum function, Spj+1(|y|;λ) is iteratively computed by the following equation:
    Spj+1(|y|;λ)=|y|λp[Spj(|y|;λ)]p1,j=0,1,,J,

    Sp0(|y|;λ)=|y|, and the thresholding value τpGST(λ) is defined as follows:

    τpGST(λ)=[2λ(1p)]12p+λp[2λ(1p)]p12p.

  • (2) The u subproblem: The minimization of subproblem with u can be solved as

    Eq. (10)

    uk+1=argminuLA(ωk+1,u,λ1k,λ2k)=argminu(λ1k)T(ωk+12u)+β12ωk+12u22(λ2k)T(Kugrk)+β22Kugrk22=argminuβ12ωk+1(2u+λ1kβ1)22+β22Ku(g+rk+λ2kβ2)22.

    Then, we can obtain the first-order necessary optimality conditions of Eq. (10) as follows:

    Eq. (11)

    (β12T2+β2KTK)u=β12Tωk+12Tλ1k+β2KT(g+rk+λ2kβ2).
    Under the periodic boundary condition for u, 2T2 and KTK are all block circulant matrices, more details see Ref. 54, and the matrices can be diagonalized by the two-dimensional (2-D) fast discrete Fourier transforms.55 So, the solution of Eq. (11) can be obtained by two fast discrete Fourier transforms and the solution has the following closed form:

    Eq. (12)

    uk+1=F1[F(β12Tωk+12Tλ1k+β2KT(g+rk)+KTλ2k)F(β12T2+β2KTK)].

  • (3) The r subproblem: The r subproblem is equivalently transformed to the following form:

    rk+1=argminrΩβ22Kuk+1grλ2kβ222,
    where Ω={rRM|r2δ}. The above minimization can be directly obtained by the following projection:

    Eq. (13)

    rk+1=PΩ[Kuk+1grλ2kβ2],
    where PΩ denotes the projection operator.

    Finally, we update the Lagrange multipliers λ1 and λ2 as

    Eq. (14)

    λ1k+1=λ1kβ1ξ(ωk+12uk+1),

    Eq. (15)

    λ2k+1=λ2kβ2ξ(Kuk+1grk+1).

    The parameter ξ in Eqs. (14) and (15) is a relaxation parameter. It is well known that when ξ[0,(5+1)/2], the algorithm has the best convergence. In this paper, we select ξ=0.55.

We name the proposed algorithm as the nonconvex constrained high-order TV with alternating direction method of multipliers (abbreviated as NCHTV-ADMM), which is presented in Algorithm 1.

Algorithm 1

NCHTV with ADMM.

1. Input: g, K, β1>0, β2>0, p, J
2. Initialization: u0=g, ω0=2u0, ξ=0.55, λi=0 for i=1,2.
3. While “not converged,” Do
4. Compute ωk+1
ωk+1=TpGST(2uk+λ1kβ1;1β1)
5. Compute uk+1 via
uk+1=F1[F(β12Tωk+12Tλ1k+β2KT(g+rk)+KTλ2k)F(β12T2+β2KTK)]
6. Compute rk by
rk+1=PΩ[Kuk+1grλ2kβ2]
7. Update λ1k+1
λ1k+1=λ1kβ1ξ(ωk+12uk+1)
8. Update λ2k+1
λ2k+1=λ2kβ2ξ(Kuk+1grk+1)
9. End Do
10. Output uk+1

3.

Numerical Experiments

In this section, we present some numerical examples of image restoration to illustrate the effectiveness of our proposed NCHTV model. We test several remote sensing images including Aerial(1) (256×256), chemical plant (256×256), and Aerial(2) (512×512). The three different types of images are shown in Fig. 1. The experiments are performed under Windows 10 with MATLAB version 2012a running on a PC with an Intel Core i5Duo Central processing unit at 2.50 GHz and 4 GB of memory.

Fig. 1

Test images used for the experiments: (a) Aerial(1), (b) chemical plant, and (c) Aerial(2).

JARS_13_2_022006_f001.png

The signal-to-noise ratio (SNR), structural similarity index measure (SSIM), and relative error (Rerr)56 are used to compare the quality of the restoration results. They are defined as follows:

SNR=20log10u0u¯2u0u2,
SSIM=(2μu0μu+c1)(2σu0u+c2)(μu02+μu2+c1)(σu02+σu2+c2),
Rerr=uu02u02,
where u0, u are the original image and the restored image, respectively, u¯ is the mean intensity value of u0. μu0 and μu are the mean values of the u0 and u, respectively, σu02 and σu2 represent the variance of the u0 and u, respectively, and σu0u is the covariance of the u0 and u, c1 and c2 are the positive constants that can be seen as stabilizing constants for near-zero denominator values. Generally, the larger SNR values show that the restored images are better. The SSIM is an index that is used to measure the similarity between the restored image and the ideal image. The closer the values of SSIM are to 1, the closer the restored image is to the original ones. And, the smaller the Rerr values are, then the better the performance is. The stopping criterion of the testing algorithms in all the experiments is set as follows:
uk+1uk2uk2104.

We compare the proposed method with two related methods: one is the GISA, which was proposed by Zuo et al.46 to solve the nonconvex lp regularization image restoration; the other is a fast TV regularization based method with alternating direction method of multipliers (FTVd).28

3.1.

Experiment 1

In this experiment, we show the effect of parameter p to the recovery performance. We test the proposed NCHTV-ADMM for restoring the image “chemical plant” with different values of p under different blurring kernels and different noise levels. In Fig. 2, we plot the Rerr behaviors along with associated iteration numbers under different values of p. It can be observed from Fig. 2 that the proposed NCHTV-ADMM generates decreasing sequences when p=1,0.9,0.6,0.7,0.8. From this experiment, it is clear that NCHTV-ADMM performs better when p=0.8, and we set p=0.8 in the following experiments.

Fig. 2

Rerr values versus iteration with different p. (a) and (b) Corrupted by Gaussian blur. (c) and (d) Corrupted by average blur. (e) and (f) Corrupted by motion blur.

JARS_13_2_022006_f002.png

3.2.

Experiment 2

In this subsection, we perform some experiments to illustrate the performance of the proposed NCHTV-ADMM algorithm. To show the performance of the proposed NCHTV-ADMM, we compared it with two state-of-the-art methods, FTVd28 and GISA.46

First, the “Aerial(1)” images are degraded by Gaussian blurring operator. For an experiment with noise levels δ=0.02,0.1 and Gaussian blur with Gaussian [Eq. (5)] kernels of size 11, Fig. 3 shows the restored results with FTVd,28 GISA,46 and the proposed NCHTV-ADMM. The zoomed parts of the restored images are shown in Fig. 4. For a more complete explanation, we also perform the experiments for the three tested images under different Gaussian blurring kernels. The corresponding detailed results of SNR and SSIM values are shown in Table 1. In Fig. 3, Fig. 4, and Table 1, the proposed algorithm demonstrates improvement in the restored images using our algorithm. Meanwhile, one can see that the proposed method can obtain better restoration results with higher SNRs and SSIMs.

Fig. 3

Results of noisy images restored with different methods under 11*11 Gaussian blur, with noise level (a–d) δ=0.02 and (e–h) δ=0.1. Columns from the left to the right in each row are the blurred noisy image, the restored image by FTVd, the restored image by GISA, the restored image by NCHTV-ADMM, respectively.

JARS_13_2_022006_f003.png

Fig. 4

Zoomed partial regions in Fig. 3.

JARS_13_2_022006_f004.png

Table 1

The restored results by FTVd, GISA, and NCHTV-ADMM for different images under Gaussian blur.

Blurring kernelImageδ=0.02δ=0.1
FTVdGISAOur methodFTVdGISAOur method
Gaussian(9*9)Aerial(1)SNR29.4630.4331.1424.2325.5426.36
SSIM0.95390.96080.97670.87620.89380.9186
Chemical plantSNR27.6828.4429.4221.9322.5723.96
SSIM0.92140.93100.94400.77290.83090.8676
Aerial(2)SNR33.2334.5036.0927.1128.8329.75
SSIM0.93470.94000.95490.76240.82990.8744
Gaussian(11*11)Aerial(1)SNR27.6128.6229.4023.1124.3425.10
SSIM0.93130.94260.95300.84920.87920.8959
Chemical plantSNR25.9526.7727.7920.8322.4823.71
SSIM0.88300.89980.92000.72870.79020.8281
Aerial(2)SNR31.7632.964.4126.0127.8329.08
SSIM0.91200.92100.94030.74260.80830.8532
Gaussian(15*15)Aerial(1)SNR25.3326.4227.2321.7022.8623.35
SSIM0.89360.91290.93000.81030.83070.8542
Chemical plantSNR24.2225.0726.1319.7221.4622.49
SSIM0.83530.85900.88910.68440.75140.7868
Aerial(2)SNR28.7430.1131.3424.4425.1026.23
SSIM0.85290.87180.90010.68380.74610.7910

Next, the average blur is considered. For an experiment with noise levels δ=0.02,0.1 and average blur kernel of size 15×15, Fig. 5 shows the results obtained by FTVd,28 GISA,46 and the proposed NCHTV-ADMM algorithm. The zoomed parts of the restored images are shown in Fig. 6. We can easily see the proposed algorithm yields better results in image restoration as it avoids the staircase effect while preserving edges well. Table 2 shows the results of SNR and SSIM values under different average blurring kernels.

Fig. 5

Results of noisy images restored by different methods under 15*15 average blur, with noise level (a–d) δ=0.02 and (e–h) δ=0.1. Columns from the left to the right in each row are the blurred noisy image, the restored image by FTVd, the restored image by GISA, and the restored image by NCHTV-ADMM, respectively.

JARS_13_2_022006_f005.png

Fig. 6

Zoomed partial regions in Fig. 5. For a better visualization, some small partial regions of the restored results in Fig. 5 are zoomed.

JARS_13_2_022006_f006.png

Table 2

The restored results by FTVd, GISA, and NCHTV-ADMM for different images under average blur.

Blurring kernelImageδ=0.02δ=0.1
FTVdGISAOur methodFTVdGISAOur method
Average(9)Aerial(1)SNR30.1431.1031.9124.7325.9426.87
SSIM0.95950.96590.97130.88540.91070.9256
Chemical plantSNR28.2929.0430.0822.2723.8625.29
SSIM0.93000.93710.95120.78260.83770.8763
Aerial(2)SNR33.8135.0736.6727.4229.1630.66
SSIM0.93830.94320.95660.76950.83380.8775
Average(11)Aerial(1)SNR28.3629.4830.3623.4724.7825.53
SSIM0.94090.95180.96150.85720.88850.9036
Chemical plantSNR26.5427.3028.6121.1922.8724.14
SSIM0.89650.90970.93330.76470.80580.8433
Aerial(2)SNR32.3733.5235.0626.3028.1029.47
SSIM0.92030.92600.94500.74260.81000.8579
Average(15)Aerial(1)SNR25.2526.3227.0822.0022.8623.25
SSIM0.89180.91190.92650.81530.83670.8496
Chemical plantSNR24.3225.0726.0820.6321.4622.49
SSIM0.83790.85860.88760.72140.75040.7878
Aerial(2)SNR29.4330.8632.2724.7426.4727.35
SSIM0.86660.88420.91450.69210.73520.7831

Then, the ideal image “Aerial(2)” is degraded by a linear motion blur. For the experiment with noise levels δ=0.02,0.1 and the motion kernels of length 55, Fig. 7 shows the results obtained by the above-mentioned three algorithms. For a better visualization, some small partial regions of the restored results of Fig. 7 are zoomed in Fig. 8. The results of SNR and SSIM values for tested images under different motion blurring kernels are shown in Table 3. Clearly, the visual quality of the restored image by the proposed NCHTV-ADMM algorithm is competitive with the other two algorithms. Moreover, one can observe that the SNRs and the SSIMs of the restored images by the proposed algorithm are better than those by the other two mentioned algorithms.

Fig. 7

Results of noisy images restored by different methods under 55*135 motion blur, with noise level (a–d) δ=0.02 and (e–h) δ=0.1. Columns from the left to the right in each row are the blurred noisy image, the restored image by FTVd, the restored image by GISA, the restored image by NCHTV-ADMM, respectively.

JARS_13_2_022006_f007.png

Fig. 8

Zoomed partial regions in Fig. 7. For a better visualization, some small partial regions of the restored results in Fig. 7 are zoomed.

JARS_13_2_022006_f008.png

Table 3

The restored results by FTVd, GISA, and NCHTV-ADMM for different images under motion blur.

Blurring kernelImageδ=0.02δ=0.1
FTVdGISAOur methodFTVdGISAOur method
Motion(55,135)Aerial(1)SNR31.9033.4334.5726.0326.5427.36
SSIM0.96990.97780.98270.89020.91180.9326
Chemical plantSNR29.4830.8432.0923.5324.1725.06
SSIM0.93340.94700.96100.81140.83090.8656
Aerial(2)SNR36.3837.9639.4928.1129.5331.01
SSIM0.93370.94300.96390.77540.82400.8644
Motion(25,35)Aerial(1)SNR34.5435.8437.1828.5928.9029.45
SSIM0.98390.98720.98960.94070.95020.9561
Chemical plantSNR33.0233.7734.9925.8326.9027.27
SSIM0.97150.97460.97990.87380.89920.9125
Aerial(2)SNR40.3641.5242.4731.3932.8333.93
SSIM0.97220.97540.97860.85070.88610.9075

3.3.

Experiment 3

In this subsection, we also perform some experiments to further demonstrate the superiority of our proposed method over FTVd and GISA. We plot three sets of figures to illustrate the convergence performance of the relative errors versus iteration number and SNR versus iteration number, and the results are shown in Figs. 9Fig. 1011. As is clearly shown, FTVd, GISA, and our proposed NCHTV-ADMM generate increasing sequences in terms of the iteration number over the SNR, and generate decreasing sequences in terms of the iteration number over the relative errors. Moreover, we find that our proposed method outperforms FTVd and GISA, in terms of highest SNR and lower Rerr in fewer iterations. These facts also indicate that the proposed method performs better than FTVd and GISA.

Fig. 9

SNR and Rerr versus iteration number for three different methods with the noise level δ=0.02 under 11*11 Gaussian blur.

JARS_13_2_022006_f009.png

Fig. 10

SNR and Rerr versus iteration number for three different methods with the noise level δ=0.02 under 15*15 average blur.

JARS_13_2_022006_f010.png

Fig. 11

SNR and Rerr versus iteration number for three different methods with the noise level δ=0.02 under 55*135 motion blur.

JARS_13_2_022006_f011.png

4.

Conclusion

In this paper, we proposed a constrained second-order nonconvex TV regularization image restoration model. A new alternating minimization algorithm that combines generalization of soft-thresholding algorithm and alternating direction method is proposed to solve the proposed model. Numerical results show that the new proposed model can preserve the edge information while avoiding the staircase effect. By comparison with FTVd and GISA, our proposed method can obtain better performance.

Acknowledgments

This work was supported by the Training Program of the Major Research Plan of National Science Foundation of China under Grant No. 91746104, the National Science Foundation of China under Grant Nos. 61101208 and 11326186, the Qindao Postdoctoral Science Foudation, China (2016114), a Project of Shandong Province Higher Educational Science and Technology Program, China (J17KA166), Joint Innovative Center for Safe and Effective Mining Technology and Equipment of Coal Resources, Shandong Province of China and SDUST Research Fund (2014TDJH102). The authors declare no conflict of interest.

References

1. 

J. Ma and L. Dimet, “Deblurring from highly incomplete measurements for remote sensing,” IEEE Trans. Geosci. Remote Sens., 47 (3), 792 –802 (2009). https://doi.org/10.1109/TGRS.2008.2004709 IGRSD2 0196-2892 Google Scholar

2. 

Y. Chen et al., “Denoising of hyperspectral images using nonconvex low rank matrix approximation,” IEEE Trans. Geosci. Remote Sens., 55 (9), 5366 –5380 (2017). https://doi.org/10.1109/TGRS.2017.2706326 IGRSD2 0196-2892 Google Scholar

3. 

G. Lianru et al., “Study on the method for estimating the noise in remote sensing images based on local standard deviations,” J. Remote Sens., 11 (2), 201 –208 (2007). Google Scholar

4. 

X. Wang, H. Zhang and F. Li, “A PDE-based hybrid model for denosing remote sensing image with Gaussian and salt-pepper noise,” Acta Geod. Cartographica Sin., 39 (3), 283 –288 (2010). Google Scholar

5. 

F. Xu et al., “Denoising of hyperspectral image using low-rank matrix factorization,” IEEE Geosci. Remote Sens. Lett., 14 (7), 1141 –1145 (2017). https://doi.org/10.1109/LGRS.2017.2700406 Google Scholar

6. 

H. F. Shen et al., “Blind restoration of remote sensing images by a combination of automatic knife-edge detection and alternating minimization,” Remote Sens., 6 (8), 7491 –7521 (2014). https://doi.org/10.3390/rs6087491 Google Scholar

7. 

A. N. Tikhonov and V. Y. Arsenin, Solution of Ill-Posed Problems, Winston, New York (1977). Google Scholar

8. 

L. I. Rudin, S. Osher and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Phys. D: Nonlinear Phenom., 60 259 –268 (1992). https://doi.org/10.1016/0167-2789(92)90242-F Google Scholar

9. 

L. I. Rudin and S. Osher, “Total variation based image restoration with free local constraints,” in Proc. of the IEEE Int. Conf. Image Processing (ICIP), 31 –35 (1994). https://doi.org/10.1109/ICIP.1994.413269 Google Scholar

10. 

C. R. Vogel and M. E. Oman, “Iterative methods for total variation denoising,” SIAM J. Sci. Comput., 17 (1), 227 –238 (1996). https://doi.org/10.1137/0917016 SJOCE3 1064-8275 Google Scholar

11. 

T. F. Chan and P. Mulet, “A nonlinear diffusivity fixed point method in total variation based image restoration,” SIAM J. Numer. Anal., 20 (2), 1964 –1977 (1999). https://doi.org/10.1007/3-540-76076-8_137 Google Scholar

12. 

J. G. Zhu and B. B. Hao, “A new noninterior continuation method for solving a system of equalities and inequalities,” J. Appl. Math., 2014 1 –6 (2014). https://doi.org/10.1155/2014/592540 Google Scholar

13. 

Y. M. Huang, M. K. Ng and Y. W. Wen, “A fast total variation minimization method for image restoration,” SIAM J. Multiscale Model. Simul., 7 (2), 774 –795 (2008). https://doi.org/10.1137/070703533 Google Scholar

14. 

Z. Z. Feng, L. Fang and G. He, “An iteration primal-dual path-following method, based on wide neighbourhood and large update, for second-order cone programming,” Optimization, 63 (5), 679 –691 (2014). https://doi.org/10.1080/02331934.2012.678849 OPTZDQ Google Scholar

15. 

J. Tang et al., “A smoothing Newton method for the second-order cone complementarity problem,” Appl. Math., 58 (2), 223 –247 (2013). https://doi.org/10.1007/s10492-013-0011-9 Google Scholar

16. 

L. Sun et al., “An accurate active set newton algorithm for large scale bound constrained optimization,” Appl. Math., 56 (3), 297 –314 (2011). https://doi.org/10.1007/s10492-011-0018-z Google Scholar

17. 

A. Chambolle, “An algorithm for total variation minimization and applications,” J. Math. Imaging Vision, 20 (1–2), 89 –97 (2004). https://doi.org/10.1023/B:JMIV.0000011325.36760.1e JIMVEC 0924-9907 Google Scholar

18. 

Z. L. Tian et al., “An accelerated Jacobi gradient based iterative algorithm for solving sylvester matrix equations,” Filomat, 31 (8), 2381 –2390 (2017). https://doi.org/10.2298/FIL1708381T Google Scholar

19. 

J. Yu et al., “A decomposition method for large-scale box constrained optimization,” Appl. Math. Comput., 231 (12), 9 –15 (2014). https://doi.org/10.1016/j.amc.2013.12.169 Google Scholar

20. 

M. Li, X. Kao and H. Che, “Relaxed inertial accelerated algorithms for solving split equality feasibility problem,” J. Nonlinear Sci. Appl., 10 (8), 4109 –4121 (2017). https://doi.org/10.22436/jnsa Google Scholar

21. 

Y. W. Wen, M. K. Ng and W. K. Ching, “Iterative algorithms based on decoupling of deblurring and denoising for image restoration,” SIAM J. Sci. Comput., 30 (5), 2655 –2674 (2008). https://doi.org/10.1137/070683374 SJOCE3 1064-8275 Google Scholar

22. 

F. Zheng, C. Han and Y. Wang, “Parallel SSLE algorithm for large scale constrained optimization,” Appl. Math. Comput., 217 (12), 5377 –5384 (2011). https://doi.org/10.1016/j.amc.2010.12.005 Google Scholar

23. 

C. Y. Han et al., “Parallel algorithms for large-scale linearly constrained minimization problem,” Acta Math. Appl. Sin. Engl. Ser., 30 (3), 707 –720 (2014). https://doi.org/10.1007/s10255-013-0300-9 Google Scholar

24. 

R. Y. Zhang, F. F. Xu and J. C. Huang, “Reconstructing local volatility using total variation,” Acta Math. Sin. Engl. Ser., 33 (2), 263 –277 (2017). https://doi.org/10.1007/s10114-017-5178-7 Google Scholar

25. 

X. Lu, H. X. Wang and X. Wang, “On Kalman smoothing for wireless sensor networks systems with multiplicative noises,” J. Appl. Math., 2012 203 –222 (2012). https://doi.org/10.1155/2012/717504 Google Scholar

26. 

T. Goldstein and S. Osher, “The split Bregman method for L1-regularized problems,” SIAM J. Imaging Sci., 2 323 –343 (2009). https://doi.org/10.1137/080725891 Google Scholar

27. 

B. B. Hao and J. G. Zhu, “Fast L1 regularized iterative forward backward splitting with adaptive parameter selection for image restoration,” J. Visual Commun. Image Represent., 44 139 –147 (2017). https://doi.org/10.1016/j.jvcir.2017.01.016 JVCRE7 1047-3203 Google Scholar

28. 

Y. Wang et al., “A new alternating minimization algorithm for total variation image reconstruction,” SIAM J. Imaging Sci., 1 (3), 248 –272 (2008). https://doi.org/10.1137/080724265 Google Scholar

29. 

T. Chan, A. Marquina and P. Mulet, “High-order total variation-based image restoration,” SIAM J. Sci. Comput., 22 (2), 503 –516 (2000). https://doi.org/10.1137/S1064827598344169 SJOCE3 1064-8275 Google Scholar

30. 

X. G. Lv, Y. Z. Song and S. X. Wang, “Image restoration with a high-order total variation minimization method,” Appl. Math. Modell., 37 8210 –8224 (2013). https://doi.org/10.1016/j.apm.2013.03.028 AMMODL 0307-904X Google Scholar

31. 

J. G. Zhu, K. Li and B. B. Hao, “Image restoration by a mixed high-order total variation and l1 regularization model,” Math. Probl. Eng., 2018 1 –13 (2018). https://doi.org/10.1155/2018/6538610 Google Scholar

32. 

Z. Ren, C. He and Q. Zhang, “Fractional order total variation regularization for image super-resolution,” Signal Process., 93 (9), 2408 –2421 (2013). https://doi.org/10.1016/j.sigpro.2013.02.015 Google Scholar

33. 

Z. Wang, “A numerical method for delayed fractional-order differential equations,” J. Appl. Math., 2013 1 –7 (2013). https://doi.org/10.1155/2013/256071 Google Scholar

34. 

Z. Wang, X. Huang and J. P. Zhou, “A numerical method for delayed fractional-order differential equations: based on GL definition,” Appl. Math. Inf. Sci., 7 (2), 525 –529 (2013). https://doi.org/10.12785/amis/072L22 Google Scholar

35. 

C. Jiang, F. Zhang and T. Li, “Synchronization and antisynchronization of N-coupled fractional-order complex systems with ring connection,” Math. Methods Appl. Sci., 41 (7), 2625 –2638 (2018). https://doi.org/10.1002/mma.v41.7 Google Scholar

36. 

K. Papafitsoros and C. B. Schönlieb, “A combined first and second order variational approach for image reconstruction,” J. Math. Imaging Vision, 48 (2), 308 –338 (2014). https://doi.org/10.1007/s10851-013-0445-4 JIMVEC 0924-9907 Google Scholar

37. 

K. Bredies, K. Kunisch and T. Pock, “Total generalized variation,” SIAM J. Imaging Sci., 3 (3), 492 –526 (2010). https://doi.org/10.1137/090769521 Google Scholar

38. 

C. L. Wu and X. C. Tai, “Augmented Lagrangian method, dual methods, and split Bregman iteration for ROF, vectorial TV, and high order models,” SIAM J. Imaging Sci., 3 (3), 300 –339 (2010). https://doi.org/10.1137/090767558 Google Scholar

39. 

A. Parekh and I. Selesnick, “Convex denoising using non-convex tight frame regularization,” IEEE Signal Process. Lett., 22 (10), 1786 –1790 (2015). https://doi.org/10.1109/LSP.2015.2432095 IESPEJ 1070-9908 Google Scholar

40. 

P. Y. Chen and I. W. Selesnick, “Group-sparse signal denoising: Non-convex regularization, convex optimization,” IEEE Trans. Signal Process., 62 (13), 3464 –3478 (2014). https://doi.org/10.1109/TSP.2014.2329274 ITPRED 1053-587X Google Scholar

41. 

M. Nikolova, M. K. Ng and C. P. Tam, “Fast nonconvex nonsmooth minimization methods for image restoration and reconstruction,” IEEE Trans. Image Process., 19 (12), 3073 –3088 (2010). https://doi.org/10.1109/TIP.2010.2052275 IIPRE4 1057-7149 Google Scholar

42. 

X. G. Lv, Y. Z. Song and F. Li, “An efficient nonconvex regularization for wavelet frame and total variation based image restoration,” J. Comput. Appl. Math., 290 553 –566 (2015). https://doi.org/10.1016/j.cam.2015.06.006 JCAMDI 0377-0427 Google Scholar

43. 

H. Zhang et al., “Nonconvex and nonsmooth total generalized variation model for image restoration,” Signal Process., 143 69 –85 (2018). https://doi.org/10.1016/j.sigpro.2017.08.021 Google Scholar

44. 

Q. Lyu et al., “A comparison of typical lp minimization algorithms,” Neurocomputing, 119 413 –424 (2013). https://doi.org/10.1016/j.neucom.2013.03.017 NRCGEO 0925-2312 Google Scholar

45. 

Z. B. Xu et al., “l12 regularization: a thresholding representation theory and a fast solver,” IEEE Trans. Neural Networks, 23 1013 –1027 (2012). https://doi.org/10.1109/TNNLS.2012.2197412 ITNNEP 1045-9227 Google Scholar

46. 

W. M. Zuo et al., “A generalized iterated shrinkage algorithm for non-convex sparse coding,” in Proc. IEEE Int. Conf. on Computer Vision, 217 –224 (2013). https://doi.org/10.1109/ICCV.2013.34 Google Scholar

47. 

M. V. Afonso, J. M. Bioucas-Dias and M. A. Figueiredo, “An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems,” IEEE Trans. Image Process., 20 681 –695 (2011). https://doi.org/10.1109/TIP.2010.2076294 IIPRE4 1057-7149 Google Scholar

48. 

S. Chen, D. Donoho and M. Saunders, “Atomic decomposition by basis pursuit,” SIAM J. Sci. Comput., 20 33 –61 (1998). https://doi.org/10.1137/S1064827596304010 SJOCE3 1064-8275 Google Scholar

49. 

M. V. Afonso, J. M. Bioucas-Dias and M. A. Figueiredo, “Fast image recovery using variable splitting and constrained optimization,” IEEE Trans. Image Process., 19 (9), 2345 –2356 (2010). https://doi.org/10.1109/TIP.2010.2047910 IIPRE4 1057-7149 Google Scholar

50. 

P. Ochs et al., “On iteratively reweighted algorithms for nonsmooth nonconvex optimization in computer vision,” SIAM J. Imaging Sci., 8 331 –372 (2015). https://doi.org/10.1137/140971518 Google Scholar

51. 

Z. Lu, Y. Zhang and J. Lu, “lp Regularized low-rank approximation via iterative reweighted singular value minimization,” Comput. Optim. Appl., 68 (3), 619 –642 (2017). CPPPEF 0926-6003 Google Scholar

52. 

M. J. Lai, Y. Y. Xu and W. T. Yin, “Improved iteratively reweighted least squares for unconstrained smoothed lp minimization,” SIAM J. Numer. Anal., 51 927 –957 (2013). https://doi.org/10.1137/110840364 Google Scholar

53. 

Y. Peng et al., “Reweighted low-rank matrix recovery and its application in image restoration,” IEEE Trans. Cybern., 44 (12), 2418 –2430 (2014). https://doi.org/10.1109/TCYB.2014.2307854 Google Scholar

54. 

M. K. Ng, R. H. Chan and W. C. Tang, “A fast algorithm for deblurring models with neumann boundary conditions,” SIAM J. Sci. Comput., 21 (3), 851 –866 (1999). https://doi.org/10.1137/S1064827598341384 SJOCE3 1064-8275 Google Scholar

55. 

M. K. Ng and R. J. Plemmons, “Plemmons, fast recursive least squares adaptive filtering by fast fourier transform-based conjugate gradient iterations,” SIAM J. Sci. Comput., 17 (4), 920 –941 (1996). https://doi.org/10.1137/0917060 SJOCE3 1064-8275 Google Scholar

56. 

Z. Wang et al., “Image quality assessment: from error visibility to structural similarity,” IEEE Trans. Image Process., 13 (4), 600 –612 (2004). https://doi.org/10.1109/TIP.2003.819861 IIPRE4 1057-7149 Google Scholar

Biography

Jianguang Zhu is an associate professor at Shandong University of Science and Technology. He received his PhD in applied mathematics from Xidian University, Xi’an, China, in 2011. His current research interests include optimization theory, algorithms, and applications in image processing and sparse representation.

Kai Li is currently pursuing his MS degree with the College of Mathematics and Systems Science, Shandong University of Science and Technology, Qingdao, China. His current research interests include optimization algorithms in image processing.

Binbin Hao received her PhD in applied mathematics from Xidian University, Xi’an, China, in 2010. She joined the College of Science, China University of Petroleum in 2009, and has been an associate professor since 2012. Her current research interests include image processing, pattern recognition, wavelet analysis, and sparse representation.

© 2019 Society of Photo-Optical Instrumentation Engineers (SPIE) 1931-3195/2019/$25.00 © 2019 SPIE
Jianguang Zhu, Kai Li, and Binbin Hao "Restoration of remote sensing images based on nonconvex constrained high-order total variation regularization," Journal of Applied Remote Sensing 13(2), 022006 (2 January 2019). https://doi.org/10.1117/1.JRS.13.022006
Received: 29 August 2018; Accepted: 23 October 2018; Published: 2 January 2019
Lens.org Logo
CITATIONS
Cited by 22 scholarly publications and 1 patent.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Signal to noise ratio

Remote sensing

Image restoration

Lithium

Visualization

Algorithm development

Fourier transforms

Back to Top