5 February 2024 Mutual encoder-decoder with bi-gated convolution for image inpainting
Hewei Yu, Renfeng Yang, Jingxi Yu
Author Affiliations +
Abstract

Partial convolution and gated convolution (GC) have been widely used to solve the limitations of vanilla convolution. However, both approaches have their respective drawbacks. For example, the single-channel binary mask used in partial convolution restricts its flexibility, and the accuracy of the gating values learned from GC cannot be guaranteed. To overcome these limitations, we propose an approach called bi-gated convolution. It adaptively integrates the binary mask and the gating values learned from the network to obtain refined gating values that effectively characterize the features, thereby increasing the recognition accuracy of the gating value. Furthermore, we propose a feature-adaptive supplementation operation designed specifically for repairing damaged areas within the encoder features. Finally, we present a mutual encoder-decoder architecture with bi-gated convolution. Experiments conducted on two benchmark datasets show that the proposed method has the capability to generate visually plausible results.

© 2024 SPIE and IS&T
Hewei Yu, Renfeng Yang, and Jingxi Yu "Mutual encoder-decoder with bi-gated convolution for image inpainting," Journal of Electronic Imaging 33(1), 013036 (5 February 2024). https://doi.org/10.1117/1.JEI.33.1.013036
Received: 19 August 2023; Accepted: 16 January 2024; Published: 5 February 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Convolution

Binary data

Education and training

Visualization

Feature fusion

Image processing

Image restoration

Back to Top