9 March 2023 Dual-aware transformer network for single-image super-resolution
Zhonghua Luo, Li Wang, Fengzhou Wang, Yinglan Ruan
Author Affiliations +
Abstract

The advent of deep learning has enabled image super-resolution (SR) technology to achieve tremendous success. The recent exploration between convolutional neural network (CNN) and transformer has produced an impressive performance. However, the huge model size and heavy computational cost occupied by most approaches cannot be ignored. Additionally, the global and local modeling of image features is not well utilized and explored, which is important for texture content reconstruction. In this study, we present an efficient and lightweight network based on CNN and transformer for image SR, dubbed dual-aware transformer network (DATN). Specifically, a dual-aware fusion module (DAFM), consisting of spatial-aware adaptive block (SAAB) and global-aware fusion block (GAFB), learns local and global features in a complementary manner for yielding abundant content details. SAAB delivers the captured spatial information to GAFB in parallel, whereas GAFB establishes long-range spatial dependencies among diverse features to boost the network’s ability for recovering texture details. Further, in the upsampling stage, our proposed transformer-empowered upsampling module aggregates global information from the transformer module to generate location-wise reassembly kernels for content-aware upsampling. In such way, feature-rich information is highlighted adaptively to reconstruct high-quality images with maximum efficiency. Experimental results reveal that our proposed DATN achieves high qualitative performance while maintaining low computational demands, surpassing most state-of-the-art SR networks.

© 2023 SPIE and IS&T
Zhonghua Luo, Li Wang, Fengzhou Wang, and Yinglan Ruan "Dual-aware transformer network for single-image super-resolution," Journal of Electronic Imaging 32(2), 023008 (9 March 2023). https://doi.org/10.1117/1.JEI.32.2.023008
Received: 25 September 2022; Accepted: 17 February 2023; Published: 9 March 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Transformers

Image restoration

Super resolution

Performance modeling

Lawrencium

Feature extraction

Data modeling

RELATED CONTENT


Back to Top