• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhao, Y. (Zhao, Y..) [1] | Zheng, C. (Zheng, C..) [2] | Su, J. (Su, J..) [3] | Chen, G. (Chen, G..) [4] (Scholars:陈光永)

Indexed by:

Scopus

Abstract:

Non-local attention (NLA) is a powerful technique for capturing long-range feature correlations in deep single-image super-resolution (SR). However, NLA suffers from high computational complexity and memory consumption, as it requires aggregating all non-local feature information for each query response and recalculating the similarity weight distribution for different abstraction levels of features. To address these challenges, we propose a novel learnable collaborative attention (LCoA) that introduces inductive bias into non-local modeling. Our LCoA consists of two components: learnable sparse pattern (LSP) and collaborative attention (CoA). LSP uses the k-means clustering algorithm to dynamically adjust the sparse attention pattern of deep features, which reduces the number of non-local modeling rounds compared with existing sparse solutions. CoA leverages the sparse attention pattern and weights learned by LSP and co-optimizes the similarity matrix across different abstraction levels, which avoids redundant similarity matrix calculations. The experimental results show that our LCoA can reduce the non-local modeling time by about 83% in the inference stage. In addition, we integrate our LCoA into a deep learnable collaborative attention network (LCoAN), which achieves competitive performance in terms of inference time, memory consumption, and reconstruction quality compared with other state-of-the-art SR methods. Our code and pre-trained LCoAN models were uploaded to GitHub (https://github.com/YigangZhao/LCoAN) for validation. © 2024 SPIE and IS&T.

Keyword:

k-means clustering non-local attention self-similarity single-image super-resolution

Community:

  • [ 1 ] [Zhao Y.]Fuzhou University, College of Computer and Data Science, Fuzhou, China
  • [ 2 ] [Zheng C.]Fuzhou University, College of Computer and Data Science, Fuzhou, China
  • [ 3 ] [Su J.]Fuzhou University, College of Computer and Data Science, Fuzhou, China
  • [ 4 ] [Chen G.]Fuzhou University, College of Computer and Data Science, Fuzhou, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Journal of Electronic Imaging

ISSN: 1017-9909

Year: 2024

Issue: 6

Volume: 33

1 . 0 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:150/10203181
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1