• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Niu, Yuzhen (Niu, Yuzhen.) [1] (Scholars:牛玉贞) | Xu, Rui (Xu, Rui.) [2] | Lin, Zhihua (Lin, Zhihua.) [3] | Liu, Wenxi (Liu, Wenxi.) [4] (Scholars:刘文犀)

Indexed by:

EI

Abstract:

The problem of video demoiréing is a new challenge in video restoration. Unlike image demoiréing, which involves removing static and uniform patterns, video demoiréing requires tackling dynamic and varied moiré patterns while maintaining video details, colors, and temporal consistency. It is particularly challenging to model moiré patterns for videos with camera or object motions, where separating moiré from the original video content across frames is extremely difficult. Nonetheless, we observe that the spatial distribution of moiré patterns is often sparse on each frame, and their long-range temporal correlation is not significant. To fully leverage this phenomenon, a sparsity-constrained spatial self-attention scheme is proposed to concentrate on removing sparse moiré efficiently for each frame without being distracted by dynamic video content. The frame-wise spatial features are then correlated and aggregated via the local temporal cross-frame-attention module to produce temporal-consistent high-quality moiré-free videos. The above decoupled spatial and temporal transformers constitute the Spatio-Temporal Decomposition Network, dubbed STD-Net. For evaluation, we present a large-scale video demoiréing benchmark featuring various real-life scenes, camera motions, and object motions. We demonstrate that our proposed model can effectively and efficiently achieve superior performance on video demoiréing and single image demoiréing tasks. The proposed dataset is released at https://github.com/FZU-N/LVDM. © 1991-2012 IEEE.

Keyword:

Cameras Image reconstruction Job analysis Large datasets Restoration Video recording

Community:

  • [ 1 ] [Niu, Yuzhen]Fuzhou University, Fujian Key Laboratory of Network Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou; 350108, China
  • [ 2 ] [Xu, Rui]Fuzhou University, Fujian Key Laboratory of Network Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou; 350108, China
  • [ 3 ] [Xu, Rui]Ministry of Education, Engineering Research Center of Bigdata Intelligence, Fuzhou; 350108, China
  • [ 4 ] [Lin, Zhihua]Research Institute of Alipay Information Technology Company Ltd., Hangzhou; 310000, China
  • [ 5 ] [Liu, Wenxi]Fuzhou University, Fujian Key Laboratory of Network Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou; 350108, China
  • [ 6 ] [Liu, Wenxi]Ministry of Education, Engineering Research Center of Bigdata Intelligence, Fuzhou; 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Circuits and Systems for Video Technology

ISSN: 1051-8215

Year: 2024

Issue: 9

Volume: 34

Page: 8562-8575

8 . 3 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

Online/Total:487/9665360
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1