• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Liu, W. (Liu, W..) [1] | Zhang, H. (Zhang, H..) [2] | Lin, X. (Lin, X..) [3] | Zhang, Q. (Zhang, Q..) [4] | Li, Q. (Li, Q..) [5] | Liu, X. (Liu, X..) [6] | Cao, Y. (Cao, Y..) [7]

Indexed by:

Scopus

Abstract:

In recent years, the rapid advancement of image generation techniques has resulted in the widespread abuse of manipulated images, leading to a crisis of trust and affecting social equity. Thus, the goal of our work is to detect and localize tampered regions in images. Many deep learning based approaches have been proposed to address this problem, but they can hardly handle the tampered regions that are manually fine-tuned to blend into image background. By observing that the boundaries of tempered regions are critical to separating tampered and non-tampered parts, we present a novel boundary-guided approach to image manipulation detection, which introduces an inherent bias towards exploiting the boundary information of tampered regions. Our model follows an encoder-decoder architecture, with multi-scale localization mask prediction, and is guided to utilize the prior boundary knowledge through an attention mechanism and contrastive learning. In particular, our model is unique in that 1) we propose a boundary-aware attention module in the network decoder, which predicts the boundary of tampered regions and thus uses it as crucial contextual cues to facilitate the localization and 2) we propose a multi-scale contrastive learning scheme with a novel boundary-guided sampling strategy, leading to more discriminative localization features. Our state-of-art performance on several public benchmarks demonstrates the superiority of our model over prior works. IEEE

Keyword:

Contrastive learning Decoding Deepfakes Feature extraction Image Manipulation Detection/Localization Location awareness Task analysis Visualization

Community:

  • [ 1 ] [Liu W.]College of Computer and Data Science, Fuzhou University, China
  • [ 2 ] [Zhang H.]College of Computer and Data Science, Fuzhou University, China
  • [ 3 ] [Lin X.]Xiamen Zhonglian Century Co., Ltd., China
  • [ 4 ] [Zhang Q.]College of Computer and Data Science, Fuzhou University, China
  • [ 5 ] [Li Q.]College of Computer and Data Science, Fuzhou University, China
  • [ 6 ] [Liu X.]College of Computer and Data Science, Fuzhou University, China
  • [ 7 ] [Cao Y.]School of Information Science and Technology, ShanghaiTech University, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

IEEE Transactions on Information Forensics and Security

ISSN: 1556-6013

Year: 2024

Volume: 19

Page: 1-1

6 . 3 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:85/9996983
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1