• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Gong, Z. (Gong, Z..) [1] | Xiao, G. (Xiao, G..) [2] | Shi, Z. (Shi, Z..) [3] | Wang, S. (Wang, S..) [4] | Chen, R. (Chen, R..) [5]

Indexed by:

Scopus

Abstract:

In this article, we propose a novel pyramid transformer network (PT-Net) for feature matching problems. Recent studies have used the dense motion field to transform unordered correspondences into ordered motion vectors and have used convolutional neural networks (CNNs) to extract deep features. However, the limited receptive field of CNNs restricts the ability of the network to capture global information within the motion field. To tackle this limitation, we devise a pyramid transformer (PT) block to enhance the models ability to extract both local and global information from the motion field, which fuses multiscale motion field information by constructing a pyramid-structured motion field. Furthermore, to alleviate the high memory demands of spatial attention in the transformer, we introduce dilated sparse attention (DSA), a novel attention block that reduces the computational difficulty of multihead self-attention (MHSA) through regular interval sampling and deconvolution operations and focuses on the essential regions to establish long-range dependencies between the correct motion vectors. The proposed PT-Net is effective in inferring the probabilities of correspondences belonging to either inliers or outliers, while simultaneously estimating the essential matrix. Extensive experiments demonstrate that PT-Net network outperforms state-of-the-art methods for outlier removal tasks and camera pose estimation on different datasets, including YFCC100M and SUN3D. The code is available at https://github.com/gongzhepeng/PT-Net.  © 1963-2012 IEEE.

Keyword:

Camera pose estimation deep learning feature matching outlier removal

Community:

  • [ 1 ] [Gong Z.]Fujian Agriculture and Forestry University, College of Computer and Information Science, Fuzhou, 350002, China
  • [ 2 ] [Xiao G.]Tongji University, School of Electronics and Information Engineering, Shanghai, 201804, China
  • [ 3 ] [Shi Z.]Fujian Agriculture and Forestry University, College of Computer and Information Science, Fuzhou, 350002, China
  • [ 4 ] [Wang S.]Fuzhou University, College of Computer and Data Science/College of Software, Fuzhou, 350108, China
  • [ 5 ] [Chen R.]Fujian Agriculture and Forestry University, College of Computer and Information Science, Fuzhou, 350002, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Instrumentation and Measurement

ISSN: 0018-9456

Year: 2024

Volume: 73

Page: 1-11

5 . 6 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:133/9988527
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1