• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Ke, Xiao (Ke, Xiao.) [1] | Liu, Hao (Liu, Hao.) [2] | Xu, Peirong (Xu, Peirong.) [3] | Lin, Xinru (Lin, Xinru.) [4] | Guo, Wenzhong (Guo, Wenzhong.) [5]

Indexed by:

EI

Abstract:

Text-based person search aims to use text descriptions to search for corresponding person images. However, due to the obvious pattern differences in image and text modalities, it is still a challenging problem to align the two modalities. Most existing approaches only consider semantic alignment within a global context or partial parts, lacking consideration of how to match image and text in terms of differences in model information. Therefore, in this paper, we propose an efficient Modality-Aligned Person Search network (MAPS) to address this problem. First, we suppress image-specific information by image feature style normalization to achieve modality knowledge alignment and reduce information differences between text and image. Second, we design a multi-granularity modal feature fusion and optimization method to enrich the modal features. To address the problem of useless and redundant information in the multi-granularity fused features, we propose a Multi-granularity Feature Self-optimization Module (MFSM) to adaptively adjust the corresponding contributions of different granularities in the fused features of the two modalities. Finally, to address the problem of information inconsistency in the training and inference stages, we propose a Cross-instance Feature Alignment (CFA) to help the network enhance category-level generalization ability and improve retrieval performance. Extensive experiments demonstrate that our MAPS achieves state-of-the-art performance on all text-based person search datasets, and significantly outperforms other existing methods. © 2024

Keyword:

Semantics

Community:

  • [ 1 ] [Ke, Xiao]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 2 ] [Ke, Xiao]Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou; 350116, China
  • [ 3 ] [Liu, Hao]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 4 ] [Xu, Peirong]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 5 ] [Xu, Peirong]Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou; 350116, China
  • [ 6 ] [Lin, Xinru]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 7 ] [Lin, Xinru]Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou; 350116, China
  • [ 8 ] [Guo, Wenzhong]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 9 ] [Guo, Wenzhong]Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou; 350116, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

Pattern Recognition

ISSN: 0031-3203

Year: 2024

Volume: 152

7 . 5 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:451/10063841
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1