• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Huang, Jinghao (Huang, Jinghao.) [1] | Chen, Yaxiong (Chen, Yaxiong.) [2] | Xiong, Shengwu (Xiong, Shengwu.) [3] | Lu, Xiaoqiang (Lu, Xiaoqiang.) [4] (Scholars:卢孝强)

Indexed by:

EI

Abstract:

An important challenge that existing work has yet to address is the relatively small differences in audio representations compared with the rich content provided by remote sensing (RS) images, making it easy to overlook certain details in the images. This imbalance in information between modalities poses a challenge in maintaining consistent representations. In response to this challenge, we propose a novel cross-modal RS image-audio (RSIA) retrieval method called adaptive learning for aligning correlation (ALAC). ALAC integrates region-level learning into image annotation through a region-enhanced learning attention (RELA) module. By collaboratively suppressing features at different region levels, ALAC is able to provide a more comprehensive visual feature representation. In addition, a novel adaptive knowledge transfer (AKT) strategy has been proposed, which guides the learning process of the frontend network using aligned feature vectors. This approach allows the model to adaptively acquire alignment information during the learning process, thereby facilitating better alignment between the two modalities. Finally, to better use mutual information between different modalities, we introduce a plug-and-play result rerank module. This module optimizes the similarity matrix using retrieval mutual information between modalities as weights, significantly improving retrieval accuracy. Experimental results on four RSIA datasets demonstrate that ALAC outperforms other methods in retrieval performance. Compared with state-of-the-art methods, improvements of 1.49%, 2.25%, 4.24%, and 1.33% were, respectively, achieved by ALAC. The codes are accessible at https://github.com/huangjh98/ALAC. © 1980-2012 IEEE.

Keyword:

Feature extraction Image enhancement Image retrieval Knowledge management Learning systems Remote sensing

Community:

  • [ 1 ] [Huang, Jinghao]Shanghai Artificial Intelligence Laboratory, Shanghai; 200232, China
  • [ 2 ] [Huang, Jinghao]Wuhan University of Technology, School of Computer Science and Artificial Intelligence, Wuhan; 430070, China
  • [ 3 ] [Huang, Jinghao]Wuhan University of Technology, Chongqing Research Institute, Chongqing; 401122, China
  • [ 4 ] [Chen, Yaxiong]Shanghai Artificial Intelligence Laboratory, Shanghai; 200232, China
  • [ 5 ] [Chen, Yaxiong]Wuhan University of Technology, School of Computer Science and Artificial Intelligence, Wuhan; 430070, China
  • [ 6 ] [Chen, Yaxiong]Wuhan University of Technology, Chongqing Research Institute, Chongqing; 401122, China
  • [ 7 ] [Xiong, Shengwu]Shanghai Artificial Intelligence Laboratory, Shanghai; 200232, China
  • [ 8 ] [Xiong, Shengwu]Wuhan University of Technology, School of Computer Science and Artificial Intelligence, Wuhan; 430070, China
  • [ 9 ] [Xiong, Shengwu]Wuhan University of Technology, Chongqing Research Institute, Chongqing; 401122, China
  • [ 10 ] [Lu, Xiaoqiang]Fuzhou University, College of Physics and Information Engineering, Fuzhou; 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Geoscience and Remote Sensing

ISSN: 0196-2892

Year: 2024

Volume: 62

7 . 5 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:51/10049868
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1