• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Huang, Zhiming (Huang, Zhiming.) [1] | Weng, Qian (Weng, Qian.) [2] (Scholars:翁谦) | Lin, Jiawen (Lin, Jiawen.) [3] | Jian, Cairen (Jian, Cairen.) [4]

Indexed by:

EI

Abstract:

Scene classification is a key step in intelligent information processing of high-resolution remote sensing, which aims to identify the land-use types of remote sensing image blocks. In recent years, the models based on deep convolution neural networks (CNN) have made outstanding achievements in the field of remote sensing, but these models are computationally expensive and time-consuming, while the lightweight shallow network models have few parameters, fast speed, but low accuracy. Both the deep CNN models and the lightweight shallow network models could not be directly applied to embedded devices. Therefore, we propose an Adaptive Enhanced Knowledge Distillation (AE-KD) to deeply mine the output and feature information from teacher model and transfer them to student model, so as to improve the performance of lightweight model. Firstly, aiming at the uneven degree of difference among remote sensing image categories, an adaptive temperature mechanism is proposed by improving the temperature mechanism in the traditional knowledge distillation, which promotes the student model to better learn the probability distribution knowledge from the output layer of the large and deep teacher model. And then, the spatial attention and inter-channel correlation of features are added as constraints in order to make the student model learn the multi-level knowledge from teacher model. The experimental results on UC Merced Land-Use and AID public datasets show that the proposed method reduces 91 % parameters of the teacher model and improves the prediction speed by 22 times, where it has only a small loss of classification accuracy, which is effective for the lightweight model. ablation study also further analyzes and discusses the performance improvement of the student model under different levels of knowledge distillation. © 2022 IEEE.

Keyword:

Classification (of information) Distillation Image enhancement Land use Probability distributions Remote sensing Students

Community:

  • [ 1 ] [Huang, Zhiming]Fuzhou University, College of Computer and Data Science, Fuzhou, China
  • [ 2 ] [Weng, Qian]Fuzhou University, College of Computer and Data Science, Fuzhou, China
  • [ 3 ] [Lin, Jiawen]Fuzhou University, College of Computer and Data Science, Fuzhou, China
  • [ 4 ] [Jian, Cairen]Xiamen University Tan Kah Kee College, School of Information Science and Technology, Zhangzhou, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Year: 2022

Language: English

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 6

Online/Total:245/9288998
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1