• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Yang, D. (Yang, D..) [1] | Peng, X. (Peng, X..) [2] | Wu, X. (Wu, X..) [3] | Huang, H. (Huang, H..) [4] | Li, L. (Li, L..) [5] | Zhong, W. (Zhong, W..) [6]

Indexed by:

Scopus

Abstract:

During the process of real-time monitoring, low sampling rate make it difficult to construct a prediction model of variable due to the lack of data. Transfer learning addresses the dilemma of lacking sufficiently labeled data for training neural networks by leveraging relevant labeled data for knowledge transfer, which can significantly improve the prediction accuracy of the low sampling rate variable by utilizing high sampling rate variables. When the feature spaces of low and high sampling rate indicators do not coincide, it constitutes a special case of transfer learning known as Heterogeneous Transfer Learning (HTL). One classical way of HTL is fine-tuning the pre-trained source model. Nevertheless, they mainly focus on optimizing the weights of pre-trained models and ignore the mismatch of structure. Therefore, in this paper, Domain Perceptive-Pruning and Fine-tuning (DP-PF) is proposed for HTL to simultaneously tune the structure and weights of the source pre-trained model and improve its adaptability to the target task. Specifically, DP-PF proposes target-perceptive pruning that removes unimportant layers from the source pre-trained model based on the target pre-trained model to tune structure, importance-perceptive fine-tuning with adaptive learning rate based on layer importance to tune the weights, and source-perceptive regularizing to mitigate catastrophic forgetting of original knowledge contained in the source model. Experiments are constructed based on the wastewater treatment process and air quality prediction. The R2 predicted by DP-PF is at least 12% higher than that of other compared methods. The excellence of DP-PF in accurate cross-domain prediction proves the effectiveness of the proposed method. © 2024

Keyword:

Air quality prediction Fine-tune Heterogeneous transfer learning Prune Regularize Wastewater treatment process

Community:

  • [ 1 ] [Yang D.]Department of Information and Electrical Engineering, Hunan University of Science and Technology, Xiangtan, 411201, China
  • [ 2 ] [Yang D.]Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, 200237, China
  • [ 3 ] [Peng X.]Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, 200237, China
  • [ 4 ] [Wu X.]Faculty of Information Technology, Beijing Key Laboratory of Computational Intelligence and Intelligent System, Engineering Research Center of Digital Community, Ministry of Education, Beijing Artificial Intelligence Institute and Beijing Laboratory for Intelligent Environmental Protection, Beijing University of Technology, Beijing, 100124, China
  • [ 5 ] [Huang H.]College of Electrical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China
  • [ 6 ] [Li L.]Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, 100083, China
  • [ 7 ] [Zhong W.]Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, 200237, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

Expert Systems with Applications

ISSN: 0957-4174

Year: 2025

Volume: 260

7 . 5 0 0

JCR@2023

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:43/10146857
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1