Home>Results

  • Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

[期刊论文]

Overcoming Forgetting in Local Adaptation of Federated Learning Model

Share
Edit Delete 报错

author:

Liu, Shunjian (Liu, Shunjian.) [1] | Feng, Xinxin (Feng, Xinxin.) [2] (Scholars:冯心欣) | Zheng, Haifeng (Zheng, Haifeng.) [3] (Scholars:郑海峰)

Indexed by:

CPCI-S EI

Abstract:

Federated learning allows multiple clients to train a global model without data exchanging. But in real world, the global model is not suitable for all clients because they may hold heterogenous data and have personalized and individual demands, which will directly weaken the motivation of them to participate in federated learning. To make each client benefits from federated learning, researchers propose to train personalized models from global model using local data. However, the lack of raw data in the model retraining process will lead to the challenge of forgetting, which can deprive the personalized model of the benefits gained from federated learning. In extreme cases (e.g., the client lacks certain classes of data), the ability to recognize the lacked data may even be completely forgotten. To this end, we propose a local adaptation method to overcome forgetting, which add the generator synthetic data to local adaptation to realize model updating incrementally. We test our method on real-world datasets, and the results show that when adopting the proposed method on local adaptation, the clients can get flexible adaption ability to new data as well as keep the original recognition capability of the global model even in extreme cases.

Keyword:

Federated learning Incremental learning Knowledge distillation Local adaptation

Community:

  • [ 1 ] [Liu, Shunjian]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou, Peoples R China
  • [ 2 ] [Feng, Xinxin]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou, Peoples R China
  • [ 3 ] [Zheng, Haifeng]Fuzhou Univ, Coll Phys & Informat Engn, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou, Peoples R China

Reprint 's Address:

Show more details

Related Article:

Source :

ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2022, PT I

ISSN: 0302-9743

Year: 2022

Volume: 13280

Page: 613-625

0 . 4 0 2

JCR@2005

Cited Count:

WoS CC Cited Count: 3

SCOPUS Cited Count: 2

30 Days PV: 2

Online/Total:1204/10122698
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1