• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Liao, Xinting (Liao, Xinting.) [1] | Chen, Chaochao (Chen, Chaochao.) [2] | Liu, Weiming (Liu, Weiming.) [3] | Zhou, Pengyang (Zhou, Pengyang.) [4] | Zhu, Huabin (Zhu, Huabin.) [5] | Shen, Shuheng (Shen, Shuheng.) [6] | Wang, Weiqiang (Wang, Weiqiang.) [7] | Hu, Mengling (Hu, Mengling.) [8] | Tan, Yanchao (Tan, Yanchao.) [9] | Zheng, Xiaolin (Zheng, Xiaolin.) [10]

Indexed by:

EI

Abstract:

Federated learning (FL) is a distributed machine learning paradigm that needs collaboration between a server and a series of clients with decentralized data. To make FL effective in real-world applications, existing work devotes to improving the modeling of decentralized non-IID data. In non-IID settings, there are intra-client inconsistency that comes from the imbalanced data modeling, and inter-client inconsistency among heterogeneous client distributions, which not only hinders sufficient representation of the minority data, but also brings discrepant model deviations. However, previous work overlooks to tackle the above two coupling inconsistencies together. In this work, we propose FedRANE, which consists of two main modules, i.e., local relational augmentation (LRA) and global Nash equilibrium (GNE), to resolve intra-and inter-client inconsistency simultaneously. Specifically, in each client, LRA mines the similarity relations among different data samples and enhances the minority sample representations with their neighbors using attentive message passing. In server, GNE reaches an agreement among inconsistent and discrepant model deviations from clients to server, which encourages the global model to update in the direction of global optimum without breaking down the clients' optimization toward their local optimums. We conduct extensive experiments on four benchmark datasets to show the superiority of FedRANE in enhancing the performance of FL with non-IID data. © 2023 ACM.

Keyword:

Benchmarking Computation theory Game theory Learning systems Message passing

Community:

  • [ 1 ] [Liao, Xinting]College of Computer Science, Zhejiang University, China
  • [ 2 ] [Chen, Chaochao]College of Computer Science, Zhejiang University, China
  • [ 3 ] [Liu, Weiming]College of Computer Science, Zhejiang University, China
  • [ 4 ] [Zhou, Pengyang]College of Computer Science, Zhejiang University, China
  • [ 5 ] [Zhu, Huabin]College of Computer Science, Zhejiang University, China
  • [ 6 ] [Shen, Shuheng]Tiansuan Lab, Ant Group, China
  • [ 7 ] [Wang, Weiqiang]Tiansuan Lab, Ant Group, China
  • [ 8 ] [Hu, Mengling]College of Computer Science, Zhejiang University, China
  • [ 9 ] [Tan, Yanchao]College of Computer and Data Science, Fuzhou University, China
  • [ 10 ] [Zheng, Xiaolin]College of Computer Science, Zhejiang University, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Year: 2023

Page: 1536-1545

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 3

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:2/10090958
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1