• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Huang, Wei (Huang, Wei.) [1] (Scholars:黄维) | Wang, Dexian (Wang, Dexian.) [2] | Ouyang, Xiaocao (Ouyang, Xiaocao.) [3] | Wan, Jihong (Wan, Jihong.) [4] | Liu, Jia (Liu, Jia.) [5] | Li, Tianrui (Li, Tianrui.) [6]

Indexed by:

EI

Abstract:

Multimodal learning mines and analyzes multimodal data in reality to better understand and appreciate the world around people. However, how to exploit this rich multimodal data without violating user privacy is a key issue. Federated learning is a privacy-conscious alternative to centralized machine learning, therefore many researchers have combined federated learning with multimodal learning to break down data barriers for the purpose of jointly leveraging multiple modal data from different clients for modeling. In order to provide a systematic summarize of multimodal federated learning, this paper describes the basic mode of multimodal federated learning, multimodal fusion based on federated learning, multimodal federated learning optimization and multimodal federated learning application, and introduces each type of multimodal federated learning methods in detail. Finally, the future research trends of multimodal federated learning are discussed and analyzed, mainly including the optimization of multimodal federated learning, privacy-preserving techniques for multimodal federated learning, multimodal federated few-shot learning & multimodal federated semi-supervised learning, and data and knowledge-driven multimodal federated learning. © 2024 Elsevier B.V.

Keyword:

Learning systems Modal analysis Privacy-preserving techniques

Community:

  • [ 1 ] [Huang, Wei]College of Computer and Data Science, Fuzhou University, Fuzhou; 350108, China
  • [ 2 ] [Wang, Dexian]School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu; 611137, China
  • [ 3 ] [Ouyang, Xiaocao]School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu; 611756, China
  • [ 4 ] [Wan, Jihong]School of Computer Science and Technology, Guangdong University of Technology, Guangdong; 510006, China
  • [ 5 ] [Liu, Jia]School of Computer and Software Engineering, Xihua University, Chengdu; 610039, China
  • [ 6 ] [Li, Tianrui]School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu; 611756, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Information Fusion

ISSN: 1566-2535

Year: 2024

Volume: 112

1 4 . 8 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Online/Total:68/10006766
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1