• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Shi, Chenjunhao (Shi, Chenjunhao.) [1] | Li, Jin (Li, Jin.) [2] | Zhuang, Jianzhi (Zhuang, Jianzhi.) [3] | Yao, Xi (Yao, Xi.) [4] | Huang, Yisong (Huang, Yisong.) [5] | Fu, Yang-Geng (Fu, Yang-Geng.) [6]

Indexed by:

CPCI-S EI Scopus

Abstract:

With increasing popularity and larger real-world applicability, graph self-supervised learning (GSSL) can significantly reduce labeling costs by extracting implicit input supervision. As a promising example, graph masked autoencoders (GMAE) can encode rich node knowledge by recovering the masked input components, e.g., features or edges. Despite their competitiveness, existing GMAEs focus only on neighboring information reconstruction, which totally ignores distant multi-hop semantics and thus fails to capture global knowledge. Furthermore, many GMAEs cannot scale on large-scale graphs since they suffer from memory bottlenecks with unavoidable full-batch training. To address these challenges and facilitate "high-level" discriminative semantics, we propose a simple yet effective framework (i.e., HopMAE) to encourage hop-perspective semantic interactions by adopting multi-hop input-rich reconstruction while supporting mini-batch training. Despite the rationales of the above designs, we still observe some limitations (e.g., sub-optimal generalizability and training instability), potentially due to the implicit gap between the task-triviality and input-richness of reconstruction. Therefore, to alleviate task-triviality and fully unleash the potential of our framework, we further propose a combined fine-grained loss function, which generalizes the existing ones and significantly improves the difficulties of reconstruction tasks, thus naturally alleviating over-fitting. Extensive experiments on eight benchmarks demonstrate that our method comprehensively outperforms many state-of-the-art counterparts.

Keyword:

Graph Masked Auto-Encoders Graph Neural Networks Graph Representation Learning Self-Supervised Learning

Community:

  • [ 1 ] [Shi, Chenjunhao]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Peoples R China
  • [ 2 ] [Zhuang, Jianzhi]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Peoples R China
  • [ 3 ] [Yao, Xi]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Peoples R China
  • [ 4 ] [Huang, Yisong]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Peoples R China
  • [ 5 ] [Fu, Yang-Geng]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Peoples R China
  • [ 6 ] [Li, Jin]HKUST Guangzhou, Informat Hub, AI Thrust, Guangzhou, Peoples R China

Reprint 's Address:

  • [Fu, Yang-Geng]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Peoples R China;;

Show more details

Version:

Related Keywords:

Source :

ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024

ISSN: 2945-9133

Year: 2024

Volume: 14876

Page: 343-355

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:642/10065315
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1