• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Li, Jin (Li, Jin.) [1] | Huang, Yisong (Huang, Yisong.) [2] | Chen, Xinlong (Chen, Xinlong.) [3] | Fu, Yang-Geng (Fu, Yang-Geng.) [4]

Indexed by:

EI ESCI Scopus

Abstract:

As a kind of generalization of Transformers in the graph domain, Global Graph Transformers are good at learning distant knowledge by directly doing information interactions on complete graphs, which differs from Local Graph Transformers interacting on the original structures. However, we find that most prior works focus only on graph-level tasks (e.g., graph classification) and few Graph Transformer models can effectively solve node-level tasks, especially semi-supervised node classification, which obviously has important practical significance due to the limitation and expensiveness of these node labels. In order to fill this gap, this paper first summarizes the theoretical advantages of Graph Transformers. And based on some exploring experiments, we give some discussions on the main cause of their poor practical performance in semi-supervised node classifications. Secondly, based on this analysis, we design a three-stage homogeneity augmentation framework and propose a Semi-Global Graph Transformer. Considering both global and local perspectives, the proposed model combines various technologies including self-distillation, pseudo-label filtering, pre-training and fine-tuning, and metric learning. Furthermore, it simultaneously enhances the structure and the optimization, improving its effectiveness, scalability, and generalizability. Finally, extensive experiments on seven public homogeneous and heterophilous graph benchmarks show that the proposed method can achieve competitive or much better results compared to many baseline models including state-of-the-arts. © 2023 World Scientific Publishing Company.

Keyword:

Classification (of information) Distillation Graphic methods Graph neural networks Graph structures Graph theory Structural optimization

Community:

  • [ 1 ] [Li, Jin]College of Computer and Data Science, Fuzhou University, No. 2, Wulongjiang North Avenue, Fuzhou; 350108, China
  • [ 2 ] [Huang, Yisong]College of Computer and Data Science, Fuzhou University, No. 2, Wulongjiang North Avenue, Fuzhou; 350108, China
  • [ 3 ] [Chen, Xinlong]College of Computer and Data Science, Fuzhou University, No. 2, Wulongjiang North Avenue, Fuzhou; 350108, China
  • [ 4 ] [Fu, Yang-Geng]College of Computer and Data Science, Fuzhou University, No. 2, Wulongjiang North Avenue, Fuzhou; 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Parallel Processing Letters

ISSN: 0129-6264

Year: 2023

Issue: 1-2

Volume: 33

0 . 5

JCR@2023

0 . 5 0 0

JCR@2023

JCR Journal Grade:4

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 2

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:63/10066618
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1