• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Cheng, Yongli (Cheng, Yongli.) [1] | Wang, Fang (Wang, Fang.) [2] | Jiang, Hong (Jiang, Hong.) [3] | Hua, Yu (Hua, Yu.) [4] | Feng, Dan (Feng, Dan.) [5] | Wu, Yunxiang (Wu, Yunxiang.) [6] | Zhu, Tingwei (Zhu, Tingwei.) [7] | Guo, Wenzhong (Guo, Wenzhong.) [8]

Indexed by:

EI

Abstract:

Existing distributed graph-processing frameworks, e.g., Pregel, GPS and Giraph, handle large-scale graphs in the memory of clusters built of commodity compute nodes for better scalability and performance. While capable of scaling out according to the size of graphs up to thousands of compute nodes, for graphs beyond a certain size, these frameworks would usually require investments of machines that are either beyond the financial capability of or unprofitable for most small and medium-sized organizations, making the deployment of their large-scale graph-computing jobs difficult if not impossible. At the other end of the spectrum of graph-processing frameworks research, the single-node disk-based graph-computing frameworks, such as GraphChi and XStream, handle large-scale graphs on just one commodity computer, leading to high efficiency in the use of hardware but at the cost of low user performance and limited scalability. Motivated by this dichotomy, in this paper we propose a pipeline-based task scheduling strategy with high cost-effectiveness. We use this scheduling strategy to design and implement a distributed disk-based graph-processing framework, called DD-Graph, that can process very large graphs with trillions of edges on a small cluster while achieving the high performance of existing distributed in-memory graph-processing frameworks. The evaluation of DD-Graph prototype, driven by very large graph datasets, shows that it saves 73% of GPS’ hardware costs while running 1.34x faster than GPS. © 2018 Elsevier B.V.

Keyword:

Computer hardware Cost effectiveness Graphic methods Graph theory Large dataset Multitasking Scalability

Community:

  • [ 1 ] [Cheng, Yongli]College of Mathematics and Computer Science, FuZhou University, China
  • [ 2 ] [Cheng, Yongli]School of Computer, Huazhong University of Science and Technology, WuHan, China
  • [ 3 ] [Wang, Fang]School of Computer, Huazhong University of Science and Technology, WuHan, China
  • [ 4 ] [Jiang, Hong]Department of Computer Science & Engineering, University of Texas at Arlington, United States
  • [ 5 ] [Hua, Yu]School of Computer, Huazhong University of Science and Technology, WuHan, China
  • [ 6 ] [Feng, Dan]School of Computer, Huazhong University of Science and Technology, WuHan, China
  • [ 7 ] [Wu, Yunxiang]School of Computer, Huazhong University of Science and Technology, WuHan, China
  • [ 8 ] [Zhu, Tingwei]School of Computer, Huazhong University of Science and Technology, WuHan, China
  • [ 9 ] [Guo, Wenzhong]College of Mathematics and Computer Science, FuZhou University, China
  • [ 10 ] [Guo, Wenzhong]Key Lab of Spatial Data Mining & Info. Sharing, Min. of Education, Fuzhou, China
  • [ 11 ] [Guo, Wenzhong]Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, China

Reprint 's Address:

  • [cheng, yongli]school of computer, huazhong university of science and technology, wuhan, china;;[cheng, yongli]college of mathematics and computer science, fuzhou university, china

Show more details

Related Keywords:

Related Article:

Source :

Future Generation Computer Systems

ISSN: 0167-739X

Year: 2018

Volume: 89

Page: 698-712

5 . 7 6 8

JCR@2018

6 . 2 0 0

JCR@2023

ESI HC Threshold:174

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:42/10065576
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1