• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Cheng, Yongli (Cheng, Yongli.) [1] (Scholars:程永利) | Wang, Fang (Wang, Fang.) [2] | Jiang, Hong (Jiang, Hong.) [3] | Hua, Yu (Hua, Yu.) [4] | Feng, Dan (Feng, Dan.) [5] | Wu, Yunxiang (Wu, Yunxiang.) [6] | Zhu, Tingwei (Zhu, Tingwei.) [7] | Guo, Wenzhong (Guo, Wenzhong.) [8] (Scholars:郭文忠)

Indexed by:

EI Scopus SCIE

Abstract:

Existing distributed graph-processing frameworks, e.g., Pregel, GPS and Giraph, handle large-scale graphs in the memory of clusters built of commodity compute nodes for better scalability and performance. While capable of scaling out according to the size of graphs up to thousands of compute nodes, for graphs beyond a certain size, these frameworks would usually require investments of machines that are either beyond the financial capability of or unprofitable for most small and medium-sized organizations, making the deployment of their large-scale graph-computing jobs difficult if not impossible. At the other end of the spectrum of graph-processing frameworks research, the single-node disk-based graph-computing frameworks, such as GraphChi and XStream, handle large-scale graphs on just one commodity computer, leading to high efficiency in the use of hardware but at the cost of low user performance and limited scalability. Motivated by this dichotomy, in this paper we propose a pipeline-based task scheduling strategy with high cost-effectiveness. We use this scheduling strategy to design and implement a distributed disk-based graph-processing framework, called DD-Graph, that can process very large graphs with trillions of edges on a small cluster while achieving the high performance of existing distributed in-memory graph-processing frameworks. The evaluation of DD-Graph prototype, driven by very large graph datasets, shows that it saves 73% of GPS' hardware costs while running 1.34x faster than GPS. (C) 2018 Elsevier B.V. All rights reserved.

Keyword:

Cost-effectiveness Graph computation Very large graphs

Community:

  • [ 1 ] [Cheng, Yongli]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou, Fujian, Peoples R China
  • [ 2 ] [Guo, Wenzhong]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou, Fujian, Peoples R China
  • [ 3 ] [Cheng, Yongli]Huazhong Univ Sci & Technol, Sch Comp, Wuhan, Hubei, Peoples R China
  • [ 4 ] [Wang, Fang]Huazhong Univ Sci & Technol, Sch Comp, Wuhan, Hubei, Peoples R China
  • [ 5 ] [Hua, Yu]Huazhong Univ Sci & Technol, Sch Comp, Wuhan, Hubei, Peoples R China
  • [ 6 ] [Feng, Dan]Huazhong Univ Sci & Technol, Sch Comp, Wuhan, Hubei, Peoples R China
  • [ 7 ] [Wu, Yunxiang]Huazhong Univ Sci & Technol, Sch Comp, Wuhan, Hubei, Peoples R China
  • [ 8 ] [Zhu, Tingwei]Huazhong Univ Sci & Technol, Sch Comp, Wuhan, Hubei, Peoples R China
  • [ 9 ] [Jiang, Hong]Univ Texas Arlington, Dept Comp Sci & Engn, Arlington, TX 76019 USA
  • [ 10 ] [Guo, Wenzhong]Min Educ, Key Lab Spatial Data Min & Info Sharing, Fuzhou, Fujian, Peoples R China
  • [ 11 ] [Guo, Wenzhong]Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou, Fujian, Peoples R China

Reprint 's Address:

  • 程永利

    [Cheng, Yongli]2 Xue Yuan Rd, Fuzhou 350108, Fujian, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE

ISSN: 0167-739X

Year: 2018

Volume: 89

Page: 698-712

5 . 7 6 8

JCR@2018

6 . 2 0 0

JCR@2023

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:174

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:169/10063200
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1