• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Huang, Yicheng (Huang, Yicheng.) [1] | Lan, Xingtu (Lan, Xingtu.) [2] | Chen, Xing (Chen, Xing.) [3] (Scholars:陈星) | Guo, Wenzhong (Guo, Wenzhong.) [4] (Scholars:郭文忠)

Indexed by:

CPCI-S EI Scopus

Abstract:

Hadoop is an open source software framework of distributed processing of big data. There are many kinds of services in Hadoop ecosystem, such as HDFS, Map-Reduce, HBase, Hive, Yarn, Flume, Spark, Storm, Zookeeper, and so on, which increase the complexity of deployment and configuration. It takes plenty of time to construct a Hadoop cluster. Although there are some management tools which help administrators deploy and configure Hadoop clusters automatically, they usually provide a fixed solution. So administrators couldn't construct their Hadoop clusters according to different management requirements by the tools. Software architecture acts as a bridge between requirements and implementations. It has been used to reduce the complexity and cost mainly resulted from the difficulties faced by understanding the large-scale and complex software system. This paper proposes a model based approach to Hadoop deployment and configuration which help administrators construct Hadoop clusters in a simple but powerful enough manner. First, we provide the unified models of Hadoop software architecture, according to the domain knowledge of current Hadoop deployment and configuration. Second, we provide a framework with a set of definable rules for domain experts to describe their solutions to deploy and configure Hadoop clusters. Thus, administrators can use various custom solutions to automatically deploy and configure their Hadoop clusters according to different management requirements. In addition, a real-world experiment demonstrates the feasibility, effectiveness and benefits of the new approach to Hadoop deployment and configuration.

Keyword:

Hadoop Deployment and Configuration Models at Runtime Software Architecture

Community:

  • [ 1 ] [Huang, Yicheng]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
  • [ 2 ] [Lan, Xingtu]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
  • [ 3 ] [Chen, Xing]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China
  • [ 4 ] [Huang, Yicheng]Fujian Prov Key Lab Networking Comp & Intelligent, Fuzhou, Peoples R China
  • [ 5 ] [Lan, Xingtu]Fujian Prov Key Lab Networking Comp & Intelligent, Fuzhou, Peoples R China
  • [ 6 ] [Chen, Xing]Fujian Prov Key Lab Networking Comp & Intelligent, Fuzhou, Peoples R China

Reprint 's Address:

  • 黄益成

    [Huang, Yicheng]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Peoples R China

Show more details

Version:

Related Keywords:

Related Article:

Source :

2015 12TH WEB INFORMATION SYSTEM AND APPLICATION CONFERENCE (WISA)

Year: 2015

Page: 79-84

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:158/9997469
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1