Home>Results

  • Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

[会议论文]

Towards model based approach to hadoop deployment and configuration

Share
Edit Delete 报错

author:

Huang, Yicheng (Huang, Yicheng.) [1] | Lan, Xingtu (Lan, Xingtu.) [2] | Chen, Xing (Chen, Xing.) [3] | Unfold

Indexed by:

EI

Abstract:

Hadoop is an open source software framework of distributed processing of big data. There are many kinds of services in Hadoop ecosystem, such as HDFS, Map-Reduce, HBase, Hive, Yarn, Flume, Spark, Storm, Zookeeper, and so on, which increase the complexity of deployment and configuration. It takes plenty of time to construct a Hadoop cluster. Although there are some management tools which help administrators deploy and configure Hadoop clusters automatically, they usually provide a fixed solution. So administrators couldn't construct their Hadoop clusters according to different management requirements by the tools. Software architecture acts as a bridge between requirements and implementations. It has been used to reduce the complexity and cost mainly resulted from the difficulties faced by understanding the large-scale and complex software system. This paper proposes a model based approach to Hadoop deployment and configuration which help administrators construct Hadoop clusters in a simple but powerful enough manner. First, we provide the unified models of Hadoop software architecture, according to the domain knowledge of current Hadoop deployment and configuration. Second, we provide a framework with a set of definable rules for domain experts to describe their solutions to deploy and configure Hadoop clusters. Thus, administrators can use various custom solutions to automatically deploy and configure their Hadoop clusters according to different management requirements. In addition, a real-world experiment demonstrates the feasibility, effectiveness and benefits of the new approach to Hadoop deployment and configuration. © 2015 IEEE.

Keyword:

Computer programming Data handling Information systems Information use Open source software Open systems Software architecture

Community:

  • [ 1 ] [Huang, Yicheng]College of Mathematics and Computer Science, Fuzhou University, Fuzhou; 350108, China
  • [ 2 ] [Huang, Yicheng]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, China
  • [ 3 ] [Lan, Xingtu]College of Mathematics and Computer Science, Fuzhou University, Fuzhou; 350108, China
  • [ 4 ] [Lan, Xingtu]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, China
  • [ 5 ] [Chen, Xing]College of Mathematics and Computer Science, Fuzhou University, Fuzhou; 350108, China
  • [ 6 ] [Chen, Xing]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, China
  • [ 7 ] [Guo, Wenzhong]Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, China

Reprint 's Address:

  • [chen, xing]fujian provincial key laboratory of networking computing and intelligent information processing, china;;[chen, xing]college of mathematics and computer science, fuzhou university, fuzhou; 350108, china

Show more details

Related Article:

Source :

Year: 2015

Page: 79-84

Language: English

Cited Count:

WoS CC Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:34/10106621
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1