Home>Results

  • Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

[期刊论文]

Research on the parallelization of the DBSCAN clustering algorithm for spatial data mining based on the Spark platform

Share
Edit Delete 报错

author:

Huang, F. (Huang, F..) [1] | Zhu, Q. (Zhu, Q..) [2] | Zhou, J. (Zhou, J..) [3] | Unfold

Indexed by:

Scopus

Abstract:

Density-based spatial clustering of applications with noise (DBSCAN) is a density-based clustering algorithm that has the characteristics of being able to discover clusters of any shape, effectively distinguishing noise points and naturally supporting spatial databases. DBSCAN has been widely used in the field of spatial data mining. This paper studies the parallelization design and realization of the DBSCAN algorithm based on the Spark platform, and solves the following problems that arise when computing macro data: the requirement of a great deal of calculation using the single-node algorithm; the low level of resource-utilization with the multi-node algorithm; the large time consumption; and the lack of instantaneity. The experimental results indicate that the proposed parallel algorithm design is able to achieve more stable speedup at an increased involved spatial data scale. © 2017 by the author.

Keyword:

DBSCAN algorithm; Parallel computing; Spark platform; Spatial data mining; Traffic congestion area discovery

Community:

  • [ 1 ] [Huang, F.]School of Resources and Environment, University of Electronic Science and Technology of China, 2006 Xiyuan Ave., West Hi-Tech Zone, Chengdu, 611731, China
  • [ 2 ] [Huang, F.]Institute of Remote Sensing Big Data, Big Data Research Center, University of Electronic Science and Technology of China, 2006 Xiyuan Road, West Hi-Tech Zone, Chengdu, 611731, China
  • [ 3 ] [Zhu, Q.]School of Resources and Environment, University of Electronic Science and Technology of China, 2006 Xiyuan Ave., West Hi-Tech Zone, Chengdu, 611731, China
  • [ 4 ] [Zhou, J.]School of Resources and Environment, University of Electronic Science and Technology of China, 2006 Xiyuan Ave., West Hi-Tech Zone, Chengdu, 611731, China
  • [ 5 ] [Tao, J.]Texas A and M Engineering Experiment Station and High Performance Research Computing, Texas A and M University, College Station, TX 77843, United States
  • [ 6 ] [Zhou, X.]Key Laboratory of Spatial Data Mining and Information Sharing of Ministry of Education, Fuzhou University, No. 2 Xueyuan Road, Fuzhou University New District, Fuzhou, 350116, China
  • [ 7 ] [Jin, D.]School of Resources and Environment, University of Electronic Science and Technology of China, 2006 Xiyuan Ave., West Hi-Tech Zone, Chengdu, 611731, China
  • [ 8 ] [Tan, X.]International School of Software, Wuhan University, 129 Luoyu Road, Wuhan, 430079, China
  • [ 9 ] [Wang, L.]School of Computer Science, China University of Geosciences, Wuhan, 430074, China
  • [ 10 ] [Wang, L.]Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, 10094, China

Reprint 's Address:

  • [Huang, F.]School of Resources and Environment, University of Electronic Science and Technology of China, 2006 Xiyuan Ave., China

Show more details

Source :

Remote Sensing

ISSN: 2072-4292

Year: 2017

Issue: 12

Volume: 9

3 . 4 0 6

JCR@2017

4 . 2 0 0

JCR@2023

ESI HC Threshold:177

JCR Journal Grade:2

CAS Journal Grade:3

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 39

30 Days PV: 1

Affiliated Colleges:

Online/Total:91/10137224
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1