Research on the Parallelization of the DBSCAN Clustering Algorithm for Spatial Data Mining Based on the Spark Platform Academic Article uri icon

abstract

  • 2017 by the author. Density-based spatial clustering of applications with noise (DBSCAN) is a density-based clustering algorithm that has the characteristics of being able to discover clusters of any shape, effectively distinguishing noise points and naturally supporting spatial databases. DBSCAN has been widely used in the field of spatial data mining. This paper studies the parallelization design and realization of the DBSCAN algorithm based on the Spark platform, and solves the following problems that arise when computing macro data: the requirement of a great deal of calculation using the single-node algorithm; the low level of resource-utilization with the multi-node algorithm; the large time consumption; and the lack of instantaneity. The experimental results indicate that the proposed parallel algorithm design is able to achieve more stable speedup at an increased involved spatial data scale.

published proceedings

  • REMOTE SENSING

author list (cited authors)

  • Huang, F., Zhu, Q., Zhou, J. i., Tao, J., Zhou, X., Jin, D. u., Tan, X., & Wang, L.

citation count

  • 28

complete list of authors

  • Huang, Fang||Zhu, Qiang||Zhou, Ji||Tao, Jian||Zhou, Xiaocheng||Jin, Du||Tan, Xicheng||Wang, Lizhe

publication date

  • January 2017

publisher