| 基于Hadoop平台上面向电影数据集Kmeans算法的改进 |
| |
| 引用本文： | 朱蔷蔷,张桂芸,刘文龙. 基于Hadoop平台上面向电影数据集Kmeans算法的改进[J]. 哈尔滨师范大学自然科学学报, 2012, 28(1): 32-36 |
| |
| 作者姓名： | 朱蔷蔷 张桂芸 刘文龙 |
| |
| 作者单位： | 天津师范大学 |
| |
| 基金项目： | 国家自然科学基金项目，天津市教委资助项目，天津市科技支撑计划重点项目，天津师大博士基金项目资助 |
| |
| 摘 要： | 针对聚类算法并行化的需求,该文对基于Hadoop平台Kmeans算法进行了改进,选用Canopy算法对数据进行预处理,并在具有一定数据结构的电影数据集上进行了单机对比实验,集群加速比实验和集群扩展率实验,分别体现改进后算法实现的高效性、良好的加速比和可扩展性,从而可以有效地运用在实际海量数据挖掘中.
|
| 关 键 词： | Hadoop Map Reduce Kmeans |
The Improvement of Kmeans Algorithm Facing the Movie Dataset Based on Hadoop Platform |
| |
| Zhu Qiangqiang,Zhang Guiyun,Liu Wenlong. The Improvement of Kmeans Algorithm Facing the Movie Dataset Based on Hadoop Platform[J]. Natural Science Journal of Harbin Normal University, 2012, 28(1): 32-36 |
| |
| Authors: | Zhu Qiangqiang Zhang Guiyun Liu Wenlong |
| |
| Affiliation: | ( Tianjin Normal University) |
| |
| Abstract: | According to parallelism demand of the clustering algorithm, This paper improved the implemention of the kmeans algorithm based on the Hadoop platform. We do the preprocess on the dataset using the canopy algorithm, and conduct the single contrast experiment, cluster speed up experiment and cluster expansion rate experiment, showing the high effiency, better speed up and scalability, thus the implemention can be used in the pratical mass data mining effectively. |
| |
| Keywords: | Hadoop Map Reduce Kmeans |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
|
