首页 | 本学科首页   官方微博 | 高级检索  
     检索      

基于改进型FP-Tree的分布式关联分类算法
引用本文:卢琦蓓,郭飞鹏.基于改进型FP-Tree的分布式关联分类算法[J].山东大学学报(自然科学版),2014(1):71-75.
作者姓名:卢琦蓓  郭飞鹏
作者单位:[1]浙江工商大学管理科学与工程研究所,浙江杭州310018 [2]台州职业技术学院工商管理系,浙江台州318000 [3]浙江经贸职业技术学院信息技术系,浙江杭州310018
基金项目:国家自然科学基金资助项目(71071141);教育部人文社会科学研究基金资助项目(BYJC630041);浙江省自然科学基金资助项目(LQ13G020008);浙江省教育厅科研项目(Y201225624)
摘    要:传统的信息挖掘技术已经无法满足大数据环境下日益复杂的应用需求,而分布式数据挖掘技术是解决这个难题的一种手段,因此提出了基于改进型频繁模式树(FP-Tree)的分布式关联分类算法。首先,在各局部节点优化FP-Tree。生成局部条件模式树(CFP-Tree),再通过各节点间传送CFP-Tree构建全局CFP-Tree;其次,在挖掘全局CFP-Tree时通过计算显著度来获取初始的全局显著分类规则;最后,利用剪枝策略选取一个较小规则集来构造全局的关联分类器。实验结果表明该算法能够有效降低网络通信量,提高信息挖掘效率,同时保证剪枝的质量和规则的统计显著性,提高分类的精确性。

关 键 词:频繁模式树  条件模式树  关联分类  显著度  分布式信息挖掘

Distributed associative classification algorithm based on improved FP-tree
LU Qi-bei,GUO Fei-peng.Distributed associative classification algorithm based on improved FP-tree[J].Journal of Shandong University(Natural Science Edition),2014(1):71-75.
Authors:LU Qi-bei  GUO Fei-peng
Institution:1. Institute of Management Science and Engineering, Zhejiang Gongshang University, Hangzhou 310018, Zhejiang, China; 2. Department of Business Administration, Taizhou Vocational and Technical College, Taizhou 318000, Zhejiang, China; 3. Department of Information Technology, Zhejiang Economic and Trade Polytechnic, Hangzhou 310018, Zhejiang, China)
Abstract:Traditional information mining technology has been unable to meet the increasingly complex application requirements in the big data environment. The distributed data mining technique is a means to solve this problem. An improved distributed associative classification algorithm based on improved FP-tree was presented. First, FP-Tree was optimized in each local node to generate local conditional pattern tree ( CFP-Tree), and then a global CFP-Tree was constructed through the inter-site transmission of each CFP-Tree. Second, the initial global significant classification rules were obtained by calculating significant degree in the process of global CFP-Tree mining. Final, the pruning strate- gies were used to get a small set of rules to construct the overall associative classifier. Experimental results show that this algorithm can not only effectively reduce network traffic and improve mining efficiency, but also ensure ensuring statistical significance of rules and improve the ability for the discovery of implicit rules.
Keywords:FP-tree  conditional pattern tree  associative classification  significant degree  distributed information mining
本文献已被 维普 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号