首页 | 本学科首页   官方微博 | 高级检索  
     

神经网络紧凑集成模式
引用本文:汪庆华,张优云,朱永生. 神经网络紧凑集成模式[J]. 西安交通大学学报, 2007, 41(3): 295-298
作者姓名:汪庆华  张优云  朱永生
作者单位:1. 西安交通大学润滑理论及轴承研究所,710049,西安;西安工业大学机电学院,710032,西安
2. 西安交通大学润滑理论及轴承研究所,710049,西安
摘    要:在分析现有神经网络集成构造过程的基础上,提出了一种神经网络紧凑集成模式,集成中成员网络的训练和网络组合权重的优化在同一个学习过程中进行,各参数的调整以提高集成泛化性能为目的.与现有神经网络集成模式相比,集成构造过程更加紧凑,它将个体网络生成阶段与结论合成阶段合二为一,并且网络之间的信息交互建立在实时动态的集成结构基础上,保证了成员网络训练与结论合成之间信息传递的始终一致性.为验证该模式的有效性及优越性,采用4种典型的分类数据集对神经网络紧凑集成模式与CNNE、Bagging、Boosting等现有的集成模式在泛化性能上进行了比较,结果表明神经网络集成模式在测试数据集上的错误率降低了8%~16%.

关 键 词:神经网络集成  紧凑集成模式  组合权重  泛化性能
文章编号:0253-987X(2007)03-0295-04
收稿时间:2006-08-25
修稿时间:2006-08-25

Compact Ensemble Model of Neural Networks
Wang Qinghua,Zhang Youyun,Zhu Yongsheng. Compact Ensemble Model of Neural Networks[J]. Journal of Xi'an Jiaotong University, 2007, 41(3): 295-298
Authors:Wang Qinghua  Zhang Youyun  Zhu Yongsheng
Abstract:Analyzing the construction process of the existing neural network ensembles, a novel compact ensemble model of neural networks is proposed. Training members in an ensemble and optimizing the combination weights for members are carried out simultaneously in the same learning process, and all parameters are adjusted to improve the generalization ability of the ensemble. In comparison with other existing ensemble model, the ensemble construction process is more compact by integrating the two stages into one, and the communication among neural networks is based on the real-time and dynamic structure of an ensemble so that the information conveyed between integration and training always keeps coincident. To validate the validity and advantage of this ensemble model, four well known classification problems are considered to compare the generalization error of compact ensemble with the generalization error of CNNE, Bagging, Boosting and other existing neural network ensemble model. The experimental results show that the error rate on testing sets can be decreased with compact ensemble model by 8% to 16%.
Keywords:neural network ensemble   compact ensemble model   combination weight   generaliza tion ability
本文献已被 CNKI 维普 万方数据 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号