模块化神经网络子网的动态集成方法学研究

提出一个模块化神经网络的广义定义,它包含了几乎所有多神经网络(系统)。简要分析了模块化神经网络子网集成的相关概念和问题。针对一类模块化神经网络,提出了5种基于"分而治之"原理和自适应组合的新型动态集成方法。它们之间的主要区别在于:距离测度(绝对距离测度和相对距离测度);个体数目(有些全部参与集成,有些则是部分参与);集成策略和规则(数据驱动和数据/知识驱动)。仿真实验证实了这些方法的有效性。同时,还提出了一种基于"一专多能"思想的子网训练方法。

Methodological research for dynamic integration of modular neural network's sub-networks

A generalized definition of modular neural networks(MNN) that almost include all multi-neural networks(systems) is presented.Some relative concepts and problems of MNN' dynamic integration are briefly analyzed.Five new dynamic integration algorithms are presented for a kind of modular neural networks that are based on the principle of "divide and conguer" and adaptive combination.The main differences among each sub-method are: distance measure(absolute distance measure and relative distance measure) and computing method;selected and integrated number of the candidates(some integrate all networks and the others select only in part);integrated strategy and rule(some are based on data driven or knowledge driven,the others are based on data and knowledge driven).Empirical studies show these algorithms' effectiveness and potential.Meanwhile,a technical approach based on the thought of "experienced-in-one-aspect-and-feasible-in-others" is presented for MNN sub-networks' training.