基于相对概率变化比的CNN超参数优化方法

卷积神经网络(convolutional neural network,CNN)已被广泛应用于图像识别领域,其自身的超参数对图像分类问题中分类错误率的大小有较大的影响.为进一步优化CNN超参数,提出了基于Softmax回归的相对概率变化比.应用相对概率变化比寻找对图像分类影响较大的超参数,并根据超参数的重要性大小依次对...

CNN hyper-parameters optimization method based on the change ratio of relative probability

Convolutional neural network (CNN) has been widely used in the field of image classification. Its hyper-parameters have a great impact on the misclassification rate. In order to further optimize CNN hyper-parameters, the change ratio of relative probability based on Softmax regression was introduced. The change ratio of relative probability was used to find the hyper-parameters which have great influence on the image classification problem, and the hyper-parameters were adjusted according to their importance. In order to verify the effectiveness of the change ratio of relative probability, experiments were carried out in Architecture 1 and Architecture 2. The experiment results show that the concept of the change ratio of relative probability introduced in Softmax regression can reflect the effect of CNN hyper-parameters on misclassification rate in both architectures, and it is more helpful to find a better combination of CNN hyper-parameters and reduce the misclassification rate. The comparative experiments on MNIST and CIFAR-10 datasets show that the above conclusions are applicable to different datasets.