Multiclassification algorithm and its realization based on least square support vector machine algorithm

1.INTRODUCTION Thedatabasedmachinelearningasastatisticlearning methodplaysanimportantpartinmodernintelligent technology.Basedontheresearchofstatisticlearning theory,VapnikVNpointedouttheproblemofexpe riencedriskminimization,andpresentedthenotionof minimizingstructurerisk.Upontheabovetheory,herecomesthesupportvectormachine(SVM)algo rithm[1].Itisespeciallyaimedatfinitesamples,and wecanfinallygettheoptimalsolutionsfortheexist ed informationbutnotforthesituationoftraditional statistictheory…

Multi-classification algorithm and its realization based on least square support vector machine algorithm

As a new type of learning machine developed on the basis of statistics learning theory, support vector machine (SVM) plays an important role in knowledge discovering and knowledge updating by constructing nonlinear optimal classifier. However, realizing SVM requires resolving quadratic programming under constraints of inequality, which results in calculation difficulty while learning samples gets larger. Besides, standard SVM is incapable of tackling multiclassification. To overcome the bottleneck of populating SVM, with training algorithm presented, the problem of quadratic programming is converted into that of resolving a linear system of equations composed of a group of equation constraints by adopting the least square SVM(LSSVM) and introducing a modifying variable which can change inequality constraints into equation constraints, which simplifies the calculation. With regard to multiclassification, an LSSVM applicable in multiclassification is deduced. Finally, efficiency of the algorithm is checked by using universal Circle in square and twospirals to measure the performance of the classifier.