Most of environmental sounds are not harmonious. Compared with speech and music sounds, environmental sounds are less stable. For the deficiencies of traditional time-frequency analysis, a method is proposed to extract environmental sound features based on auditory perception. In view of the problem of small sample, SVM is used as the classification algorithm to classify the environmental sounds. The simulation results show that the features and the method are effective.