首页 | 本学科首页   官方微博 | 高级检索  
     检索      

基于知识蒸馏的轻量型浮游植物检测网络
引用本文:张彤彤,董军宇,赵浩然,李琼,孙鑫.基于知识蒸馏的轻量型浮游植物检测网络[J].应用科学学报,2020,38(3):367-376.
作者姓名:张彤彤  董军宇  赵浩然  李琼  孙鑫
作者单位:中国海洋大学 信息科学与工程学院, 山东 青岛 266000
基金项目:国家自然科学基金(No.41576011,No.U1706218)资助
摘    要:当前基于卷积神经网络的目标检测框架已成为主流,使用深层的特征提取网络可以达到很好的目标检测效果,但带来的大量的参数和计算开销使这些算法难以应用到对存储空间和参数量有一定限制的嵌入式设备中.为此,该文提出将知识蒸馏方法用于目标检测网络的特征提取网络,以提升浅层特征提取网络的性能,在降低模型的计算量和规模的同时尽可能地保证模型的性能.实验结果表明,经过蒸馏的浅层网络作为特征提取网络的检测精度比没有经过教师指导的网络精度提高了11.7%.与此同时,该文构建的浮游植物目标检测数据集不仅可以评估一些最先进的目标检测算法的性能,也有利于未来浮游植物显微视觉技术的发展.

关 键 词:知识蒸馏  特征提取网络  浮游植物  Faster  R-CNN  目标检测  
收稿时间:2019-10-23

Lightweight Phytoplankton Detection Network Based on Knowledge Distillation
ZHANG Tongtong,DONG Junyu,ZHAO Haoran,LI Qiong,SUN Xin.Lightweight Phytoplankton Detection Network Based on Knowledge Distillation[J].Journal of Applied Sciences,2020,38(3):367-376.
Authors:ZHANG Tongtong  DONG Junyu  ZHAO Haoran  LI Qiong  SUN Xin
Institution:College of Information Science and Engineering, Ocean University of China, Qingdao 266000, Shandong Province, China
Abstract:Object detection framework based on convolution neural network usually uses a very deep convolution neural network to extract object features before detection. However, its huge network structure leads to the reduction of detection speed, thus, the model can hardly achieve real-time object detection and be put into embedded devices. Address to the problem, this paper applies a knowledge distillation method to feature extraction network of object detection network to improve the performance of shallow feature extraction network. In this way, the model can ensure the same performance with a big reduction on computational load and model scale. Experimental results show that the detection accuracy of feature extraction networks employing distilled shallow network is 11.7% higher than that of networks without teacher’s guidance. Moreover, we build a phytoplankton dataset in this paper, which can not only be used for the evaluation of the performance of object detection algorithms, but also will be helpful to the development of phytoplankton microscopic vision technology.
Keywords:knowledge distillation  feature extraction network  phytoplankton  Faster RCNN  object detection  
本文献已被 CNKI 等数据库收录!
点击此处可从《应用科学学报》浏览原始摘要信息
点击此处可从《应用科学学报》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号