首页 | 本学科首页   官方微博 | 高级检索  
     检索      

基于显式运动建模的视频伪装目标检测
引用本文:肖涛,章超,傅可人.基于显式运动建模的视频伪装目标检测[J].上海理工大学学报,2024,46(2):120-128.
作者姓名:肖涛  章超  傅可人
作者单位:四川大学 计算机学院,成都 610065;四川警察学院,泸州 646000;智能警务四川省重点实验室,泸州 646000;四川大学 计算机学院,成都 610065;四川大学 视觉合成图形图像技术国家级重点实验室,成都 610064
基金项目:国家自然科学基金资助项目(62176169);智能警务四川省重点实验室资助项目(ZNJW2022KFMS001)
摘    要:目前的视频伪装目标检测方法通常采用隐式运动建模或直接输入存在噪声的离线光流图来获取运动线索,这会影响模型性能。为了解决这一问题,提出一种新的基于显式运动建模的视频伪装目标检测框架,称为SMHNet。首先,该框架将显式运动建模与伪装目标检测联合在同一个框架中进行学习。然后利用特征双向更新模块实现两个分支的双向交互更新,相互补充、优化和纠错,输出光流估计结果和目标检测图。此外,为了解决缺少光流真值图这一问题,采用自监督策略对显式运动建模分支进行监督。在两个数据集上的对比实验结果表明,SMHNet有效地提高了视频场景中伪装目标检测的性能。

关 键 词:视频伪装目标检测  显式运动建模  光流  自监督
收稿时间:2023/5/17 0:00:00

Explicit motion handling for video camouflaged object detection
XIAO Tao,ZHANG Chao,FU Keren.Explicit motion handling for video camouflaged object detection[J].Journal of University of Shanghai For Science and Technology,2024,46(2):120-128.
Authors:XIAO Tao  ZHANG Chao  FU Keren
Institution:School of Computer Science, Sichuan University, Chengdu 610065, China;Sichuan Police College, Luzhou 646000, China;Intelligent Policing Key Laboratory of Sichuan Province, Luzhou 646000, China; School of Computer Science, Sichuan University, Chengdu 610065, China;National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University , Chengdu 610064, China
Abstract:Earlier video camouflaged object detection methods often exploit motion cues by implicit motion modeling or directly inputting offline optical flow maps with noise, which affects model performance. To address the effective utilization of motion cues, an explicit motion modeling framework for video camouflaged object detection, called SMHNet, was proposed. First, an explicit motion modeling branch and a camouflaged object detection branch were jointly learned in the same framework. Then, the two branches were updated bidirectionally using a bidirectional feature updating module. The two branches performed mutual optimization and error correction to output optical flow estimation results and object detection maps. In addition, to address the lack of ground truth optical flow, a self-supervised strategy was adopted to supervise the explicit motion modeling branch. Comparison experiments on two benchmark datasets show that SMHNet effectively improves the performance of video camouflaged object detection.
Keywords:Video camouflaged object detection  explicit motion handling  optical flow  self-supervision
点击此处可从《上海理工大学学报》浏览原始摘要信息
点击此处可从《上海理工大学学报》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号