| 注意力叠加与时序特征融合的目标检测方法 |
| |
| 引用本文： | 吴雨泽,聂卓赟,周长新. 注意力叠加与时序特征融合的目标检测方法[J]. 华侨大学学报(自然科学版), 2022, 0(5): 650-657. DOI: 10.11830/ISSN.1000-5013.202103034 |
| |
| 作者姓名： | 吴雨泽 聂卓赟 周长新 |
| |
| 作者单位： | 华侨大学 信息科学与工程学院, 福建 厦门 361021 |
| |
| 基金项目： | 国家自然科学基金资助项目（61403149）；;福建省自然科学基金资助项目（2019J01053）； |
| |
| 摘 要： | 提出一种基于注意力叠加与时序特征融合的目标检测方法.在端到端目标检测(DETR)网络的基础上，依据注意力机制特性，使用注意力权重叠加的方式提取目标物像素级标识，用于实例轨迹的划分.为使目标检测与轨迹跟踪协同作用，通过时序特征融合的方式融合之前轨迹跟踪信息，调整当前帧目标检测效果，从而充分利用视频载体提供的时间维度信息.在公开数据集上，对文中方法进行验证，结果表明：文中方法能有效识别被遮挡的目标物，具有较强鲁棒性.
|
| 关 键 词： | 目标检测网络 注意力机制 轨迹跟踪 时序特征 |
Object Detection Method of Attention Superposition and Temporal Feature Fusion |
| |
| WU Yuze,NIE Zhuoyun,ZHOU Changxin. Object Detection Method of Attention Superposition and Temporal Feature Fusion[J]. Journal of Huaqiao University(Natural Science), 2022, 0(5): 650-657. DOI: 10.11830/ISSN.1000-5013.202103034 |
| |
| Authors: | WU Yuze NIE Zhuoyun ZHOU Changxin |
| |
| Affiliation: | College of Information Science and Engineering, Huaqiao University, Xiamen 361021, China |
| |
| Abstract: | An object detection method of attention superposition and temporal feature fusion is proposed. Based on the end-to-end object detection(DETR)network, attention weight superposition is used to extract the object pixel-level identification for the division of the instance trajectory according to the characteristics of the attention mechanism. In order to cooperate the object detection and trajectory tracking, the previous track tracking information is fused by the temporal feature fusion to adjust the effect of current frame object detection, so as to make full use of the temporal dimension information provided by the video carrier. The proposed method is experimentally tested on the public data set. The results show that the method in this paper can effectively detect the blocked object and has stronger robustness. |
| |
| Keywords: | object detection network attention mechanism trajectory tracking temporal feature |
|
| 点击此处可从《华侨大学学报(自然科学版)》浏览原始摘要信息 |
|
点击此处可从《华侨大学学报(自然科学版)》下载全文 |
