基于时空域数据融合的Kinect深度图像修复算法

针对Kinect传感器获取的深度图像中存在大量噪声以及深度信息缺失导致的空洞问题,提出一种基于时空域数据融合的深度图像修复算法。首先,对配准后的深度图像利用卡尔曼滤波使跳变深度值趋于平稳,并采用阈值分割法得到待修复区域;其次,计算待修复边界所有像素点的时空域置信度,对时空域置信度最大的像素点计算其时域和空域深度数据,并根据时空域置信度为时空数据分配权值进行数据融合,实现像素点的修复;最后,待修复边界改变,迭代执行上一步直至图像修复完成。实验结果表明:与传统修复算法相比,基于时空域数据融合的Kinect深度图像修复算法的深度图峰值信噪比更高、均方根误差更小,图像质量更好。

Kinect Depth Image Restoration Algorithm Based on Space-Time Domain Data Fusion

Aiming at a great number of problems which caused by a large number of noises in the depth image acquired by Kinect sensor and the lack of depth information. A depth image restoration algorithm which is based on spatio-temporal data fusion is proposed in this paper. Firstly, to deal with the depth image of registration through the Kalman filter to stabilize the hop depth value, and to obtain the region to be repaired by the threshold segmentation method. Secondly, the space-time domain reliability of all pixels in the boundary to be repaired is calculated. The time domain and spatial depth date of the pixel with the highest reliability is calculated, and the data fusion which is accomplishing in accordance with the space-time domain reliability for the spatio-temporal data distribution weight, to achieve the pixel point repair. Finally, after the boundary to be repaired changing, with an interation method to perform the previous step until the image restoration is successful. The experimental results show that compared with the traditional repair algorithm, the depth image restoration algorithm makes a peak signal-to-noise ratio more accurate, root means square error less and image quality better.