融合多元触觉和沉浸式视觉的可移植VR软件框架

多元触觉和沉浸式视觉反馈的时空一致性配准以及现有VR软件框架中硬件设备的接入便捷性问题,制约了医疗、商务、娱乐等不同行业中视触觉融合场景的快速开发。为解决这一难题,提出融合多元触觉和沉浸式视觉的可移植VR软件框架,根据视触觉反馈精度要求的不同设计了双层和三层架构兼顾视觉渲染、触觉渲染、硬件控制的不同需求。实验结果表明该框架具有支持视-触融合同步反馈、硬件平台可移植、图形场景开发简便和交互场景可快速替换等特点,能够满足不同领域的交互应用需求。

An Adaptable VR Software Framework for Collaborative Multi-modal Haptic and Immersive Visual Display

The spatiotemporal consistency of multi-modal haptic and immersive visual feedback, as well as the integration of hardware devices in the existing VR software framework, restricts the rapid development of visuo-haptic fusion scenarios in different industries such as medical, business, and entertainment. In order to tackle this problem, an adaptable VR software framework combining multi-modal haptic and immersive visual display is proposed. To meet the different requirements of visual rendering, haptic rendering and hardware control, the double-layer and three-layer architectures are devised according to the different precision requirements of visuo-haptic fusion feedback. Experimental results show that the framework has the characteristics of supporting the synchronous feedback of visuo-haptic fusion, the convenient integration of diverse haptic devices, the simplicity of scene development and the rapid replacement of interactive scene, and it can meet the requirements of different application fields.