一种免注册标识的增强现实方法

针对传统增强现实(augmented reality, AR)技术中标识信息和虚拟信息需要提前置入、虚拟模型的显示受标识信息限制的问题,提出一种免注册标识的增强现实方法。以C/S(客户端-服务端)架构为载体,采用用户数据报协议(user datagram protocol, UDP)传输信息,首先以HoloLens为客户端采集目标信息,随后服务端通过迁移学习训练的卷积神经网络来识别目标信息,最后客户端依据识别结果从服务器中动态加载虚拟模型。通过实验证明,该方法在开发过程中无需注册标识信息,对目标信息的识别准确率高,虚拟模型的显示免于对标识的跟踪,从而提高了AR的实用性,也可以更好地适应新场景需求。

An augmented reality method for registration-free mark

In the traditional AR (Augmented Reality) technology, the identification information and virtual information need to be placed in advance, and the display of the virtual model is limited by the identification information. An augmented reality method for registration-free mark is proposed. The method uses C/S (client-server) architecture as the carrier and uses UDP protocol to transmit information. Firstly, HoloLens is used as the client to collect the target information. Then the server identifies the target information through the convolutional neural network trained by transfer learning. Finally, the client dynamically loads the virtual model from the server based on the recognition result. The experiment proves that the method does not need to register the identification information during the development process, and the recognition of the target information has high accuracy. The display of the virtual model is free from tracking the target, consequently,the practicality of the AR is improved and adapted the new scene requirements well.