工业设计中多重感官交互增强现实系统设计与应用

传统工业设计过程一般以物理样件为核心,反复试错设计循环在开发效率与成本方面没有达到令人满意的效果。为此,设计一种新的多重感官交互增强现实系统,将其应用于工业设计中。针对五指都伸展开来的手掌平面托取交互,通过优化的K向量法获取五个指尖部分,在指肚处对椭圆进行拟合;通过图论中的弗洛伊德法对指尖进行搜索,依据图像获取匹配点,完成手势的三维重建。将CSG模型和B-rep模型结合在一起,实现工业设计作品的三维场景建模。按照人机交互时人们对听觉的要求,将声源信号依次和左耳及右耳脉冲响应进行卷积处理;利用音频输出,令用户听到虚拟环境下的具有真实感及临场感的信号,和实际声音效果相似。实验结果表明,所设计系统交互性好,用户体验佳。

Design and application of multi sensory interaction augmented reality system in industrial design

In the traditional industrial design process, physical samples are usually the core. Repeated trial and error design cycles do not achieve satisfactory results in terms of development efficiency and cost. Therefore, a new multi sensory interaction augmented reality system is designed and applied to industrial design. In view of the palm plane holding of the five fingers stretching, five fingertips are obtained by the optimized K vector method, and the ellipse is fitted at the finger belly. The fingertips are searched through the Freud method in the graph theory, and the matching points are obtained according to the image to complete the 3D reconstruction of the gestures. The CSG model and B-rep model are combined to realize the 3D scene modeling of industrial design works. According to the requirement of human interaction, the sound source signal and the left ear and the right ear impulse response are convoluted. The audio output is used to make the users hear the real sense and the telepresence signal in the virtual environment, which is similar to the actual sound effect. Experimental results show that the designed system has good interactivity and user experience.