虚拟装配环境中的人机交互技术研究

为了解决虚拟装配系统中的人机交互问题,结合虚拟装配环境,给出了数据手套和三维跟踪器的驱动类,阐述了数据手套和三维跟踪器的原始数据获取方法和处理策略.提出了综合使用数据手套和三维跟踪器数据进行手势识别与命令映射的方法;采用非模态的动态透明菜单和对话框作为数据手套和跟踪器的补充方式进行人机交互;讨论了通过虚拟手操作零部件模型的虚拟装配过程.通过开发基于三通道投影的虚拟装配环境,对数据手套、三维跟踪器以及头盔显示器等应用进行了实例验证,验证结果表明上述方法有效可行.

Human-Computer Interaction in Virtual Assembly Environment

In order to solve the problem of human-computer interaction in virtual assembly systems,driver classes for data glove and 3D tracker are formed,integrated with virtual assembly environment.Methods of assessing and strategies of processing raw data are given.The method of gesture recognition that is synthetically using data collected by the data gloves and 3D trackers are proposed.Modeless dynamic transparent menu and dialog are used to aid human-computer interaction.The virtual assembly process which is realized through operating virtual assembly and part model by virtual hand is discussed.Verification for application of human-computer interaction is committed by developing a 3 channels projection-based virtual assembly environment.The application results manifest that the approach mentioned above is feasible and efficient.