Research on mixed reality multimodal interaction for information screening tasks

The information filtering task is an important human-computer interaction task in the air defense and anti missile command and control system, which has the characteristics of wide content range and multiple adaptation scenarios. Currently, it is mainly completed by humans operating the relevant areas of the display and control panel interface through mouse, keyboard, and other operations. When the information load is large and the number of task scenarios increases, the input operation efficiency is low. Therefore, it is necessary to study command and control interaction methods suitable for mixed reality environments. The existing methods for operation in Hololen2 mainly include gesture action, eye movement, and speech, with different effects. How to reasonably combine and improve the efficiency of information filtering and input interaction in MR environment is an urgent problem that needs to be solved. This article mainly analyzes the human-machine interaction characteristics of MR devices and designs a simulation information filtering operation interface experiment in the MR environment to explore the completion effect of tasks under different interaction matching schemes, in order to judge the advantages and disadvantages of the schemes.