Building an Interactive Virtual Human in the Head-up Display

In this paper, we present a next-generation interaction interface combined with a virtual human using a head-up display. First, we suggest the virtual human with multimodal interaction methods, and provide an approach to designing an intuitive interface for users. Also, we present usability evaluation methods that can utilize the interface projected on the head-up display. According to the method proposed in our paper, multimodal interaction with the virtual human can be applied to infotainment systems in vehicles, and it is expected that the interface can provide driver convenience and entertainment for self-driving cars. Furthermore, we believe that basic researches for designing virtual humans will progress more actively.