Clothing recognition system using MLLM and its utility

Clothing is one of the attributes of information that expresses a person's tastes and preferences. Therefore, automatically identifying and categorizing clothing can have significant marketing applications. In this paper, we developed a communication system based on clothing recognition as an example of multimodal communication with humans using MLLM (Multimodal Large Language Model). We examined the communication part such as recognizing the customer's attire and calling out to them, saying what they think of the outfit, and complimenting them. We planned the flow and content of the exchange. In addition, the system development and its effectiveness were verified. Experiments were conducted at stores, and results such as customers becoming interested in the system and the number of smiles increased after using the system were obtained. From these, the usefulness of the system was shown.