A Prompt-Optimized Vision-Language Model System for Fine-Grained Fashion Style Recognition
With the accelerated digital transformation of the fashion industry, accurate clothing style recognition has become essential for intelligent e-commerce retrieval, personalized outfit recommendation, and fashion trend analysis. Vision-language models (VLMs), with their cross-modal semantic alignment and zero-shot inference capabilities, offer an efficient technical pathway for this task. However, when applied to the fashion domain, general-purpose VLMs face several challenges, including vague prompt semantics, insufficient fine-grained discrimination, difficulty in capturing composite style characteristics, and high deployment costs. To address these issues, this paper presents a comprehensive clothing style recognition system based on Qwen3-VL-Plus. A four-level structured prompt template—comprising style definitions, visual feature guidance, and confidence distribution constraints—is introduced to direct the model's attention toward fine-grained attributes such as silhouette, fabric, color, and decoration. A confidence distribution modeling mechanism based on Softmax normalization is proposed to convert cross-modal similarity scores into interpretable confidence distributions, enabling quantitative representation of composite styles. Furthermore, INT8 quantization and inference pipeline optimization are employed to achieve lightweight deployment, allowing the system to operate stably in an ordinary CPU environment. On the FashionStyle14 dataset, the proposed system achieves a Top-1 accuracy of 69.21% and a macro-average F1 score of 66.38%, outperforming CLIP by 17.98 and 18.21 percentage points, respectively. INT8 quantization yields a 36.77% reduction in inference time and a 75.12% reduction in model size. In a user experience evaluation involving 30 participants, the system attains an overall satisfaction score of 8.60 out of 10, with 96.67% of users recognizing the interpretability of the recognition results. Experimental results demonstrate that the proposed approach offers significant advantages in recognition accuracy, interpretability, and deployment practicality, providing a complete solution with both technical feasibility and application value for intelligent clothing style recognition in the fashion industry.
Authors
- Xiaoqun Dai (ORCID: https://orcid.org/0000-0002-9805-2428)
- Rui Mai
- Ting Chen
- Xiao Li
Publication Details
- Journal
- Journal of Design Intelligence
- Published
- 2026-11-05
- DOI
- https://doi.org/10.64509/jdi.14.118
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00