A Prompt-Optimized Vision-Language Model System for Fine-Grained Fashion Style Recognition

With the accelerated digital transformation of the fashion industry, accurate clothing style recognition has become essential for intelligent e-commerce retrieval, personalized outfit recommendation, and fashion trend analysis. Vision-language models (VLMs), with their cross-modal semantic alignment and zero-shot inference capabilities, offer an efficient technical pathway for this task. However, when applied to the fashion domain, general-purpose VLMs face several challenges, including vague prompt semantics, insufficient fine-grained discrimination, difficulty in capturing composite style characteristics, and high deployment costs. To address these issues, this paper presents a comprehensive clothing style recognition system based on Qwen3-VL-Plus. A four-level structured prompt template—comprising style definitions, visual feature guidance, and confidence distribution constraints—is introduced to direct the model's attention toward fine-grained attributes such as silhouette, fabric, color, and decoration. A confidence distribution modeling mechanism based on Softmax normalization is proposed to convert cross-modal similarity scores into interpretable confidence distributions, enabling quantitative representation of composite styles. Furthermore, INT8 quantization and inference pipeline optimization are employed to achieve lightweight deployment, allowing the system to operate stably in an ordinary CPU environment. On the FashionStyle14 dataset, the proposed system achieves a Top-1 accuracy of 69.21% and a macro-average F1 score of 66.38%, outperforming CLIP by 17.98 and 18.21 percentage points, respectively. INT8 quantization yields a 36.77% reduction in inference time and a 75.12% reduction in model size. In a user experience evaluation involving 30 participants, the system attains an overall satisfaction score of 8.60 out of 10, with 96.67% of users recognizing the interpretability of the recognition results. Experimental results demonstrate that the proposed approach offers significant advantages in recognition accuracy, interpretability, and deployment practicality, providing a complete solution with both technical feasibility and application value for intelligent clothing style recognition in the fashion industry.

Authors

Publication Details

Journal
Journal of Design Intelligence
Published
2026-11-05
DOI
https://doi.org/10.64509/jdi.14.118
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Prompt-Optimized Vision-Language Model System for Fine-Grained Fashion Style Recognition

Xiaoqun Dai, Rui Mai, Ting Chen, Xiao Li
Journal of Design Intelligence
Multimodal Machine Learning Applications
article

A Prompt-Optimized Vision-Language Model System for Fine-Grained Fashion Style Recognition

Xiaoqun Dai, Rui Mai, Ting Chen, Xiao Li
article en

Abstract

With the accelerated digital transformation of the fashion industry, accurate clothing style recognition has become essential for intelligent e-commerce retrieval, personalized outfit recommendation, and fashion trend analysis. Vision-language models (VLMs), with their cross-modal semantic alignment and zero-shot inference capabilities, offer an efficient technical pathway for this task. However, when applied to the fashion domain, general-purpose VLMs face several challenges, including vague prompt semantics, insufficient fine-grained discrimination, difficulty in capturing composite style characteristics, and high deployment costs. To address these issues, this paper presents a comprehensive clothing style recognition system based on Qwen3-VL-Plus. A four-level structured prompt template—comprising style definitions, visual feature guidance, and confidence distribution constraints—is introduced to direct the model's attention toward fine-grained attributes such as silhouette, fabric, color, and decoration. A confidence distribution modeling mechanism based on Softmax normalization is proposed to convert cross-modal similarity scores into interpretable confidence distributions, enabling quantitative representation of composite styles. Furthermore, INT8 quantization and inference pipeline optimization are employed to achieve lightweight deployment, allowing the system to operate stably in an ordinary CPU environment. On the FashionStyle14 dataset, the proposed system achieves a Top-1 accuracy of 69.21% and a macro-average F1 score of 66.38%, outperforming CLIP by 17.98 and 18.21 percentage points, respectively. INT8 quantization yields a 36.77% reduction in inference time and a 75.12% reduction in model size. In a user experience evaluation involving 30 participants, the system attains an overall satisfaction score of 8.60 out of 10, with 96.67% of users recognizing the interpretability of the recognition results. Experimental results demonstrate that the proposed approach offers significant advantages in recognition accuracy, interpretability, and deployment practicality, providing a complete solution with both technical feasibility and application value for intelligent clothing style recognition in the fashion industry.

Journal of Design IntelligenceVol. 1(4)
Openalex Percentile: Top 19%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon