Weaving Context Across Images: Improving Vision-Language Models through Focus-Centric Visual Chains
Vision-language models (VLMs) achieve remarkable success in single-image tasks.However, real-world scenarios often involve intricate multi-image inputs, leading to a notable performance decline as models struggle to disentangle critical information scattered across complex visual features.In this work, we propose Focus-Centric Visual Chain, a novel paradigm that enhances VLMs' perception, comprehension, and reasoning abilities in multi-image scenarios.To facilitate this paradigm, we propose Focus-Centric Data Synthesis, a scalable bottom-up approach for synthesizing high-quality data with elaborate reasoning paths.Through this approach, We construct VISC-150K, a large-scale dataset with reasoning data in the form of Focus-Centric Visual Chain, specifically designed for multi-image tasks.Experimental results on seven multi-image benchmarks demonstrate that our method achieves average performance gains of 3.16% and 2.24% across two distinct model architectures, without compromising the general vision-language capabilities.Our study represents a significant step toward more robust and capable vision-language systems that can handle complex visual scenarios: VISC.
Authors
- Rui Yan (ORCID: https://orcid.org/0000-0003-0048-3092)
- Chuanqi Cheng (ORCID: https://orcid.org/0000-0002-3366-8395)
- Juntian Zhang (ORCID: https://orcid.org/0000-0003-3793-714X)
- Yuhan Liu (ORCID: https://orcid.org/0000-0003-2912-750X)
- Jing Luan (ORCID: https://orcid.org/0000-0003-2234-2426)
- Wei Liu
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.1347
- Citations
- 1
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 1.28
Funders
- Yuhan
- Renmin University of China