LLM-TTA: Leveraging Large Language Models for Test-Time Adaptation in Image Quality Assessment

Recent test-time adaptation (TTA) methods for image quality assessment (IQA) aim to mitigate the distribution shift between training and testing data by adapting the batch normalization layers of the base IQA model. These methods typically leverage auxiliary tasks—such as group contrastive loss and rank loss—based on feature clustering of low- and high-quality images. However, existing approaches using base models or pre-trained VGG-16 networks struggle to generate meaningful quality-based clusters, limiting their effectiveness. In this work, we introduce LLM-TTA, a novel TTA framework that exploits the perceptual ranking capabilities of pre-trained multi-modal Large Language Models (LLMs). The LLM-TTA algorithm is founded on the observation that, although pre-trained LLMs exhibit limited capability in predicting accurate absolute quality scores, they are highly effective in estimating relative quality rankings and generating more discriminative clusters—both of which are essential for the efficient computation of group contrastive loss. This simple yet impactful insight enables LLM-TTA to substantially improve the adaptability and performance of base IQA models. We validate our method on leading architectures (TReS, MUSIQ, MetaIQA, UIQA) across diverse natural (Koniq-10K, LIVE, PIPAL) and AI-generated (AGIQA-3K, PKU-AGIQA-4K, AIGCIQA2023) image quality assessment datasets. Experimental results demonstrate that LLM-TTA outperforms both existing TTA strategies and standalone LLMs, establishing a new state of the art in test-time IQA adaptation.

Authors

Institutions

Publication Details

Published
2025-10-20
DOI
https://doi.org/10.1145/3746278.3759394
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLM-TTA: Leveraging Large Language Models for Test-Time Adaptation in Image Quality Assessment

Vinit Jakhetiya, Badri Narayan Subudhi, Sunil Jaiswal, Weisi Lin et al.
Image and Video Quality Assessment
article

LLM-TTA: Leveraging Large Language Models for Test-Time Adaptation in Image Quality Assessment

Vinit Jakhetiya, Badri Narayan Subudhi, Sunil Jaiswal, Weisi Lin, Rahul Kumar, Afsheen Bashir
article en

Abstract

Recent test-time adaptation (TTA) methods for image quality assessment (IQA) aim to mitigate the distribution shift between training and testing data by adapting the batch normalization layers of the base IQA model. These methods typically leverage auxiliary tasks—such as group contrastive loss and rank loss—based on feature clustering of low- and high-quality images. However, existing approaches using base models or pre-trained VGG-16 networks struggle to generate meaningful quality-based clusters, limiting their effectiveness. In this work, we introduce LLM-TTA, a novel TTA framework that exploits the perceptual ranking capabilities of pre-trained multi-modal Large Language Models (LLMs). The LLM-TTA algorithm is founded on the observation that, although pre-trained LLMs exhibit limited capability in predicting accurate absolute quality scores, they are highly effective in estimating relative quality rankings and generating more discriminative clusters—both of which are essential for the efficient computation of group contrastive loss. This simple yet impactful insight enables LLM-TTA to substantially improve the adaptability and performance of base IQA models. We validate our method on leading architectures (TReS, MUSIQ, MetaIQA, UIQA) across diverse natural (Koniq-10K, LIVE, PIPAL) and AI-generated (AGIQA-3K, PKU-AGIQA-4K, AIGCIQA2023) image quality assessment datasets. Experimental results demonstrate that LLM-TTA outperforms both existing TTA strategies and standalone LLMs, establishing a new state of the art in test-time IQA adaptation.

Nanyang Technological University (SG), Indian Institute of Technology Jammu (IN), Saarbrücken Stadtwerke (Germany) (DE)
Openalex Percentile: Top 71%
Image and Video Quality Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.