Text-embeding and Visual-reference Less Object Counting

This study presents TET-Count, a novel category-agnostic model for object counting from natural language prompts, addressing limitations in existing methods requiring extensive annotated data. Leveraging pre-training of CLIP, TET-Count integrates feature projection and image regulation for enhanced semantic localization and counting accuracy. Experiments on the FSC-147 dataset using MAE and RMSE metrics show its superiority over other zero-shot techniques. Ablation studies confirm the importance of feature projection, and qualitative results demonstrate robust counting capabilities. TET-Count represents an advance in cross-modal object counting, combining NLP with deep learning for future research and applications.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icicml63543.2024.10958160
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Text-embeding and Visual-reference Less Object Counting

Guangyi Xiao, Jiaolong Wu, Yiwei Tan, Lei Hou et al.
Image Retrieval and Classification Techniques
article

Text-embeding and Visual-reference Less Object Counting

Guangyi Xiao, Jiaolong Wu, Yiwei Tan, Lei Hou, Yutong Zhang
article en

Abstract

This study presents TET-Count, a novel category-agnostic model for object counting from natural language prompts, addressing limitations in existing methods requiring extensive annotated data. Leveraging pre-training of CLIP, TET-Count integrates feature projection and image regulation for enhanced semantic localization and counting accuracy. Experiments on the FSC-147 dataset using MAE and RMSE metrics show its superiority over other zero-shot techniques. Ablation studies confirm the importance of feature projection, and qualitative results demonstrate robust counting capabilities. TET-Count represents an advance in cross-modal object counting, combining NLP with deep learning for future research and applications.

Hunan University (CN), Changzhou Academy of Intelli-Ag Equipment (China) (CN)
Central South University
Openalex Percentile: Top 71%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.