Metoda za detekcijo objektov s tekstovnim poizvedovanjem

The increasing diversity and scale of object detection datasets have highlighted the limitations of closed-set detectors with fixed vocabularies. Open-set object detection addresses this by enabling the detection of arbitrary classes via text prompts. Grounding DINO is a prominent zero-shot detector, but its training code is not fully open-source, and its implementation is outdated. In this work, we reimplement Grounding DINO, achieving ~20% speedup, and extend it for text-based object counting, though these modifications do not consistently improve FSCD-147 performance. To enable training from scratch, we optimize the model further, achieving an additional ~30% speedup, and develop an edge-oriented variant inspired by a closed-source model. Training on 1.3 million images from scratch, we evaluate the model on COCO and LVIS datasets, where it performs comparably to other open-source models, but remains below the closed-source baseline, likely due to a much smaller training set.

Publication Details

Journal
Repository of the University of Ljubljana (University of Ljubljana)
Published
2025-10-14
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Metoda za detekcijo objektov s tekstovnim poizvedovanjem

Repository of the University of Ljubljana (University of Ljubljana)
Advanced Neural Network Applications
article

Metoda za detekcijo objektov s tekstovnim poizvedovanjem

article en

Abstract

The increasing diversity and scale of object detection datasets have highlighted the limitations of closed-set detectors with fixed vocabularies. Open-set object detection addresses this by enabling the detection of arbitrary classes via text prompts. Grounding DINO is a prominent zero-shot detector, but its training code is not fully open-source, and its implementation is outdated. In this work, we reimplement Grounding DINO, achieving ~20% speedup, and extend it for text-based object counting, though these modifications do not consistently improve FSCD-147 performance. To enable training from scratch, we optimize the model further, achieving an additional ~30% speedup, and develop an edge-oriented variant inspired by a closed-source model. Training on 1.3 million images from scratch, we evaluate the model on COCO and LVIS datasets, where it performs comparably to other open-source models, but remains below the closed-source baseline, likely due to a much smaller training set.

Repository of the University of Ljubljana (University of Ljubljana)
Quality Education
Openalex Percentile: Top 39%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.