ReviewHQ: An API-Based System for Reviewer Assignment and Quality Control in Research Conferences

Managing the review process for large-scale academic conferences poses significant challenges in effectively matching papers to the right reviewers, detecting conflicts of interest, ensuring review quality, and addressing potential ethical issues such as dual submissions. In this demonstration paper, we introduce ReviewHQ, an API-based system designed to streamline conference management. For matching reviewers to publications, ReviewHQ constructs expertise profiles for potential reviewers by mining their publication records and representing both papers and reviewers as dense vectors. It then formulates paper assignment as a constrained optimization problem, leveraging dense vector similarity scores and other reviewer's and submission's features to produce high-quality assignments. Beyond its core functionality, ReviewHQ identifies conflicts of interest by analyzing co-authorship histories and flags suspected dual submissions by comparing manuscripts against submission information from other conferences. Further, the system employs methods to detect low-quality or automated (AI-generated) reviews and pinpoint discrepancies between reviewers' recommendations and final acceptance decisions. ReviewHQ has been used since 2024 across the SIGIR and SIGIR-AP conferences.

Authors

Institutions

Publication Details

Published
2025-07-13
DOI
https://doi.org/10.1145/3726302.3730139
Primary Topic
Expert finding and Q&A systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ReviewHQ: An API-Based System for Reviewer Assignment and Quality Control in Research Conferences

Guido Zuccon
Expert finding and Q&A systems
article

ReviewHQ: An API-Based System for Reviewer Assignment and Quality Control in Research Conferences

Guido Zuccon
article en

Abstract

Managing the review process for large-scale academic conferences poses significant challenges in effectively matching papers to the right reviewers, detecting conflicts of interest, ensuring review quality, and addressing potential ethical issues such as dual submissions. In this demonstration paper, we introduce ReviewHQ, an API-based system designed to streamline conference management. For matching reviewers to publications, ReviewHQ constructs expertise profiles for potential reviewers by mining their publication records and representing both papers and reviewers as dense vectors. It then formulates paper assignment as a constrained optimization problem, leveraging dense vector similarity scores and other reviewer's and submission's features to produce high-quality assignments. Beyond its core functionality, ReviewHQ identifies conflicts of interest by analyzing co-authorship histories and flags suspected dual submissions by comparing manuscripts against submission information from other conferences. Further, the system employs methods to detect low-quality or automated (AI-generated) reviews and pinpoint discrepancies between reviewers' recommendations and final acceptance decisions. ReviewHQ has been used since 2024 across the SIGIR and SIGIR-AP conferences.

The University of Queensland (AU)
Openalex Percentile: Top 75%
Expert finding and Q&A systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

ReviewHQ: An API-Based System for Reviewer Assignment and Quality Control in Research Conferences — Guido Zuccon · (2025) | TGRS Research Map | TGRS