Resource-efficient blocking: Optimizing the trade-off between effectiveness and scalability in entity resolution

Deep Learning has revolutionized Entity Resolution (ER) by enabling high-accuracy matching through dense vector embeddings. However, this paradigm shift transforms the traditional blocking step into a high-dimensional similarity search problem, introducing a massive computational bottleneck that threatens scalability. While modern ER frameworks increasingly rely on blocking, the so-called indexing, to generate candidate pairs, the architectural design of this retrieval stage is often treated as a black box, with little attention paid to the resource implications of high-dimensional models. This paper conducts a rigorous design space exploration of blocking architectures, evaluating nine candidate generation strategies across graph-based, partition-based, and hash-based families. A primary contribution is a systematic analysis of Vector Quantization —specifically Product Quantization and Scalar Quantization—demonstrating that quantization is not merely a memory optimization, but a critical requirement for deploying state-of-the-art embeddings at scale. We evaluate these architectures on seven real-world datasets, measuring the interplay between embedding granularity, recall, and computational cost. Our results reveal that while graph-based methods offer peak precision, quantized partitioning methods reduce memory footprints by up to 96% with negligible loss in recall, effectively democratizing high-performance ER on commodity hardware. The study culminates in a decision framework for designing scalable, resource-aware blocking pipelines.

Authors

Institutions

Publication Details

Journal
Information Systems
Published
2026-07-27
DOI
https://doi.org/10.1016/j.is.2026.102785
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Resource-efficient blocking: Optimizing the trade-off between effectiveness and scalability in entity resolution

Dimitrios Karapiperis, Christos Tjortjis, Vassilios S. Verykios
Information Systems
Data Quality and Management
article

Resource-efficient blocking: Optimizing the trade-off between effectiveness and scalability in entity resolution

Dimitrios Karapiperis, Christos Tjortjis, Vassilios S. Verykios
article en

Abstract

Deep Learning has revolutionized Entity Resolution (ER) by enabling high-accuracy matching through dense vector embeddings. However, this paradigm shift transforms the traditional blocking step into a high-dimensional similarity search problem, introducing a massive computational bottleneck that threatens scalability. While modern ER frameworks increasingly rely on blocking, the so-called indexing, to generate candidate pairs, the architectural design of this retrieval stage is often treated as a black box, with little attention paid to the resource implications of high-dimensional models. This paper conducts a rigorous design space exploration of blocking architectures, evaluating nine candidate generation strategies across graph-based, partition-based, and hash-based families. A primary contribution is a systematic analysis of Vector Quantization —specifically Product Quantization and Scalar Quantization—demonstrating that quantization is not merely a memory optimization, but a critical requirement for deploying state-of-the-art embeddings at scale. We evaluate these architectures on seven real-world datasets, measuring the interplay between embedding granularity, recall, and computational cost. Our results reveal that while graph-based methods offer peak precision, quantized partitioning methods reduce memory footprints by up to 96% with negligible loss in recall, effectively democratizing high-performance ER on commodity hardware. The study culminates in a decision framework for designing scalable, resource-aware blocking pipelines.

Information SystemsVol. 142
International Hellenic University (GR), Hellenic Open University (GR)
Decent work and economic growth
Openalex Percentile: Top 5%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.