An Alternative to Crawlers: Scalable P2P Network Monitoring Using the Network Scale-Up Method

Peer-to-peer (P2P) networks have remained an active area of research and development for decades. Originally used for data dissemination, they have later become instrumental to decentralized payment systems, blockchains, and Web3 applications following the introduction of Bitcoin by Satoshi Nakamoto in 2008. Since decentralization is a crucial property of these networks, they are continuously monitored to track attributes such as the geographical distribution of nodes, which serve as indicators of infrastructure concentration and resilience. However, monitoring typically relies on full-network crawls to derive complete, accurate snapshots, which requires substantial computational and network resources. In contrast, the Network Scale-up Method (NSUM) is a statistical tool in social network analysis that estimates the prevalence of subpopulations based on responses to questions such as "How many people do you know in a specific group?" This work leverages the information embedded in Kademlia routing tables to develop a lightweight NSUM-based measurement and estimation framework that infers global network attribute distributions from a small set of nodes, offering an alternative to full-network crawls. As a case study, we evaluate our approach on the InterPlanetary File System (IPFS), a well-researched and widely used Web3 data storage and retrieval network. To the best of our knowledge, this is the first application of NSUM to decentralized network measurement. We evaluate our methodology on two datasets: the first comprises 360 full-network crawls collected over one month to assess our measurement-estimation approach across multiple simulated measurement scenarios, while the second dataset was collected through a deployment of the proposed lightweight measurement framework during May 2026. The results show that local Kademlia routing views, with only 10 nodes, preserve sufficient information to accurately estimate global attribute distributions, achieving normalized biases below 10%, and closely track temporal changes in network composition.

Authors

Institutions

Publication Details

Journal
Proceedings of the ACM on Networking
Published
2026-11-19
DOI
https://doi.org/10.1145/3856956
Primary Topic
Peer-to-Peer Network Technologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

An Alternative to Crawlers: Scalable P2P Network Monitoring Using the Network Scale-Up Method

Sergio Díaz-Aranda, Leonhard Balduf, Juan Marcos Ramírez, Antonio Fernández-Anta
1 links
Proceedings of the ACM on Networking
Peer-to-Peer Network Technologies
article

An Alternative to Crawlers: Scalable P2P Network Monitoring Using the Network Scale-Up Method

Sergio Díaz-Aranda, Leonhard Balduf, Juan Marcos Ramírez, Antonio Fernández-Anta
article en

Abstract

Peer-to-peer (P2P) networks have remained an active area of research and development for decades. Originally used for data dissemination, they have later become instrumental to decentralized payment systems, blockchains, and Web3 applications following the introduction of Bitcoin by Satoshi Nakamoto in 2008. Since decentralization is a crucial property of these networks, they are continuously monitored to track attributes such as the geographical distribution of nodes, which serve as indicators of infrastructure concentration and resilience. However, monitoring typically relies on full-network crawls to derive complete, accurate snapshots, which requires substantial computational and network resources. In contrast, the Network Scale-up Method (NSUM) is a statistical tool in social network analysis that estimates the prevalence of subpopulations based on responses to questions such as "How many people do you know in a specific group?" This work leverages the information embedded in Kademlia routing tables to develop a lightweight NSUM-based measurement and estimation framework that infers global network attribute distributions from a small set of nodes, offering an alternative to full-network crawls. As a case study, we evaluate our approach on the InterPlanetary File System (IPFS), a well-researched and widely used Web3 data storage and retrieval network. To the best of our knowledge, this is the first application of NSUM to decentralized network measurement. We evaluate our methodology on two datasets: the first comprises 360 full-network crawls collected over one month to assess our measurement-estimation approach across multiple simulated measurement scenarios, while the second dataset was collected through a deployment of the proposed lightweight measurement framework during May 2026. The results show that local Kademlia routing views, with only 10 nodes, preserve sufficient information to accurately estimate global attribute distributions, achieving normalized biases below 10%, and closely track temporal changes in network composition.

Proceedings of the ACM on NetworkingVol. 4(CoNEXT4)
IMDEA Networks (ES), Technische Universität Darmstadt (DE), IMDEA Software Institute (ES)
Comunidad de Madrid, European Regional Development Fund, Agencia Estatal de Investigación
Peer-to-Peer Network Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon