Multilingual Evaluation of Main Content Extractors for Web Pages
Tools designed to extract main content from web pages require thorough evaluation, yet existing benchmarks disproportionately focus on English-language datasets. Consequently, previous studies have shown that while these extractors are well-optimized for English, their effectiveness partially or entirely diminishes in other languages. This study reproduces and extends recent benchmarks by incorporating multilingual datasets as a key factor. We analyze extractor performance across five languages-Greek, English, Polish, Russian, and Chinese-highlighting the need to adapt extraction models to linguistic variations. Our results show that while some extractors maintain stable performance, others suffer significant drops in precision and recall on non-English or structurally irregular pages.
Authors
- François Rioult (ORCID: https://orcid.org/0000-0001-8162-0997)
- Emmanuel Marchand
- Thomas Largillier
- Gaël Dias (ORCID: https://orcid.org/0000-0002-5840-1603)
- Fabrice Maurel (ORCID: https://orcid.org/0000-0002-8644-2461)
- Guillaume Pitel (ORCID: https://orcid.org/0000-0001-6172-4342)
- Aurélien Bournonville
Institutions
- ParisTech (FR)
- Université de Caen Normandie (FR)
Publication Details
- Published
- 2025-07-13
- DOI
- https://doi.org/10.1145/3726302.3730234
- Primary Topic
- Web Data Mining and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00