In the LLM era, Word Sense Induction remains unsolved

In the absence of sense-annotated data, word sense induction (WSI) is a compelling alternative to word sense disambiguation, particularly in low-resource or domain-specific settings.In this paper, we emphasize methodological problems in current WSI evaluation.We propose an evaluation on a SemCor-derived dataset, respecting the original corpus polysemy and frequency distributions.We assess pre-trained embeddings and clustering algorithms across parts of speech, and propose and evaluate an LLMbased WSI method for English.We evaluate data augmentation sources (LLM-generated, corpus and lexicon), and semi-supervised scenarios using Wiktionary for data augmentation, must-link constraints, number of clusters per lemma.We find that no unsupervised method (whether ours or previous) surpasses the strong "one cluster per lemma" heuristic (1cpl).We also show that (i) results and best systems may vary across POS, (ii) LLMs have troubles performing this task, (iii) data augmentation is beneficial and (iv) capitalizing on Wiktionary does help.It surpasses previous SOTA system on our test set by 3.3%.WSI is not solved, and calls for a better articulation of lexicons and LLMs' lexical semantics capabilities.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.882
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

In the LLM era, Word Sense Induction remains unsolved

Carlos Ramisch, Marie Candito, Anna Mosolova
Natural Language Processing Techniques
article

In the LLM era, Word Sense Induction remains unsolved

Carlos Ramisch, Marie Candito, Anna Mosolova
article en

Abstract

In the absence of sense-annotated data, word sense induction (WSI) is a compelling alternative to word sense disambiguation, particularly in low-resource or domain-specific settings.In this paper, we emphasize methodological problems in current WSI evaluation.We propose an evaluation on a SemCor-derived dataset, respecting the original corpus polysemy and frequency distributions.We assess pre-trained embeddings and clustering algorithms across parts of speech, and propose and evaluate an LLMbased WSI method for English.We evaluate data augmentation sources (LLM-generated, corpus and lexicon), and semi-supervised scenarios using Wiktionary for data augmentation, must-link constraints, number of clusters per lemma.We find that no unsupervised method (whether ours or previous) surpasses the strong "one cluster per lemma" heuristic (1cpl).We also show that (i) results and best systems may vary across POS, (ii) LLMs have troubles performing this task, (iii) data augmentation is beneficial and (iv) capitalizing on Wiktionary does help.It surpasses previous SOTA system on our test set by 3.3%.WSI is not solved, and calls for a better articulation of lexicons and LLMs' lexical semantics capabilities.

Agence Nationale de la Recherche
Gender equality
Openalex Percentile: Top 90%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

In the LLM era, Word Sense Induction remains unsolved — Carlos Ramisch, Marie Candito, et al. · (2025) | TGRS Research Map | TGRS