GC-PCWR+ for Word Sense Disambiguation

Word sense disambiguation (WSD) is a significant task in the field of natural language processing, focused on determining a word’s specific meaning within a given context. The gloss-context prompt-based contextual word representation (GC-PCWR) method, first proposed, successfully applied prompt learning to the task of word sense disambiguation, yielding promising results. However, it exhibited insufficient adaptability and generalization capabilities. For this purpose, we propose the GC-PCWR+ method that improves GC-PCWR by designing more appropriate prompt templates and better embedding the method. To leverage the capability of pre-trained models for semantic information during the training phase, the GC-PCWR+ method embeds prompt templates into the context encoding. This integration of prompt information with the context of the target word provides more comprehensive semantic insights. We established a more pragmatic dataset based on Collins and additionally performed a series of experiments on template statement complexity and information complexity. Furthermore, our method outperforms baseline models across datasets with diverse annotation systems, validating the impact of varied templates on overall performance.

Authors

Institutions

Publication Details

Published
2024-08-04
DOI
https://doi.org/10.1109/ialp63756.2024.10661141
Citations
1
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GC-PCWR+ for Word Sense Disambiguation

Xueting Huang, Jian Zhang, Yuanzhe Ma
1 citations
Natural Language Processing Techniques
0.35
article

GC-PCWR+ for Word Sense Disambiguation

Xueting Huang, Jian Zhang, Yuanzhe Ma
article en
1 citations

Abstract

Word sense disambiguation (WSD) is a significant task in the field of natural language processing, focused on determining a word’s specific meaning within a given context. The gloss-context prompt-based contextual word representation (GC-PCWR) method, first proposed, successfully applied prompt learning to the task of word sense disambiguation, yielding promising results. However, it exhibited insufficient adaptability and generalization capabilities. For this purpose, we propose the GC-PCWR+ method that improves GC-PCWR by designing more appropriate prompt templates and better embedding the method. To leverage the capability of pre-trained models for semantic information during the training phase, the GC-PCWR+ method embeds prompt templates into the context encoding. This integration of prompt information with the context of the target word provides more comprehensive semantic insights. We established a more pragmatic dataset based on Collins and additionally performed a series of experiments on template statement complexity and information complexity. Furthermore, our method outperforms baseline models across datasets with diverse annotation systems, validating the impact of varied templates on overall performance.

Dongguan University of Technology (CN)
Openalex Percentile: Top 34%
Natural Language Processing Techniques
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

GC-PCWR+ for Word Sense Disambiguation — Xueting Huang, Jian Zhang, et al. · (2024) | TGRS Research Map | TGRS