Multi language similarity calculation based on smooth sentence vectors

Unsupervised contrastive learning models typically treat samples from the same language as positive pairs, which can lead to language bias—causing the model to assign higher semantic similarity scores to sentences in the same language. To address this issue, this paper proposes a multilingual sentence similarity computation method based on IS-CSE. First, independent language tags are explicitly added to sentences, enabling the model to perceive linguistic characteristics and enhance the consistency of multilingual sentence representations. Then, a dynamic memory buffer mechanism is introduced to reduce computational overhead while maintaining a balanced distribution of languages within the buffer, preventing any single language from dominating. Additionally, a language enhancement coefficient is incorporated to adjust the weighting of different languages in generating smooth sentence embeddings. Finally, experiments on the Tatoeba and BUCC datasets demonstrate the effectiveness of the proposed method in cross-lingual sentence retrieval, particularly in scenarios without parallel corpora, where it significantly improves sentence semantic similarity computation. The results show that the proposed model exhibits superior adaptability and robustness in multilingual tasks, providing an effective solution for semantic computation in low-resource languages.

Authors

Institutions

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1145/3746709.3746748
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi language similarity calculation based on smooth sentence vectors

De-Syuan Huang, Yiquan Wang
Topic Modeling
article

Multi language similarity calculation based on smooth sentence vectors

De-Syuan Huang, Yiquan Wang
article en

Abstract

Unsupervised contrastive learning models typically treat samples from the same language as positive pairs, which can lead to language bias—causing the model to assign higher semantic similarity scores to sentences in the same language. To address this issue, this paper proposes a multilingual sentence similarity computation method based on IS-CSE. First, independent language tags are explicitly added to sentences, enabling the model to perceive linguistic characteristics and enhance the consistency of multilingual sentence representations. Then, a dynamic memory buffer mechanism is introduced to reduce computational overhead while maintaining a balanced distribution of languages within the buffer, preventing any single language from dominating. Additionally, a language enhancement coefficient is incorporated to adjust the weighting of different languages in generating smooth sentence embeddings. Finally, experiments on the Tatoeba and BUCC datasets demonstrate the effectiveness of the proposed method in cross-lingual sentence retrieval, particularly in scenarios without parallel corpora, where it significantly improves sentence semantic similarity computation. The results show that the proposed model exhibits superior adaptability and robustness in multilingual tasks, providing an effective solution for semantic computation in low-resource languages.

Dalian University of Technology (CN)
Quality Education
Openalex Percentile: Top 88%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.