Based on the Gemini Large-scale Model, Enhanced Accuracy in Semantic Similarity Detection With the Ernie Model

The rapid development of deep learning models has been a hallmark of recent years. As the world moves towards greater intelligence, there is an urgent need for advancements in technologies like question-answering systems, chatbots, and search and recommendation engines, especially within the service and e-commerce sectors. At the heart of these advancements lies the task of detecting semantic similarity in natural language processing. Against this backdrop, this paper examines the accuracy of semantic similarity detection across different deep learning models, focusing specifically on the LSTM, Transformer, and ERNIE models under identical hyperparameters and configuration settings. The study reveals a common challenge among these models in achieving effective data generalization on the LCQMC dataset. To address this, the paper introduces an innovative approach by combining the highest-performing ERNIE model with the Gemini large-scale model and employing data augmentation techniques to enhance accuracy. This strategy increased accuracy from 82% with the ERNIE model alone to 85%.

Authors

Institutions

Publication Details

Journal
Transactions on Computer Science and Intelligent Systems Research
Published
2024-08-12
DOI
https://doi.org/10.62051/dpxb3t71
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Based on the Gemini Large-scale Model, Enhanced Accuracy in Semantic Similarity Detection With the Ernie Model

Zihang Li
Transactions on Computer Science and Intelligent Systems Research
Topic Modeling
article

Based on the Gemini Large-scale Model, Enhanced Accuracy in Semantic Similarity Detection With the Ernie Model

Zihang Li
article en

Abstract

The rapid development of deep learning models has been a hallmark of recent years. As the world moves towards greater intelligence, there is an urgent need for advancements in technologies like question-answering systems, chatbots, and search and recommendation engines, especially within the service and e-commerce sectors. At the heart of these advancements lies the task of detecting semantic similarity in natural language processing. Against this backdrop, this paper examines the accuracy of semantic similarity detection across different deep learning models, focusing specifically on the LSTM, Transformer, and ERNIE models under identical hyperparameters and configuration settings. The study reveals a common challenge among these models in achieving effective data generalization on the LCQMC dataset. To address this, the paper introduces an innovative approach by combining the highest-performing ERNIE model with the Gemini large-scale model and employing data augmentation techniques to enhance accuracy. This strategy increased accuracy from 82% with the ERNIE model alone to 85%.

Transactions on Computer Science and Intelligent Systems ResearchVol. 5
Communication University of China (CN)
Openalex Percentile: Top 89%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.