Hybrid model of speech act classification: combination of RuBERT embeddings and logical-algebraic implicants

The subject of the study is the problem of interpretable automatic classification of speech acts in Russian-language utterances, which represents one of the key tasks of modern computational linguistics and applied natural language analysis. Traditional machine learning methods and transformer models demonstrate high quality; however, they remain insufficiently transparent, hindering their application in critical areas where explainability of decisions is required. This work explores the possibility of combining contextual embeddings from RuBERT with logical-algebraic mechanisms for feature interpretation aimed at identifying stable latent structures corresponding to various types of speech acts: assertions, questions, requests, and assumptions. The study encompasses the processes of corpus formation, extraction of vector representations, construction of a classification model, and analysis of how logical rules can enhance the reliability of interpretation of results. The methodology is based on a combination of RuBERT contextual embeddings, threshold binary feature binarization, and logical-algebraic extraction of minimal implicants, applied together with a linear classifier in a hybrid architecture. The scientific novelty of the research lies in the development of a hybrid approach that combines the strengths of neural network and symbolic methods: continuous embeddings from RuBERT are used to form informative representations of text, while logical-algebraic implicants provide transparent interpretation of the classifier’s decisions. The proposed model demonstrates that it is possible to construct compact logical rules over high-dimensional embeddings, describing stable regions of the feature space and enhancing trust in the system's operation. Experimental results show that the hybrid architecture surpasses the linear classifier by 3-4 percentage points, achieving high performance. The findings confirm that logical-symbolic structures can simultaneously improve the accuracy and interpretability of models, making the approach promising for Explainable AI and the development of dialog and analytical language systems.

Authors

Publication Details

Journal
Историческая информатика
Published
2025-04-01
DOI
https://doi.org/10.7256/2585-7797.2025.4.77162
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid model of speech act classification: combination of RuBERT embeddings and logical-algebraic implicants

L. A. Lyutikova
Историческая информатика
Explainable Artificial Intelligence (XAI)
article

Hybrid model of speech act classification: combination of RuBERT embeddings and logical-algebraic implicants

L. A. Lyutikova
article en

Abstract

The subject of the study is the problem of interpretable automatic classification of speech acts in Russian-language utterances, which represents one of the key tasks of modern computational linguistics and applied natural language analysis. Traditional machine learning methods and transformer models demonstrate high quality; however, they remain insufficiently transparent, hindering their application in critical areas where explainability of decisions is required. This work explores the possibility of combining contextual embeddings from RuBERT with logical-algebraic mechanisms for feature interpretation aimed at identifying stable latent structures corresponding to various types of speech acts: assertions, questions, requests, and assumptions. The study encompasses the processes of corpus formation, extraction of vector representations, construction of a classification model, and analysis of how logical rules can enhance the reliability of interpretation of results. The methodology is based on a combination of RuBERT contextual embeddings, threshold binary feature binarization, and logical-algebraic extraction of minimal implicants, applied together with a linear classifier in a hybrid architecture. The scientific novelty of the research lies in the development of a hybrid approach that combines the strengths of neural network and symbolic methods: continuous embeddings from RuBERT are used to form informative representations of text, while logical-algebraic implicants provide transparent interpretation of the classifier’s decisions. The proposed model demonstrates that it is possible to construct compact logical rules over high-dimensional embeddings, describing stable regions of the feature space and enhancing trust in the system's operation. Experimental results show that the hybrid architecture surpasses the linear classifier by 3-4 percentage points, achieving high performance. The findings confirm that logical-symbolic structures can simultaneously improve the accuracy and interpretability of models, making the approach promising for Explainable AI and the development of dialog and analytical language systems.

Историческая информатика(4)
Openalex Percentile: Top 79%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.