Hybrid Transformer Learning with Contextual Semantic Features for Sarcasm Detection

Sarcasm detection is a challenging problem in computational linguistics because the sentiment expressed on the surface of a sarcastic utterance frequently contradicts the sentiment its author intends. Existing detectors are also brittle: models that perform well on one platform typically degrade sharply when applied to text from a different domain or writing style. This paper proposes a context-aware hybrid model that couples a pre-trained BERT encoder with a bidirectional LSTM and an additive attention layer, and fuses the resulting contextual representation with two complementary signals — an unsupervised topic-context vector obtained from BERTopic and a set of nine handengineered linguistic cues. The model is trained only on a labelled Twitter corpus and evaluated in two regimes: an in-domain held-out Twitter test set and a zero-shot cross-domain test on a balanced, formally-written News-Headlines corpus that the model never sees during training. Against four classical TF-IDF baselines and pure transformer baselines evaluated under an identical protocol, the proposed hybrid attains the strongest in-domain results, reaching an accuracy of 0.8695 and an F1-score of 0.7945, and the zero-shot cross-domain evaluation quantifies the extent to which a tweet-trained detector generalizes to a different register. The results indicate that combining a contextual transformer encoder with unsupervised topic context and linguistic cues is an effective and transferable design for sarcasm detection.

Authors

Institutions

Publication Details

Journal
International Journal of Drug Delivery Technology
Published
2026-11-19
DOI
https://doi.org/10.25258/ijddt.16.80s.70
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Hybrid Transformer Learning with Contextual Semantic Features for Sarcasm Detection

Yuvraj G. Nikam, Dhanshri Amol Shinde, Vijay Pal Singh
3 links
International Journal of Drug Delivery Technology
Sentiment Analysis and Opinion Mining
article

Hybrid Transformer Learning with Contextual Semantic Features for Sarcasm Detection

Yuvraj G. Nikam, Dhanshri Amol Shinde, Vijay Pal Singh
article en

Abstract

Sarcasm detection is a challenging problem in computational linguistics because the sentiment expressed on the surface of a sarcastic utterance frequently contradicts the sentiment its author intends. Existing detectors are also brittle: models that perform well on one platform typically degrade sharply when applied to text from a different domain or writing style. This paper proposes a context-aware hybrid model that couples a pre-trained BERT encoder with a bidirectional LSTM and an additive attention layer, and fuses the resulting contextual representation with two complementary signals — an unsupervised topic-context vector obtained from BERTopic and a set of nine handengineered linguistic cues. The model is trained only on a labelled Twitter corpus and evaluated in two regimes: an in-domain held-out Twitter test set and a zero-shot cross-domain test on a balanced, formally-written News-Headlines corpus that the model never sees during training. Against four classical TF-IDF baselines and pure transformer baselines evaluated under an identical protocol, the proposed hybrid attains the strongest in-domain results, reaching an accuracy of 0.8695 and an F1-score of 0.7945, and the zero-shot cross-domain evaluation quantifies the extent to which a tweet-trained detector generalizes to a different register. The results indicate that combining a contextual transformer encoder with unsupervised topic context and linguistic cues is an effective and transferable design for sarcasm detection.

International Journal of Drug Delivery TechnologyVol. 16(80s)
Mangalayatan University (IN)
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon